Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
58credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Google Cloud

    Skills you'll gain: MongoDB, Dataflow, Applied Machine Learning, Google Cloud Platform, Data Pipelines, Big Data, Data Integration

    Intermediate · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Loss Prevention, Personally Identifiable Information, Data Pipelines, Cloud-Based Integration, Cloud Storage, Data Security, Data Integration, Data Management, Data Transformation, Cloud Management, DevOps

    Advanced · Project · Less Than 2 Hours

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Metadata Management, Data Integration, Data Pipelines, Databases, Business Logic, Java, Data Warehousing, File Management, Data Cleansing, Data Import/Export, Data Migration, Data Manipulation, Scalability, Data Transformation, Software Documentation, Software Installation, Data Processing, MySQL, Debugging

    Beginner · Specialization · 1 - 3 Months

  • Status: New
    Status: Free Trial

    LearnKartS

    Skills you'll gain: AWS Kinesis, Amazon Redshift, Real Time Data, Data Processing, Data Pipelines, Serverless Computing, Apache Spark, Data Visualization, Big Data, Amazon Web Services, Advanced Analytics, Performance Tuning, Extract, Transform, Load, Amazon CloudWatch, Amazon S3, Data Transformation, Scalability

    Intermediate · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    Coursera Instructor Network

    Skills you'll gain: Apache Kafka, Data Warehousing, Extract, Transform, Load, Microsoft SQL Servers, Snowflake Schema, Star Schema, Performance Tuning, Data Pipelines, Cloud Computing Architecture, Business Intelligence, Real Time Data, Apache Hadoop, Data Modeling, Data Quality, Responsible AI, Apache Spark, SQL, Generative AI, Data Governance, Quality Management

    4.3
    Rating, 4.3 out of 5 stars
    81 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Status: New
    Status: Free Trial

    Packt

    Skills you'll gain: Apache Kafka, Apache Spark, Apache Hadoop, Scala Programming, Real Time Data, Apache Hive, Command-Line Interface, Distributed Computing, Data Processing, Big Data, Apache, Apache Cassandra, Applied Machine Learning, Data Pipelines, Java, Databases, MongoDB, IntelliJ IDEA, NoSQL, Application Deployment

    4.5
    Rating, 4.5 out of 5 stars
    12 reviews

    Intermediate · Specialization · 3 - 6 Months

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Apache Spark, Data Pipelines, PySpark, Apache Hadoop, Data Transformation, MySQL, Data Manipulation, Java Platform Enterprise Edition (J2EE), Data Store, Data Import/Export, Development Environment, Software Installation, System Configuration

    Mixed · Course · 1 - 4 Weeks

  • Status: Free Trial

    Packt

    Skills you'll gain: Databricks, CI/CD, Apache Spark, Microsoft Azure, Data Governance, Data Lakes, Data Architecture, Real Time Data, PySpark, Data Pipelines, Data Integration, Data Management, Automation, Data Storage, System Testing, Data Processing, Jupyter, Data Quality, User Provisioning, File Systems

    4.3
    Rating, 4.3 out of 5 stars
    23 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Status: Free Trial

    IBM

    Skills you'll gain: Exploratory Data Analysis, Data Wrangling, Data Transformation, Data Analysis, Data Cleansing, Data Manipulation, Data Import/Export, Predictive Modeling, Regression Analysis, Statistical Analysis, Pandas (Python Package), Scikit Learn (Machine Learning Library), Data-Driven Decision-Making, Matplotlib, Feature Engineering, Data Visualization, Data Pipelines, NumPy, Python Programming

    4.7
    Rating, 4.7 out of 5 stars
    19K reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Snowflake

    Skills you'll gain: Data Engineering, Data Manipulation, Data Lakes, Data Warehousing, Cloud Development, SQL, Data Pipelines, Extract, Transform, Load, Application Development, Artificial Intelligence and Machine Learning (AI/ML), Role-Based Access Control (RBAC), Stored Procedure, Data Storage, Database Management, LLM Application, Generative AI, Data Science, Machine Learning

    4.8
    Rating, 4.8 out of 5 stars
    161 reviews

    Beginner · Course · 1 - 4 Weeks

  • Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Data Transformation, Extract, Transform, Load, Data Processing, Google Cloud Platform, Serverless Computing, Big Data, Apache Spark, Apache Hadoop, Cloud Storage, Performance Tuning

    Intermediate · Course · 1 - 3 Months

  • Packt

    Skills you'll gain: Snowflake Schema, Data Pipelines, Apache Airflow, Data Security, Data Infrastructure, Data Governance, Data Architecture, Extract, Transform, Load, Apache Kafka, Data Lakes, Data Management, Performance Tuning, PySpark, Data Warehousing, Amazon S3, Amazon Web Services, Real Time Data, Data Processing, SQL, Stored Procedure

    Intermediate · Course · 3 - 6 Months