Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
58credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Status: Free Trial

    IBM

    Skills you'll gain: Extract, Transform, Load, Apache Airflow, Data Pipelines, Apache Kafka, Data Warehousing, Data Transformation, Data Migration, Web Scraping, Data Integration, Shell Script, Data Processing, Data Mart, Unix Shell, Big Data, Performance Tuning, Scalability, Command-Line Interface

    4.5
    Rating, 4.5 out of 5 stars
    432 reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    DeepLearning.AI

    Skills you'll gain: Data Pipelines, Data Architecture, Requirements Analysis, Amazon Web Services, Data Warehousing, Data Modeling, Data Processing, System Requirements, Performance Tuning, Security Controls, Data Transformation, Scalability

    4.8
    Rating, 4.8 out of 5 stars
    434 reviews

    Intermediate · Course · 1 - 4 Weeks

  • Status: New
    Status: Preview

    Coursera Instructor Network

    Skills you'll gain: Data Integration, Extract, Transform, Load, Metadata Management, Amazon Redshift, Amazon Web Services, Data Pipelines, Data Warehousing, Amazon S3, Automation, Cloud-Native Computing, Data Transformation, Serverless Computing, Process Optimization, System Monitoring

    Intermediate · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    Snowflake

    Skills you'll gain: Data Engineering, Data Pipelines, Database Management, Data Manipulation, Databases, Data Transformation, Data Lakes, Extract, Transform, Load, Data Warehousing, DevOps, Cloud Development, SQL, Data Integration, CI/CD, Application Development, Artificial Intelligence and Machine Learning (AI/ML), Role-Based Access Control (RBAC), Software Development Tools, Stored Procedure, Data Analysis

    4.8
    Rating, 4.8 out of 5 stars
    267 reviews

    Beginner · Professional Certificate · 1 - 3 Months

  • Status: Free Trial

    IBM

    Skills you'll gain: Data Store, Extract, Transform, Load, Data Architecture, Data Pipelines, Big Data, Data Warehousing, Data Governance, Apache Hadoop, Relational Databases, Apache Spark, Data Lakes, Databases, SQL, NoSQL, Data Security, Data Science

    4.7
    Rating, 4.7 out of 5 stars
    3.4K reviews

    Beginner · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Metadata Management, Data Integration, Data Pipelines, Databases, Business Logic, Java, Data Warehousing, File Management, Data Cleansing, Data Import/Export, Data Migration, Data Manipulation, Scalability, Data Transformation, Software Documentation, Software Installation, Data Processing, MySQL, Debugging

    Beginner · Specialization · 1 - 3 Months

What brings you to Coursera today?

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Data Pipelines, Extract, Transform, Load, Apache Airflow, Google Cloud Platform, Data Integration, Data Migration, Data Processing, Apache Hadoop, Serverless Computing, Apache Spark, Big Data, Data Transformation

    4.5
    Rating, 4.5 out of 5 stars
    1.7K reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Google

    Skills you'll gain: Data Modeling, Database Design, Extract, Transform, Load, Databases, Data Warehousing, Database Systems, Data Pipelines, Business Intelligence, Data Integrity, Performance Tuning, Data Mart, Data Management, Process Optimization, Data Quality, Data Transformation, SQL, Performance Testing

    4.7
    Rating, 4.7 out of 5 stars
    684 reviews

    Advanced · Course · 1 - 4 Weeks

  • Status: New

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Apache Kafka, Data Processing, Serverless Computing, Real Time Data, Performance Tuning, Jupyter, SQL

    Advanced · Course · 1 - 3 Months

  • Status: Free Trial

    DeepLearning.AI

    Skills you'll gain: Extract, Transform, Load, Data Pipelines, Data Import/Export, Tensorflow, Data Processing, Feature Engineering, Data Integration, Data Transformation, Data Sharing, Data Management, Performance Tuning

    4.5
    Rating, 4.5 out of 5 stars
    534 reviews

    Intermediate · Course · 1 - 4 Weeks

  • Status: Free Trial

    Duke University

    Skills you'll gain: Data Visualization Software, PySpark, Data Visualization, Snowflake Schema, Data Storytelling, Site Reliability Engineering, Docker (Software), Databricks, Containerization, Interactive Data Visualization, Plotly, Data Pipelines, Matplotlib, Kubernetes, Dashboard, Apache Spark, Apache Hadoop, Big Data, Data Science, Python Programming

    3.8
    Rating, 3.8 out of 5 stars
    105 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Google Cloud

    Skills you'll gain: Apache Kafka, Data Pipelines, Google Cloud Platform, Java, Public Cloud, Cloud API, Network Analysis

    3.8
    Rating, 3.8 out of 5 stars
    27 reviews

    Beginner · Project · Less Than 2 Hours

Related roles

Gain the knowledge and skills you need to advance.

View all

  • Data Engineer

    This role has a £62,784 median salary ¹.

    Data Engineer

    description:

    A Data Engineer builds data pipelines for large datasets, optimizing systems and ensuring reliable data flow using tools like Hadoop and Spark.

    This role has a £62,784 median salary ¹.

    Offered by

    DeepLearning.AI_logo
    Amazon Web Services_logo
    Google Cloud_logo

  • Data Warehouse Developer

    This role has a £52,272 median salary ¹.

    Data Warehouse Developer

    description:

    A Data Warehouse Developer designs and optimizes data warehouses, ensuring efficient storage and retrieval for analytics using ETL processes.

    This role has a £52,272 median salary ¹.

    Offered by

    IBM_logo
    Vanderbilt University_logo
View all

Most popular

Trending now

New releases

What brings you to Coursera today?

Leading partners

  • Google Cloud
  • IBM
  • EDUCBA
  • Whizlabs
  • Duke University
  • Packt
  • DeepLearning.AI
  • Microsoft