Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
58credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Serverless Computing, Identity and Access Management, Google Cloud Platform, Cloud Security, Data Integrity, Performance Tuning, Data Security, CI/CD, Data Processing, Debugging, Real Time Data, System Monitoring, Cloud Storage, Issue Tracking, Data Storage Technologies, Extract, Transform, Load, Unit Testing, Data Transformation

    4.1
    Rating, 4.1 out of 5 stars
    125 reviews

    Intermediate · Specialization · 3 - 6 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Data Pipelines, Dataflow, Extract, Transform, Load, Google Cloud Platform, Data Integration, Data Processing, Data Transformation, Big Data, Apache Spark, Apache Hadoop, Serverless Computing, Cloud Storage

    4.8
    Rating, 4.8 out of 5 stars
    16 reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Data Pipelines, Dataflow, Google Cloud Platform, Extract, Transform, Load, Data Processing, Data Transformation, Big Data, Apache Spark, Apache Hadoop, Cloud Storage

    4.4
    Rating, 4.4 out of 5 stars
    29 reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Data Pipelines, Dataflow, Google Cloud Platform, Extract, Transform, Load, Data Processing, Apache Hive, Data Integration, Apache Spark, PySpark, Serverless Computing, Apache Hadoop, Big Data, Data Migration, Data Transformation, Performance Tuning

    4.6
    Rating, 4.6 out of 5 stars
    45 reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Data Pipelines, Dataflow, Data Processing, Google Cloud Platform, Apache Airflow, Extract, Transform, Load, Big Data, Serverless Computing, Data Transformation, Data Integration, Apache Spark, Apache Hadoop

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Apache Kafka, Serverless Computing, Debugging, Identity and Access Management, Cloud Security, Data Integrity, Real Time Data, Data Processing, Data Security, Performance Tuning, System Monitoring, CI/CD, Unit Testing, Google Cloud Platform, Data Transformation, Containerization, Jupyter, Disaster Recovery

    Intermediate · Specialization · 3 - 6 Months

  • Status: Free Trial

    Snowflake

    Skills you'll gain: Data Engineering, Data Pipelines, Data Transformation, Extract, Transform, Load, Data Integration, Data Warehousing, Software Development Tools, Stored Procedure, Data Sharing, SQL, Data Analysis, GitHub, Integrated Development Environments, Command-Line Interface

    4.8
    Rating, 4.8 out of 5 stars
    121 reviews

    Intermediate · Course · 1 - 3 Months

  • Status: New
    Status: Free Trial

    Coursera

    Skills you'll gain: AWS SageMaker, Exploratory Data Analysis, Feature Engineering, Dashboard, Interactive Data Visualization, Data Presentation, Data Visualization, Data Pipelines, Project Documentation, Solution Delivery, Data Storytelling, Amazon Web Services, Data Analysis, Data Integration, Technical Documentation, Business Intelligence, Cloud Infrastructure, Technical Communication, Automation, Project Management

    Beginner · Course · 1 - 3 Months

  • Status: New
    Status: Free Trial

    Starweaver

    Skills you'll gain: AI Personalization, System Monitoring, Generative AI, Prompt Engineering, Data Processing, Extract, Transform, Load, Scalability, Large Language Modeling, Data Architecture, Data Pipelines, LLM Application, Performance Tuning, Continuous Monitoring, Enterprise Architecture, Database Systems, Data Quality, System Design and Implementation, Talent Pipelining, Process Optimization, Engineering

    Intermediate · Course · 1 - 4 Weeks

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Serverless Computing, Apache Kafka, Data Processing, Cloud Security, Identity and Access Management, Performance Tuning, Data Integrity, Google Cloud Platform, Containerization, Maintainability, Real Time Data, Debugging, Extract, Transform, Load, System Monitoring, CI/CD, Data Transformation, Unit Testing, SQL

    Intermediate · Specialization · 3 - 6 Months

  • Status: New

    Pearson

    Skills you'll gain: Data Pipelines, Data Warehousing, SQL, Google Cloud Platform, Data Processing, Data Quality, Apache Spark, Generative AI, Applied Machine Learning, Big Data, Serverless Computing, Machine Learning, Data Analysis, Time Series Analysis and Forecasting

    Intermediate · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    Fractal Analytics

    Skills you'll gain: Responsible AI, Data Governance, Data Ethics, Data Pipelines, Data Architecture, Data Management, Governance, Data Integrity, Artificial Intelligence, Metadata Management, Automation, Generative AI, Data Security

    Intermediate · Course · 1 - 4 Weeks

Related roles

Gain the knowledge and skills you need to advance.

View all

  • Data Engineer

    This role has a £62,784 median salary ¹.

    Data Engineer

    description:

    A Data Engineer builds data pipelines for large datasets, optimizing systems and ensuring reliable data flow using tools like Hadoop and Spark.

    This role has a £62,784 median salary ¹.

    Offered by

    DeepLearning.AI_logo
    Amazon Web Services_logo
    Google Cloud_logo

  • Data Warehouse Developer

    This role has a £52,272 median salary ¹.

    Data Warehouse Developer

    description:

    A Data Warehouse Developer designs and optimizes data warehouses, ensuring efficient storage and retrieval for analytics using ETL processes.

    This role has a £52,272 median salary ¹.

    Offered by

    IBM_logo
    Vanderbilt University_logo
View all

Most popular

Trending now

New releases

What brings you to Coursera today?

Leading partners

  • Google Cloud
  • IBM
  • EDUCBA
  • Whizlabs
  • Duke University
  • Packt
  • DeepLearning.AI
  • Microsoft