Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
57credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.
Earn a university-issued career credential in a flexible, interactive format.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Google Cloud

    Skills you'll gain: Data Pipelines, Google Cloud Platform, Cloud-Based Integration, Data Transformation, Data Integration, Big Data, Data Import/Export, Cloud Services, Data Management

    3.8
    Rating, 3.8 out of 5 stars
    6 reviews

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Pipelines, Data Import/Export, Data Processing, Data Manipulation, SQL, Data Transformation, Google Cloud Platform, Big Data, Data Management, Cloud Storage

    Intermediate · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: MongoDB, Dataflow, Applied Machine Learning, Google Cloud Platform, Data Pipelines, Big Data, Data Integration

    Intermediate · Project · Less Than 2 Hours

  • Status: New
    Status: Free Trial

    LearnKartS

    Skills you'll gain: AWS Kinesis, Amazon Redshift, Real Time Data, Data Processing, Data Pipelines, Serverless Computing, Apache Spark, Data Visualization, Big Data, Amazon Web Services, Advanced Analytics, Performance Tuning, Extract, Transform, Load, Amazon CloudWatch, Amazon S3, Data Transformation, Scalability

    Intermediate · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Metadata Management, Data Integration, Data Pipelines, Databases, Business Logic, Java, Data Warehousing, File Management, Data Cleansing, Data Import/Export, Data Migration, Data Manipulation, Scalability, Data Transformation, Software Documentation, Software Installation, Data Processing, MySQL, Debugging

    Beginner · Specialization · 1 - 3 Months

  • Status: Free Trial

    Packt

    Skills you'll gain: Databricks, CI/CD, Apache Spark, Microsoft Azure, Data Governance, Data Lakes, Data Architecture, Real Time Data, PySpark, Data Pipelines, Data Integration, Data Management, Automation, Data Storage, System Testing, Data Processing, Jupyter, Data Quality, User Provisioning, File Systems

    4.3
    Rating, 4.3 out of 5 stars
    23 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Status: Free Trial

    IBM

    Skills you'll gain: Exploratory Data Analysis, Data Wrangling, Data Transformation, Data Analysis, Data Cleansing, Data Manipulation, Data Import/Export, Predictive Modeling, Regression Analysis, Statistical Analysis, Pandas (Python Package), Scikit Learn (Machine Learning Library), Data-Driven Decision-Making, Matplotlib, Feature Engineering, Data Visualization, Data Pipelines, NumPy, Python Programming

    4.7
    Rating, 4.7 out of 5 stars
    19K reviews

    Intermediate · Course · 1 - 3 Months

  • Status: New
    Status: Free Trial

    Packt

    Skills you'll gain: Apache Kafka, Apache Spark, Apache Hadoop, Scala Programming, Real Time Data, Apache Hive, Command-Line Interface, Distributed Computing, Data Processing, Big Data, Apache, Apache Cassandra, Applied Machine Learning, Data Pipelines, Java, Databases, MongoDB, IntelliJ IDEA, NoSQL, Application Deployment

    4.5
    Rating, 4.5 out of 5 stars
    12 reviews

    Intermediate · Specialization · 3 - 6 Months

  • Status: New
    Status: Free Trial

    Coursera Instructor Network

    Skills you'll gain: Apache Kafka, Data Warehousing, Extract, Transform, Load, Microsoft SQL Servers, Snowflake Schema, Star Schema, Performance Tuning, Data Pipelines, Cloud Computing Architecture, Business Intelligence, Real Time Data, Apache Hadoop, Data Modeling, Data Quality, Responsible AI, Apache Spark, SQL, Generative AI, Data Governance, Quality Management

    4.3
    Rating, 4.3 out of 5 stars
    81 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Serverless Computing, Identity and Access Management, Google Cloud Platform, Cloud Security, Data Integrity, Performance Tuning, Data Security, CI/CD, Data Processing, Debugging, Real Time Data, System Monitoring, Cloud Storage, Issue Tracking, Data Storage Technologies, Extract, Transform, Load, Unit Testing, Data Transformation

    4.1
    Rating, 4.1 out of 5 stars
    125 reviews

    Intermediate · Specialization · 3 - 6 Months

  • Status: Free Trial

    Snowflake

    Skills you'll gain: Data Engineering, Data Manipulation, Data Lakes, Data Warehousing, Cloud Development, SQL, Data Pipelines, Extract, Transform, Load, Application Development, Artificial Intelligence and Machine Learning (AI/ML), Role-Based Access Control (RBAC), Stored Procedure, Data Storage, Database Management, LLM Application, Generative AI, Data Science, Machine Learning

    4.8
    Rating, 4.8 out of 5 stars
    161 reviews

    Beginner · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Apache Spark, Data Pipelines, PySpark, Apache Hadoop, Data Transformation, MySQL, Data Manipulation, Java Platform Enterprise Edition (J2EE), Data Store, Data Import/Export, Development Environment, Software Installation, System Configuration

    Mixed · Course · 1 - 4 Weeks