Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
58credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Metadata Management, Data Integration, Data Pipelines, Databases, Business Logic, Java, Data Warehousing, File Management, Data Cleansing, Data Import/Export, Data Migration, Data Manipulation, Scalability, Data Transformation, Software Documentation, Software Installation, Data Processing, MySQL, Debugging

    Beginner · Specialization · 1 - 3 Months

  • Google Cloud

    Skills you'll gain: Data Wrangling, Data Transformation, Data Pipelines, Extract, Transform, Load, Cloud Engineering, Google Cloud Platform, Data Integration, Cloud Development, Cloud-Based Integration, Data Analysis, Database Administration, Data Management

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Dataflow, Google Cloud Platform, NoSQL, Cloud Storage, Data Pipelines, Data Integration, Data Storage Technologies, Data Processing, Big Data, Data Validation

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Pipelines, Google Cloud Platform, Cloud-Based Integration, Data Transformation, Data Integration, Big Data, Data Import/Export, Cloud Services, Data Management

    3.8
    Rating, 3.8 out of 5 stars
    6 reviews

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Cloud-Based Integration, Real Time Data, Data Pipelines, Apache Spark, Data Integration, Data Transformation, Data Wrangling, Data Analysis, Data Visualization, Data Management

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Grafana, Apache Kafka, Real Time Data, Data Pipelines, Dashboard, Data Synthesis, Interactive Data Visualization, Data Visualization Software, Data Analysis

    Intermediate · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Google Cloud Platform, Data Processing, Real Time Data, Cloud Storage

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Wrangling, Command-Line Interface, Data Transformation, Data Processing, Data Pipelines, Google Cloud Platform, Data Integration, Data Management, Database Administration

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Manipulation, Data Processing, Data Pipelines, Data Transformation, Data Quality, Data Cleansing, Data Import/Export, Extract, Transform, Load, Exploratory Data Analysis, Big Data, Google Cloud Platform, Google Analytics

    Intermediate · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Pipelines, Data Import/Export, Data Processing, Data Manipulation, SQL, Data Transformation, Google Cloud Platform, Big Data, Data Management, Cloud Storage

    Intermediate · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Processing, Google Cloud Platform, Data Store, Data Pipelines, Data Capture, Unstructured Data, Cloud API, Geographic Information Systems, Document Management, Cloud Storage, Serverless Computing, Business Process

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: MLOps (Machine Learning Operations), Google Cloud Platform, Applied Machine Learning, Data Pipelines, CI/CD, Machine Learning

    Intermediate · Project · Less Than 2 Hours

Related roles

Gain the knowledge and skills you need to advance.

View all

  • Data Engineer

    This role has a £62,784 median salary ¹.

    Data Engineer

    description:

    A Data Engineer builds data pipelines for large datasets, optimizing systems and ensuring reliable data flow using tools like Hadoop and Spark.

    This role has a £62,784 median salary ¹.

    Offered by

    DeepLearning.AI_logo
    Amazon Web Services_logo
    Google Cloud_logo

  • Data Warehouse Developer

    This role has a £52,272 median salary ¹.

    Data Warehouse Developer

    description:

    A Data Warehouse Developer designs and optimizes data warehouses, ensuring efficient storage and retrieval for analytics using ETL processes.

    This role has a £52,272 median salary ¹.

    Offered by

    IBM_logo
    Vanderbilt University_logo
View all

Most popular

Trending now

New releases

What brings you to Coursera today?

Leading partners

  • Google Cloud
  • IBM
  • EDUCBA
  • Whizlabs
  • Duke University
  • Packt
  • DeepLearning.AI
  • Microsoft