Chevron Left
ETL and Data Pipelines with Shell, Airflow and Kafka(으)로 돌아가기

IBM 기술 네트워크의 ETL and Data Pipelines with Shell, Airflow and Kafka 학습자 리뷰 및 피드백

105개의 평가

강좌 소개

After taking this course, you will be able to describe two different approaches to converting raw data into analytics-ready data. One approach is the Extract, Transform, Load (ETL) process. The other contrasting approach is the Extract, Load, and Transform (ELT) process. ETL processes apply to data warehouses and data marts. ELT processes apply to data lakes, where the data is transformed on demand by the requesting/calling application. Both ETL and ELT extract data from source systems, move the data through the data pipeline, and store the data in destination systems. During this course, you will experience how ELT and ETL processing differ and identify use cases for both. You will identify methods and tools used for extracting the data, merging extracted data either logically or physically, and for importing data into data repositories. You will also define transformations to apply to source data to make the data credible, contextual, and accessible to data users. You will be able to outline some of the multiple methods for loading data into the destination system, verifying data quality, monitoring load failures, and the use of recovery mechanisms in case of failure. Finally, you will complete a shareable final project that enables you to demonstrate the skills you acquired in each module....

최상위 리뷰


2022년 6월 13일

Excellent introduction to this topics. Labs contain all you need to know how to start using this type of technologies. Highly recommended.


2022년 6월 9일

Thanks to all the instructor's efforts, one of the best DATA engineering courses, contains hands-on Experience with essential data tools.

필터링 기준:

ETL and Data Pipelines with Shell, Airflow and Kafka의 29개 리뷰 중 1~25

교육 기관: Nataliya S

2021년 10월 12일

Thanks to IBM and Coursera for the great "ETL and Data Pipelines with Shell, Airflow and Kafka" course, that I passed with Grade Achieved: 100%. It's the third course, that I've passed, as a part of "IBM Data Engineering Specialization". I was so carried away by the course that I literally sat up until 2 am almost every day. In this course I could apply my knowledge of Python, Pandas, SQL, Bash commands to build ETL Batch and Stream pipelines.

교육 기관: Evgeny D

2021년 9월 29일

I​t's one of the most challenging courses I've been enrolled!

교육 기관: Dmitry K

2021년 9월 17일

Buggy practice. Not possible to complete without fixing airflow start script yourself. Nobody monitor or fixing issues here

교육 기관: RLee

2022년 1월 13일

The final project to connect Airflow as a pipeline management tool to Kafka server is a very useful hands-on project. More details or explanations on the syntax of Python calling Kafka producer and consumer, which are in the files of and, would be more valuable rather than just providing these two files to run on its own.

교육 기관: Ilya K

2022년 1월 13일

Perfect environment to make experiments! Very easy and powerful in use.

교육 기관: Omar H

2022년 1월 26일

It's great introduction for airflow and kafka but still an introduction it is shallow doesn't offer much but at the end you will understand what you need to continue further in both technologies.

교육 기관: Chris B

2022년 4월 20일

Course content is good but labs are riddled with bugs and in dire need of quality control. I encountered many time-consuming, frustrating technical issues that made completing this course a slog. Final assignment introduces some difficult linux manipulations that were not covered in the coures and are not really that relevant to the subject matter. Some questions on the final are unclear and could be better written. Would recommend the instructors or whomever created this course to eat their own cooking and go through this course and fix the various issues.

교육 기관: Natale F

2021년 12월 15일

Interesting course with enough labs.

교육 기관: Hugo A O O

2021년 12월 6일

i really liked the labs

교육 기관: Sina S S

2022년 5월 7일

A good introductory course to airflow and kafka. Could have been broken up into at least two courses focusing on each of these platform, and going more in depth in each one. Also, the final assignment is a pain to complete especially due to some errors in instructions. But overall, It is a decent course.


2022년 1월 17일

Love the labs, but do not like the robotic lectures.

교육 기관: Sreepad P

2022년 7월 6일

The course is simply amazing which provides good amount of hands-on sessions to learn about building data pipelines with Shell scripting, Airflow and Kafka. I highly recommend this course to anyone who wants to be a Data Engineer.

교육 기관: David A S

2022년 6월 14일

Excellent introduction to this topics. Labs contain all you need to know how to start using this type of technologies. Highly recommended.

교육 기관: Mohamed A

2022년 6월 10일

Thanks to all the instructor's efforts, one of the best DATA engineering courses, contains hands-on Experience with essential data tools.

교육 기관: k b

2022년 4월 24일

Nice intro to ETL and Data Pipelines. Beginner level easy to follow hands on Airflow and Kafka.

교육 기관: Rorisang S

2022년 3월 14일

Succinctly presented. Labs really hammered the point home :)

교육 기관: Minh N T

2022년 4월 12일

Useful course for beginner Data engineer

교육 기관: Muhammad T K

2022년 7월 9일

A​bsolutely brilliant for starter

교육 기관: Chris W

2022년 4월 3일

A d​ecent overview of Airflow and Kafka. Worth it for the time invested. The labs were good, however the execution of the final assignment was poor -- you have to submit two dozen screen captures for a peer reviewed assignment. Taking screen caps of code is silly, why not just submit the code? Plus you are taking the caps before you even know if your code works. And you are relying on strangers to read and understand your code before you can get credit for the course. Fortunately, some kind soul found mine quickly and gave me 100%. My code did work -- I tested it thoroughly -- but you can't really tell from screen caps.

교육 기관: Markus Z

2022년 3월 28일

G​ood compact summary of the topics.

R​egarding the assignment: Good to have an environment for testing your code directly. Unfortunatly it was a bit unstable. Final assignment was a bit to much screenshots and lesser coding.

교육 기관: Katarzyna G

2022년 3월 26일

I​t would be much better with real instructors and with no peer review that is not objecitve and no proper ansers clue

교육 기관: David R

2022년 6월 4일

Good introduction to Airflow and Kafka however only one airflow operator is explored

교육 기관: otto z

2022년 6월 22일

It takes 1 hour to connect the lab and start the service.

교육 기관: Mbaye B

2022년 5월 14일


교육 기관: Krishnakumar K

2022년 4월 12일