Data Engineering and ETL

Name: Data Engineering and ETL
Rating: 4.3 (1 reviews)

4.385 hours151 learnersBeta

Learn how to collect, store, transform, and manage data using Python and SQL, working with both relational and NoSQL databases. Through hands-on practice with PostgreSQL, MongoDB, and Apache Airflow, you'll build reliable data pipelines and understand how data flows through real-world systems, preparing you for entry-level data engineering roles.

Provided by

JetBrains Academy

See course content2 days ago last updated

No credit card required

Our students are building their future at:

Study at your own pace

Fit learning around your schedule. Suitable for all levels.

Learn from the experts

Short, practical text lessons by seasoned developers.

Become job-ready

Integrated with professional tools by JetBrains.

Join the community

Trusted by learners worldwide, confirmed by Trustpilot

What you'll learn

By the end of this course, you will be able to:

Understand the role of data engineering and how data is collected, stored, and used in analytics systems;
Use Python, Pandas, and SQL to read, clean, transform, and move data between systems;
Design and work with relational databases and write efficient SQL queries;
Work with NoSQL databases such as MongoDB and understand when to use them;
Build and schedule basic ETL pipelines using Apache Airflow;
Apply data quality, performance, and optimization techniques to maintain reliable data systems.

Course program

View all 36 sections

This course includes:

1060+: Choice problems
790+: Coding problems
266: Theoretical articles
18: Projects to choose from

See course content

Learn by doing

# 1

Apply knowledge into practice

You already know the theory. Now it's time to code like you do at work—in a professional IDE, with real project constraints, solving problems that actually matter. Welcome to software engineering as it should be.

# 2

Navigate complexity with surgical precision

Most developers waste months learning random concepts without seeing how they connect. Our interactive Knowledge Map fixes this. It shows exactly how every programming concept relates to others, helping you build a structured mental model of coding.

# 3

Copy the best. Then improve.

Here's what top engineers do that others don't: they study other people's code obsessively. When you get stuck on Hyperskill, you can explore solutions published by other developers. See their exact code. Understand their approach. Learn their tricks.

# 4

Code review that actually makes you better

We stripped code review down to what actually matters: does your solution work? Have you handled the edge cases? Is there a cleaner way to write this? Hyperskill acts like a competent reviewer who actually tests your code. Not genius-level analysis, not architecture debates — just solid feedback on making your code better.

Elevate your engineering mastery through real-world challenges

Master advanced engineering concepts through ambitious projects. Each project deepens your expertise and transforms you from an experienced engineer into an exceptional one.

NBA Data Preprocessing

Data preprocessing is one of the first steps in the machine learning workflow. The main idea is to transform raw data into a format that machine learning algorithms can easily understand. The predictive performance of a machine learning model highly depends on the input data quality. Thus, it's an absolute must to know how to improve the quality of your input data by removing the features with low predictive value, engineering new ones, and dealing with multicollinearity. With this project, you'll apply these concepts to NBA data to get a high-quality dataset ready to be fed to a linear model!

Graduate

Working with Scientific Papers

In this project, you'll explore the rich collection of research articles on arXiv while gaining hands-on experience with SQL. You'll start by mastering basic SQL queries to extract and analyze article metadata, including authors, titles, and abstracts. As you progress, you'll learn to perform similarity searches using vector embeddings.

Graduate

Explore all projects

Learn from the industry experts

JetBrains Academy

JetBrains Academy is a part of JetBrains, a global software company specializing in the creation of intelligent, productivity-enhancing tools for software developers and teams. With years of expertise in software development and education, JetBrains Academy empowers more than a million people worldwide to learn and teach computer science, and help organizations inspire their teams to reach their goals in tech. Professional development tools play a big role in computer science education. This is why JetBrains Academy courses offer integration with JetBrains IDEs. This integration assists learners in getting experience with real development processes to streamline their learning curve at future work.