Project

A/B Test for Delivery App

Challenging
35 completions
~ 26 hours
4.1

Calculate the size of control and test groups for an experiment, conduct exploratory data analysis with statistical and visualization tools, formulate hypotheses about customer behavior, and perform statistical tests for two means.

Provided by

JetBrains Academy JetBrains Academy

About

Digital footprints left by users can be extremely useful for increasing conversions and improving user experience. Many companies use such data to test hypotheses about various product features. This is called A/B testing, where A and B are two versions of a single feature – for example, the button element. In this project, you will apply the A/B test framework to test a statistical hypothesis about the interface of a food delivery application.

Graduate project icon

Graduate project

This project covers the core topics of the Data Scientist course, making it sufficiently challenging to be a proud addition to your portfolio.

At least one graduate project is required to complete the course.

What you'll learn

Once you choose a project, we'll provide you with a study plan that includes all the necessary topics from your course to get it built. Here’s what awaits you:
Ensure correct and adequate sampling and compare the mean order value of two samples.
Find the sample size required for detecting an impact of the new design.
Study the data, find particular data features, and remove outliers.
Compare the average order value in the control and experimental groups. Test a hypothesis for two means with skewed data.
Apply the log transformation to normalize the distribution. Conduct a parametric test for the hypothesis on the equality of two means.

Reviews

AkpuruenyaChukwu
5 months ago
This is a great project to learn basic statistical concepts while also practicing EDA and data visualization. Quite hands-on and interesting. I recommend clearer instructions and a data table to explain the columns.Great course.
Joydeep Chatterjee avatar
Joydeep Chatterjee
7 months ago
Apart from the nuisances with trying to generate the plots, this was a brutal but quintessential exercise required to learn what A/B testing is about.
Bojan Gjokjevski avatar
Bojan Gjokjevski
7 months ago
Great project! Finally started to understand the topic of Hypothesis Testing. Thanks Hyperskill! :)

4.1

Learners who completed this project within the Data Scientist course rated it as follows:
Usefulness
4.7
Fun
4.0
Clarity
3.6