Project

Linear Regression from Scratch

Hard

163 completions

~ 23 hours

4.4

Learn how to implement the linear regression algorithm with Python’s classes, methods, functions, and the Numpy library. Learn about linear algebra and matrix operations. Implement the fit, predict, and score methods; get the intercept and coefficients for a model, fit a model without intercept. Compare the performance of your model against that of the Scikit-Learn Linear Regression algorithm.

Provided by

JetBrains Academy

About

Linear relationship estimation is probably the first kind of modeling we come across at school. Linear regression is one of the most popular methods for estimating linear relationships and one of the most popular machine learning algorithms. This project explains how the linear regression algorithm works. These basics will help you with model interpretation and debugging if you want to fit and predict linear models.

Graduate project

This project covers the core topics of the Coding Machine Learning Algorithms course, making it sufficiently challenging to be a proud addition to your portfolio.

At least one graduate project is required to complete the course.

What you'll learn

Once you choose a project, we'll provide you with a study plan that includes all the necessary topics from your course to get it built. Here’s what awaits you:

Implement a fit method and perform simple linear regression.

Build a prediction method and perform multiple linear regression.

Implement R² and RMSE metrics, apply the algorithm to new data, and evaluate its performance.

Compare the performance of the custom model with the scikit-learn one.

Reviews

Mario David Felix

2 years ago

5.0

How to implement an advanced linear regression from scratch without using sk learn package. Became more comfortable with object oriented programming

Viacheslav Shalisko

2 years ago

4.0

Elements of linear algebre and matrix operations, transposition, matrix dot product, direct solution of multiple linear regressions, regression fit metrics.

Steffen Mueller

2 years ago

4.7

I have learned about linear algebra, how to implement linear regression by only using python and numpy and how to use scikit-learn to achive the same. The math part was quite difficult for me at some point but the implementation where fun.

4.4

Learners who completed this project within the Coding Machine Learning Algorithms course rated it as follows:

Usefulness

4.6

Fun

4.3

Clarity

4.3