Neural Network from Scratch

Challenging

63 completions

~ 30 hours

4.2

While completing this project, you will get your first experience in every aspect of creating a fully connected neural network. You will code feedforward networks and implement backpropagation and weight initialization. You will also create a training loop and visualize your model's training process. These skills will give you a solid base to continue with neural network science.

Provided by

JetBrains Academy

About

Let's train a very simple but fully connected neural network! In this project, we'll create the necessary metric functions and use custom feedforward and backpropagation methods and functions, all done by hand. The dataset for this project is Fashion-MNIST – no more boring number recognition.

Training project

This project allows you to practice and strengthen your coding skills, helping you get ready for more advanced tasks ahead.

What you'll learn

Once you choose a project, we'll provide you with a study plan that includes all the necessary topics from your course to get it built. Here’s what awaits you:

Rescale your data, predict the probabilities with the sigmoid function, and perform the Xavier weights initialization.

Use the functions to design the first half of the neural network: feedforward.

Measure your accuracy with the MSE and implement backpropagation to allow your network actually learn something.

Implement a training loop and see how your model learns.

Implement the feedforward for a more complicated two-layer model.

Defeat the boss of the two-layer neural network: backpropagation.

Use your already written train loop to see how well your two-layer model performs.

Reviews

Maxim Baev

5 months ago

5.0

The project really helped me understand the inner working of neural networks.

Roland Onderka

9 months ago

4.3

Great and challenging project. Best if you want to deeply understand neural networks.

Sinmi Ojeyomi

1 year ago

5.0

I actually enjoyed it! The math part were so stimulating. I do not consider myself an AI engineer or anything, but at least when people talk about neural networks, i can actually understand it more and think for myself

4.2

Learners who completed this project within the Introduction to Data Science course rated it as follows:

Usefulness

4.8

Fun

4.3

Clarity

3.5