Project

Building the Naive RAG

Hard

58 completions

~ 10 hours

4.4

Unleash the film writer in you as you build a complete Retrieval-Augmented Generation (RAG) system. You'll master the RAG pipeline—from efficient data ingestion and processing, to context-aware generation.

Provided by

JetBrains Academy

About

Movies whisk us away to magical realms and ignite our imagination. So why settle for just watching your favourite films when you can re-imagine them? In this project, you'll feed a large language model a dataset of movie scripts to craft brand-new scenes, character dialogues, and even invent entirely new twists.

Graduate project

This project covers the core topics of the Introduction to AI Engineering with Python course, making it sufficiently challenging to be a proud addition to your portfolio.

At least one graduate project is required to complete the course.

What you'll learn

Once you choose a project, we'll provide you with a study plan that includes all the necessary topics from your course to get it built. Here’s what awaits you:

Divide the ingested script into smaller, context-preserving chunks.

Transform the text chunks into high-dimensional vector embeddings that capture their semantic meaning.

Process user queries and perform similarity searches on the embeddings. Fetch the most relevant scenes based on user queries.

Provide the LLM with the retrieved context along with supplementary instructions.

Reviews

Anushka Weerasooriya

4 months ago

4.3

An interesting project, with a heavy focus on LangChain integrations, that glues together retrieving and parsing movie scripts from a retro website, splitting, embedding and storing that data in a local vector-store db, then querying those vectors and generating new content based off of it, all with ...

Dakouri Maurille-Constant Kobri

7 months ago

5.0

I built a complete Naive RAG pipeline end-to-end: ingesting movie scripts from IMSDb, cleaning and splitting them into scene-sized chunks, embedding those chunks, and storing them in a vector database (Qdrant) for fast similarity search. I learned how to improve retrieval by rewriting user queries w ...

Marcin Borkowski

11 months ago

5.0

I have learned bases of langchain, how it works and how helpful it is

4.4

Learners who completed this project within the Introduction to AI Engineering with Python course rated it as follows:

Usefulness

4.6

Fun

4.5

Clarity

4.2