RAG Pipeline Engineering Code Bootcamp
WORKSHOP SLIDES: https://docs.google.com/presentation/d/1ROXqeKzfrVftL_JvgxFhhjU_W0CmTuqFpztfn9bC2Fs/edit#
Sponsored by Segev LLP. Technology lawyer and partner Marius Adomnica will be on-site, so bring your startup and industry legal questions.
Whether you're a startup entrepreneur trying to impress customers, an application engineer looking for a promotion, or a student seeking cutting-edge skills, I believe you'll find value in this course. In this workshop, we'll cover the theory of RAG development, explain some of the most important recent research papers, and implement RAG from scratch without a framework. Optionally, you may bring your project and get live feedback from engineers.
We'll teach from the most recent survey paper on RAG techniques, linked below [1].
We'll start with thirty minutes of theory and ice-breakers, then break into pair programming teams to code for most of the session. Finally, we will have some short demos and discussions. After, there will be an optional networking event.
There are two tracks: beginner and intermediate/advanced. The beginner group will write a simple vector database-based RAG pipeline starting from the provided Python code stubs and without using LlamaIndex or Langchain. The intermediate/advanced group is encouraged to bring their own project or implement an advanced RAG technique such as RAPTOR.
Pizza and bubbly waters are generously provided by Segev LLP.
Agenda
Presentation by Toby
Use cases and non-use cases
Limitations of LLMs
RAG architecture theory
Naive RAG
Advanced RAG
Evaluation-driven development
Technical leadership
Navigating open source codebases
Major online communities
Engineers to follow
Asking effective questions online
IRL competition programming
Building your tribe in Vancouver
Advancing your career or startup
Code Workshop
Pair programming team formation
Dev environment setup
Codebase overview
Programming
Demos & discussion
[Optional] Networking
Available only to participants.