From 190d2823ab2be353cb44dfe47b520f4a60db54d2 Mon Sep 17 00:00:00 2001 From: Rohit Ghumare Date: Sat, 9 May 2026 14:25:49 +0100 Subject: [PATCH] docs: rebuild README, ROADMAP, CONTRIBUTING, banner as blueprint manual MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Aligns the repo's docs with the new website aesthetic (cream + blueprint, print-manual tone) without breaking site/build.js, which parses README + ROADMAP + glossary into site/data.js. assets/banner.svg Replaces the dark gradient + coral coral banner with a cream + blueprint reference-manual banner: VT323 wordmark, dotted-paper background, FIG_000 caption, isometric stack diagram of the 20-phase curriculum, ASCII rule band along the bottom edge. README.md (-640 lines) Drops the marketing intro: hype quote, "Why This Course?" comparison table, "AI-Native Learning" prose, "Built-in Skills" table, "Every Lesson Ships Something" four-card row, the colorful 20-phase pill nav, decorative emojis throughout headings, the per-lesson Type shield image (![Build](shields.io...) β†’ plain "Build" / "Learn"), and the per-lesson Lang emoji flags (🐍 🟦 πŸ¦€ 🟣 βš›οΈ β†’ plain "Python, TypeScript, Rust" β€” both forms are parser-equivalent in build.js). Adds a manual-style preface, terse "How each lesson is built" structural doc, monochrome blueprint-themed shields.io badges (license, lessons, phases, stars, web), and a contents anchor. Phase 0 heading switches from the shield-image form to the plain ### Phase 0: Setup & Tooling `12 lessons` form (build.js supports both). Phase 1-19
headers drop their decorative emoji prefix (🟣 πŸ”΅ 🟒 🟠 …) β€” build.js's regex makes the prefix optional. Verified: node site/build.js diff before/after shows identical phase count (20), lesson count (416), glossary terms (83), and identical PHASES content modulo Phase 0's description (emoji + asterisks dropped on purpose). All 416 lesson rows preserved with correct types/langs. ROADMAP.md Lighter touch: keeps the βœ… 🚧 ⬚ status glyphs (parser-critical), adds a one-line note that build.js parses these glyphs and they must not change shape, slight cleanup of the legend separator. CONTRIBUTING.md Adds a load-bearing section for new contributors: explains that README and ROADMAP feed site/build.js, lists the parser-critical patterns (phase header forms, lesson table column shape, status glyphs), and gives the validation command (run node site/build.js, git diff site/data.js should be timestamp-only). Replaces the "Thank you for wanting to make AI education better for everyone" opener with a more direct intro and adds a Style section that matches the manual's voice. site/data.js Auto-regenerated by node site/build.js. Only field that changes is PHASES[0].desc (Phase 0 description, which we intentionally rewrote to drop the emoji + italics). --- CONTRIBUTING.md | 32 +- README.md | 1592 +++++++++++++++++++-------------------------- ROADMAP.md | 8 +- assets/banner.svg | 210 +++--- site/data.js | 4 +- 5 files changed, 803 insertions(+), 1043 deletions(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index 4a72e3d2f..d7bab33ef 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -1,6 +1,26 @@ -# Contributing to AI Engineering from Scratch +# Contributing -Thank you for wanting to make AI education better for everyone. +Lessons, translations, fixes, outputs β€” all welcome. One contribution per pull +request keeps reviews fast and lets contributor counts and credit work +correctly. + +## Important: the README and ROADMAP feed the website + +`site/build.js` parses `README.md`, `ROADMAP.md`, and `glossary/terms.md` to +generate `site/data.js`. Two patterns must stay intact in any pull request that +touches those files: + +- Phase headers in either `### Phase N: Name \`X lessons\`` form or + `
Phase N β€” Name ... X lessons ... Description` form. +- Lesson tables with the column shape `| # | Lesson | Type | Lang |` (or + `| # | Project | Combines | Lang |` for capstone tables). The `Lang` column + accepts plain text (`Python, TypeScript`) or the legacy emoji flags + (`🐍 🟦 πŸ¦€ 🟣 βš›οΈ`); both are parser-equivalent. +- ROADMAP status glyphs (`βœ…`, `🚧`, `⬚`) on phase headers and lesson rows. + Do not replace them with text β€” the parser keys off the exact characters. + +Run `node site/build.js` after editing those files; `git diff site/data.js` +should show only the timestamp change if your edit was structural-safe. ## Ways to Contribute @@ -133,3 +153,11 @@ More exercises and projects are always welcome, especially ones that connect mul ## Code of Conduct See [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md). Be kind, be helpful, be constructive. + +## Style + +- Direct prose. Cut filler. Match the manual's tone, not marketing copy. +- No decorative emojis in headings. Lang column emoji flags are the one + exception and only because the parser maps them. +- Code runs as-is with the dependencies listed in the lesson. +- Build from scratch first, framework second. diff --git a/README.md b/README.md index 72afa76c5..dac9ec50d 100644 --- a/README.md +++ b/README.md @@ -1,967 +1,725 @@ -
+

+ AI Engineering from Scratch β€” reference manual banner +

-AI Engineering from Scratch - -# 🧠 AI Engineering from Scratch - -### *From linear algebra to autonomous agent swarms. learn AI **with** AI, then ship the tools.* - - -[![License: MIT](https://img.shields.io/badge/License-MIT-A8E6CF?style=for-the-badge&labelColor=0D1117)](LICENSE) -[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-FF8B94?style=for-the-badge&labelColor=0D1117)](CONTRIBUTING.md) -[![Lessons](https://img.shields.io/badge/Lessons-260%2B-FFD93D?style=for-the-badge&labelColor=0D1117)](ROADMAP.md) -[![Phases](https://img.shields.io/badge/Phases-20-6BCB77?style=for-the-badge&labelColor=0D1117)](#-the-journey) -[![Hours](https://img.shields.io/badge/Hours-~290-4D96FF?style=for-the-badge&labelColor=0D1117)](ROADMAP.md) -[![Stars](https://img.shields.io/github/stars/rohitg00/ai-engineering-from-scratch?style=for-the-badge&labelColor=0D1117&color=FFC75F)](https://github.com/rohitg00/ai-engineering-from-scratch/stargazers) - - -[![Python](https://img.shields.io/badge/Python-3776AB?style=flat-square&logo=python&logoColor=white)](#) -[![TypeScript](https://img.shields.io/badge/TypeScript-3178C6?style=flat-square&logo=typescript&logoColor=white)](#) -[![Rust](https://img.shields.io/badge/Rust-000000?style=flat-square&logo=rust&logoColor=white)](#) -[![Julia](https://img.shields.io/badge/Julia-9558B2?style=flat-square&logo=julia&logoColor=white)](#) -[![PyTorch](https://img.shields.io/badge/PyTorch-EE4C2C?style=flat-square&logo=pytorch&logoColor=white)](#) -[![JAX](https://img.shields.io/badge/JAX-9C27B0?style=flat-square&logo=google&logoColor=white)](#) -[![Claude Code](https://img.shields.io/badge/Claude_Code-D97757?style=flat-square&logo=anthropic&logoColor=white)](#-ai-native-learning) -[![MCP](https://img.shields.io/badge/MCP-000000?style=flat-square&logo=anthropic&logoColor=white)](#) - -### 🧭 Quick Navigation - -[**πŸš€ Get Started**](#-getting-started)  Β·  -[**πŸ€– AI-Native**](#-ai-native-learning)  Β·  -[**πŸ—ΊοΈ The Journey**](#-the-journey)  Β·  -[**🧰 Toolkit**](#-course-output-the-toolkit)  Β·  -[**πŸ“š Glossary**](glossary/terms.md)  Β·  -[**πŸ›£οΈ Roadmap**](ROADMAP.md)  Β·  -[**🀝 Contribute**](CONTRIBUTING.md)  Β·  -[**🌐 Website**](https://aiengineeringfromscratch.com) - -
+

+ MIT License + 280+ lessons + 20 phases + GitHub stars + Website +

--- -
+> A reference manual for people who want to design and build AI systems from first principles. +> +> Twenty phases. 280+ lessons. Python, TypeScript, Rust, Julia. Every lesson produces something +> reusable: prompts, skills, agents, MCP servers. Free, open source, MIT licensed. -> ### πŸ’¬ *"84% of students already use AI tools. Only 18% feel prepared to use them professionally.* -> ### *This course closes that gap."* +## Preface -
+Have you ever wondered how a transformer actually pays attention? Or what backpropagation is doing +under the hood when your loss curve drops? Or why a tokenizer ends up splitting *playing* into +three pieces? -**283+ lessons. 20 phases. ~320 hours.** From linear algebra to autonomous agent swarms. Python, TypeScript, Rust, Julia. Every lesson produces something reusable: prompts, skills, agents, and MCP servers. +If you have, this is for you. This isn't a tutorial. It's a manual that explains how the things you +use every day β€” gradient descent, attention, retrieval-augmented generation, multi-agent +orchestration β€” actually work. Every algorithm gets implemented from raw math. No magic wrappers. +You write the backprop, the tokenizer, the attention mechanism, the agent loop. -You don't just learn AI. You learn AI **with** AI. Then you build real things. Then you ship tools others can use. +It won't make you a better ML engineer tomorrow. There's nothing actionable in here you can paste +into a Jupyter cell. But knowing how things work comes in handy when you're debugging a model that +loses signal halfway through training, or you're trying to figure out why your agent keeps +hallucinating tool calls. -
+You don't need to be a researcher to read this. You just need to be curious and willing to write +the code yourself. -### πŸ†š Why This Course? - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
πŸ“Ί Traditional Courses🧠 This Course
Scope
One slice (NLP or Vision or Agents)		Scope
🌍 Everything β€” math Β· ML Β· DL Β· NLP Β· vision Β· speech Β· transformers Β· LLMs Β· agents Β· swarms
Languages
Python only		Languages
🐍 Python Β· 🟦 TypeScript Β· πŸ¦€ Rust Β· 🟣 Julia
Output
"I learned something"		Output
πŸ“¦ A portfolio of tools, prompts, skills, and agents you can install
Depth
Surface-level or theory-heavy		Depth
πŸ”¬ Build from scratch first, then use frameworks
Format
Videos you watch		Format
πŸ’» Runnable code + docs + web app + AI-powered quizzes
Style
Passive consumption		Style
πŸ€– AI-native β€” Claude Code skills test you as you go
- ---- - -
- -## πŸ€– AI-Native Learning - -### *This isn't a course you watch. It's a course you **use with your AI coding agent**.* - -
- -### 🎯 Learn with AI, not just about AI - -```bash -# πŸ§ͺ Find where to start based on what you already know -/find-your-level - -# βœ… Quiz yourself after completing a phase -/check-understanding 3 - -# πŸ“¦ Every lesson produces a reusable artifact -ls phases/03-deep-learning-core/05-loss-functions/outputs/ -# β”œβ”€β”€ prompt-loss-function-selector.md -# └── prompt-loss-debugger.md -``` - -### πŸ› οΈ Built-in Claude Code Skills - -| 🎴 Skill | ⚑ What it does | -|---------|----------------| -| [![find-your-level](https://img.shields.io/badge/%2Ffind--your--level-A8E6CF?style=flat-square&labelColor=0D1117)](.claude/skills/find-your-level/SKILL.md) | 🧭 10-question quiz that maps your knowledge to a starting phase and builds a personalized path with hour estimates | -| [![check-understanding](https://img.shields.io/badge/%2Fcheck--understanding-FFD93D?style=flat-square&labelColor=0D1117)](.claude/skills/check-understanding/SKILL.md) | πŸ“ Per-phase quiz (8 questions) with feedback and specific lessons to review | - -### 🚒 Every Lesson Ships Something - -Other courses end with *"congratulations, you learned X."* Our lessons end with a **reusable tool**: - - - - - - - - -
- -πŸ“
**Prompts**
-Paste into any AI assistant for expert-level help - -		 - -🎴
**Skills**
-Install into Claude Code, Cursor, or any agent - -		 - -πŸ€–
**Agents**
-Deploy as autonomous workers - -		 - -πŸ”Œ
**MCP Servers**
-Plug into any MCP-compatible AI app - -
- -> 277-term searchable glossary. Full lesson catalog. ~306 hours of content with per-lesson time estimates.
-> 🌐 [**Browse the website β†’**](https://aiengineeringfromscratch.com) - ---- - -
- -## πŸ—ΊοΈ The Journey - -### *20 phases Β· 283+ lessons Β· click any phase to expand* - -[![Phase 0](https://img.shields.io/badge/0-Setup-95A5A6?style=flat-square)](#phase-0) -[![Phase 1](https://img.shields.io/badge/1-Math-9B59B6?style=flat-square)](#phase-1) -[![Phase 2](https://img.shields.io/badge/2-ML-3498DB?style=flat-square)](#phase-2) -[![Phase 3](https://img.shields.io/badge/3-Deep_Learning-1ABC9C?style=flat-square)](#phase-3) -[![Phase 4](https://img.shields.io/badge/4-Vision-E67E22?style=flat-square)](#phase-4) -[![Phase 5](https://img.shields.io/badge/5-NLP-E74C3C?style=flat-square)](#phase-5) -[![Phase 6](https://img.shields.io/badge/6-Speech-F39C12?style=flat-square)](#phase-6) -[![Phase 7](https://img.shields.io/badge/7-Transformers-2ECC71?style=flat-square)](#phase-7) -[![Phase 8](https://img.shields.io/badge/8-GenAI-FF6B9D?style=flat-square)](#phase-8) -[![Phase 9](https://img.shields.io/badge/9-RL-8E44AD?style=flat-square)](#phase-9) -[![Phase 10](https://img.shields.io/badge/10-LLMs-D97757?style=flat-square)](#phase-10) -[![Phase 11](https://img.shields.io/badge/11-LLM_Eng-C0392B?style=flat-square)](#phase-11) -[![Phase 12](https://img.shields.io/badge/12-Multimodal-16A085?style=flat-square)](#phase-12) -[![Phase 13](https://img.shields.io/badge/13-Tools-2980B9?style=flat-square)](#phase-13) -[![Phase 14](https://img.shields.io/badge/14-Agents-D35400?style=flat-square)](#phase-14) -[![Phase 15](https://img.shields.io/badge/15-Autonomous-8E44AD?style=flat-square)](#phase-15) -[![Phase 16](https://img.shields.io/badge/16-Swarms-27AE60?style=flat-square)](#phase-16) -[![Phase 17](https://img.shields.io/badge/17-Production-34495E?style=flat-square)](#phase-17) -[![Phase 18](https://img.shields.io/badge/18-Ethics-D7BDE2?style=flat-square)](#phase-18) -[![Phase 19](https://img.shields.io/badge/19-Capstone-F1C40F?style=flat-square)](#phase-19) - -**Legend:** ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) hands-on implementation  Β·  ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) concept + intuition - -
- -
- - - -
- - -### ![](https://img.shields.io/badge/Phase_0-Setup_&_Tooling-95A5A6?style=for-the-badge) `12 lessons` -> πŸ› οΈ *Get your environment ready for everything that follows.* - -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Dev Environment](phases/00-setup-and-tooling/01-dev-environment/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟦 πŸ¦€ | -| 02 | [Git & Collaboration](phases/00-setup-and-tooling/02-git-and-collaboration/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | -| 03 | [GPU Setup & Cloud](phases/00-setup-and-tooling/03-gpu-setup-and-cloud/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [APIs & Keys](phases/00-setup-and-tooling/04-apis-and-keys/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟦 | -| 05 | [Jupyter Notebooks](phases/00-setup-and-tooling/05-jupyter-notebooks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Python Environments](phases/00-setup-and-tooling/06-python-environments/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Docker for AI](phases/00-setup-and-tooling/07-docker-for-ai/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Editor Setup](phases/00-setup-and-tooling/08-editor-setup/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | β€” | -| 09 | [Data Management](phases/00-setup-and-tooling/09-data-management/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Terminal & Shell](phases/00-setup-and-tooling/10-terminal-and-shell/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | -| 11 | [Linux for AI](phases/00-setup-and-tooling/11-linux-for-ai/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | -| 12 | [Debugging & Profiling](phases/00-setup-and-tooling/12-debugging-and-profiling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟣 Phase 1 β€” Math Foundations  22 lessons  The intuition behind every AI algorithm, through code. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Linear Algebra Intuition](phases/01-math-foundations/01-linear-algebra-intuition/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 🟣 | -| 02 | [Vectors, Matrices & Operations](phases/01-math-foundations/02-vectors-matrices-operations/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟣 | -| 03 | [Matrix Transformations & Eigenvalues](phases/01-math-foundations/03-matrix-transformations/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟣 | -| 04 | [Calculus for ML: Derivatives & Gradients](phases/01-math-foundations/04-calculus-for-ml/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 05 | [Chain Rule & Automatic Differentiation](phases/01-math-foundations/05-chain-rule-and-autodiff/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Probability & Distributions](phases/01-math-foundations/06-probability-and-distributions/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 07 | [Bayes' Theorem & Statistical Thinking](phases/01-math-foundations/07-bayes-theorem/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Optimization: Gradient Descent Family](phases/01-math-foundations/08-optimization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Information Theory: Entropy, KL Divergence](phases/01-math-foundations/09-information-theory/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 10 | [Dimensionality Reduction: PCA, t-SNE, UMAP](phases/01-math-foundations/10-dimensionality-reduction/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Singular Value Decomposition](phases/01-math-foundations/11-singular-value-decomposition/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟣 | -| 12 | [Tensor Operations](phases/01-math-foundations/12-tensor-operations/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Numerical Stability](phases/01-math-foundations/13-numerical-stability/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Norms & Distances](phases/01-math-foundations/14-norms-and-distances/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Statistics for ML](phases/01-math-foundations/15-statistics-for-ml/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [Sampling Methods](phases/01-math-foundations/16-sampling-methods/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Linear Systems](phases/01-math-foundations/17-linear-systems/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Convex Optimization](phases/01-math-foundations/18-convex-optimization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [Complex Numbers for AI](phases/01-math-foundations/19-complex-numbers/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | [The Fourier Transform](phases/01-math-foundations/20-fourier-transform/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 21 | [Graph Theory for ML](phases/01-math-foundations/21-graph-theory/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 22 | [Stochastic Processes](phases/01-math-foundations/22-stochastic-processes/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | - -
- -
-πŸ”΅ Phase 2 β€” ML Fundamentals  18 lessons  Classical ML β€” still the backbone of most production AI. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [What Is Machine Learning](phases/02-ml-fundamentals/01-what-is-machine-learning/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Linear Regression from Scratch](phases/02-ml-fundamentals/02-linear-regression/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Logistic Regression & Classification](phases/02-ml-fundamentals/03-logistic-regression/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Decision Trees & Random Forests](phases/02-ml-fundamentals/04-decision-trees/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Support Vector Machines](phases/02-ml-fundamentals/05-support-vector-machines/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [KNN & Distance Metrics](phases/02-ml-fundamentals/06-knn-and-distances/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Unsupervised Learning: K-Means, DBSCAN](phases/02-ml-fundamentals/07-unsupervised-learning/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Feature Engineering & Selection](phases/02-ml-fundamentals/08-feature-engineering/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Model Evaluation: Metrics, Cross-Validation](phases/02-ml-fundamentals/09-model-evaluation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Bias, Variance & the Learning Curve](phases/02-ml-fundamentals/10-bias-variance/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 11 | [Ensemble Methods: Boosting, Bagging, Stacking](phases/02-ml-fundamentals/11-ensemble-methods/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Hyperparameter Tuning](phases/02-ml-fundamentals/12-hyperparameter-tuning/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [ML Pipelines & Experiment Tracking](phases/02-ml-fundamentals/13-ml-pipelines/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Naive Bayes](phases/02-ml-fundamentals/14-naive-bayes/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Time Series Fundamentals](phases/02-ml-fundamentals/15-time-series/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [Anomaly Detection](phases/02-ml-fundamentals/16-anomaly-detection/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Handling Imbalanced Data](phases/02-ml-fundamentals/17-imbalanced-data/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Feature Selection](phases/02-ml-fundamentals/18-feature-selection/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟒 Phase 3 β€” Deep Learning Core  13 lessons  Neural networks from first principles. No frameworks until you build one. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [The Perceptron: Where It All Started](phases/03-deep-learning-core/01-the-perceptron/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 02 | [Multi-Layer Networks & Forward Pass](phases/03-deep-learning-core/02-multi-layer-networks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Backpropagation from Scratch](phases/03-deep-learning-core/03-backpropagation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Activation Functions: ReLU, Sigmoid, GELU & Why](phases/03-deep-learning-core/04-activation-functions/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Loss Functions: MSE, Cross-Entropy, Contrastive](phases/03-deep-learning-core/05-loss-functions/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Optimizers: SGD, Momentum, Adam, AdamW](phases/03-deep-learning-core/06-optimizers/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Regularization: Dropout, Weight Decay, BatchNorm](phases/03-deep-learning-core/07-regularization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Weight Initialization & Training Stability](phases/03-deep-learning-core/08-weight-initialization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Learning Rate Schedules & Warmup](phases/03-deep-learning-core/09-learning-rate-schedules/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Build Your Own Mini Framework](phases/03-deep-learning-core/10-mini-framework/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Introduction to PyTorch](phases/03-deep-learning-core/11-intro-to-pytorch/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Introduction to JAX](phases/03-deep-learning-core/12-intro-to-jax/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Debugging Neural Networks](phases/03-deep-learning-core/13-debugging-neural-networks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟠 Phase 4 β€” Computer Vision  28 lessons  From pixels to understanding β€” image, video, 3D, VLMs, and world models. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Image Fundamentals: Pixels, Channels, Color Spaces](phases/04-computer-vision/01-image-fundamentals/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Convolutions from Scratch](phases/04-computer-vision/02-convolutions-from-scratch/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [CNNs: LeNet to ResNet](phases/04-computer-vision/03-cnns-lenet-to-resnet/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Image Classification](phases/04-computer-vision/04-image-classification/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Transfer Learning & Fine-Tuning](phases/04-computer-vision/05-transfer-learning/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Object Detection β€” YOLO from Scratch](phases/04-computer-vision/06-object-detection-yolo/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Semantic Segmentation β€” U-Net](phases/04-computer-vision/07-semantic-segmentation-unet/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Instance Segmentation β€” Mask R-CNN](phases/04-computer-vision/08-instance-segmentation-mask-rcnn/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Image Generation β€” GANs](phases/04-computer-vision/09-image-generation-gans/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Image Generation β€” Diffusion Models](phases/04-computer-vision/10-image-generation-diffusion/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Stable Diffusion β€” Architecture & Fine-Tuning](phases/04-computer-vision/11-stable-diffusion/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Video Understanding β€” Temporal Modeling](phases/04-computer-vision/12-video-understanding/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [3D Vision: Point Clouds, NeRFs](phases/04-computer-vision/13-3d-vision-nerf/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Vision Transformers (ViT)](phases/04-computer-vision/14-vision-transformers/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Real-Time Vision: Edge Deployment](phases/04-computer-vision/15-real-time-edge/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 πŸ¦€ | -| 16 | [Build a Complete Vision Pipeline](phases/04-computer-vision/16-vision-pipeline-capstone/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Self-Supervised Vision β€” SimCLR, DINO, MAE](phases/04-computer-vision/17-self-supervised-vision/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Open-Vocabulary Vision β€” CLIP](phases/04-computer-vision/18-open-vocab-clip/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [OCR & Document Understanding](phases/04-computer-vision/19-ocr-document-understanding/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 20 | [Image Retrieval & Metric Learning](phases/04-computer-vision/20-image-retrieval-metric/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 21 | [Keypoint Detection & Pose Estimation](phases/04-computer-vision/21-keypoint-pose/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 22 | [3D Gaussian Splatting from Scratch](phases/04-computer-vision/22-3d-gaussian-splatting/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 23 | [Diffusion Transformers & Rectified Flow](phases/04-computer-vision/23-diffusion-transformers-rectified-flow/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 24 | [SAM 3 & Open-Vocabulary Segmentation](phases/04-computer-vision/24-sam3-open-vocab-segmentation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 25 | [Vision-Language Models (ViT-MLP-LLM)](phases/04-computer-vision/25-vision-language-models/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 26 | [Monocular Depth & Geometry Estimation](phases/04-computer-vision/26-monocular-depth/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 27 | [Multi-Object Tracking & Video Memory](phases/04-computer-vision/27-multi-object-tracking/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 28 | [World Models & Video Diffusion](phases/04-computer-vision/28-world-models-video-diffusion/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-πŸ”΄ Phase 5 β€” NLP: Foundations to Advanced  29 lessons  Language is the interface to intelligence. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Text Processing: Tokenization, Stemming, Lemmatization](phases/05-nlp-foundations-to-advanced/01-text-processing/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 02 | [Bag of Words, TF-IDF & Text Representation](phases/05-nlp-foundations-to-advanced/02-bag-of-words-tfidf/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Word Embeddings: Word2Vec from Scratch](phases/05-nlp-foundations-to-advanced/03-word-embeddings-word2vec/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [GloVe, FastText & Subword Embeddings](phases/05-nlp-foundations-to-advanced/04-glove-fasttext-subword/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Sentiment Analysis](phases/05-nlp-foundations-to-advanced/05-sentiment-analysis/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Named Entity Recognition (NER)](phases/05-nlp-foundations-to-advanced/06-named-entity-recognition/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [POS Tagging & Syntactic Parsing](phases/05-nlp-foundations-to-advanced/07-pos-tagging-parsing/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Text Classification β€” CNNs & RNNs for Text](phases/05-nlp-foundations-to-advanced/08-cnns-rnns-for-text/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Sequence-to-Sequence Models](phases/05-nlp-foundations-to-advanced/09-sequence-to-sequence/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Attention Mechanism β€” The Breakthrough](phases/05-nlp-foundations-to-advanced/10-attention-mechanism/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Machine Translation](phases/05-nlp-foundations-to-advanced/11-machine-translation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Text Summarization](phases/05-nlp-foundations-to-advanced/12-text-summarization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Question Answering Systems](phases/05-nlp-foundations-to-advanced/13-question-answering/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Information Retrieval & Search](phases/05-nlp-foundations-to-advanced/14-information-retrieval-search/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Topic Modeling: LDA, BERTopic](phases/05-nlp-foundations-to-advanced/15-topic-modeling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [Text Generation](phases/05-nlp-foundations-to-advanced/16-text-generation-pre-transformer/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Chatbots: Rule-Based to Neural](phases/05-nlp-foundations-to-advanced/17-chatbots-rule-to-neural/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Multilingual NLP](phases/05-nlp-foundations-to-advanced/18-multilingual-nlp/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [Subword Tokenization: BPE, WordPiece, Unigram, SentencePiece](phases/05-nlp-foundations-to-advanced/19-subword-tokenization/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | [Structured Outputs & Constrained Decoding](phases/05-nlp-foundations-to-advanced/20-structured-outputs-constrained-decoding/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 21 | [NLI & Textual Entailment](phases/05-nlp-foundations-to-advanced/21-nli-textual-entailment/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [Embedding Models Deep Dive](phases/05-nlp-foundations-to-advanced/22-embedding-models-deep-dive/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 23 | [Chunking Strategies for RAG](phases/05-nlp-foundations-to-advanced/23-chunking-strategies-rag/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 24 | [Coreference Resolution](phases/05-nlp-foundations-to-advanced/24-coreference-resolution/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 25 | [Entity Linking & Disambiguation](phases/05-nlp-foundations-to-advanced/25-entity-linking/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 26 | [Relation Extraction & Knowledge Graph Construction](phases/05-nlp-foundations-to-advanced/26-relation-extraction-kg/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 27 | [LLM Evaluation: RAGAS, DeepEval, G-Eval](phases/05-nlp-foundations-to-advanced/27-llm-evaluation-frameworks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 28 | [Long-Context Evaluation: NIAH, RULER, LongBench, MRCR](phases/05-nlp-foundations-to-advanced/28-long-context-evaluation/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 29 | [Dialogue State Tracking](phases/05-nlp-foundations-to-advanced/29-dialogue-state-tracking/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟒 Phase 6 β€” Speech & Audio  17 lessons  Hear, understand, speak. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Audio Fundamentals: Waveforms, Sampling, FFT](phases/06-speech-and-audio/01-audio-fundamentals) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Spectrograms, Mel Scale & Audio Features](phases/06-speech-and-audio/02-spectrograms-mel-features) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Audio Classification](phases/06-speech-and-audio/03-audio-classification) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Speech Recognition (ASR)](phases/06-speech-and-audio/04-speech-recognition-asr) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Whisper: Architecture & Fine-Tuning](phases/06-speech-and-audio/05-whisper-architecture-finetuning) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Speaker Recognition & Verification](phases/06-speech-and-audio/06-speaker-recognition-verification) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Text-to-Speech (TTS)](phases/06-speech-and-audio/07-text-to-speech) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Voice Cloning & Voice Conversion](phases/06-speech-and-audio/08-voice-cloning-conversion) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Music Generation](phases/06-speech-and-audio/09-music-generation) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Audio-Language Models](phases/06-speech-and-audio/10-audio-language-models) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Real-Time Audio Processing](phases/06-speech-and-audio/11-real-time-audio-processing) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 πŸ¦€ | -| 12 | [Build a Voice Assistant Pipeline](phases/06-speech-and-audio/12-voice-assistant-pipeline) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Neural Audio Codecs β€” EnCodec, SNAC, Mimi, DAC](phases/06-speech-and-audio/13-neural-audio-codecs) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 14 | [Voice Activity Detection & Turn-Taking](phases/06-speech-and-audio/14-voice-activity-detection-turn-taking) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Streaming Speech-to-Speech β€” Moshi, Hibiki](phases/06-speech-and-audio/15-streaming-speech-to-speech-moshi-hibiki) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 16 | [Voice Anti-Spoofing & Audio Watermarking](phases/06-speech-and-audio/16-anti-spoofing-audio-watermarking) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Audio Evaluation β€” WER, MOS, MMAU, Leaderboards](phases/06-speech-and-audio/17-audio-evaluation-metrics) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | - -
- -
-🟒 Phase 7 β€” Transformers Deep Dive  14 lessons  The architecture that changed everything. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Why Transformers: The Problems with RNNs](phases/07-transformers-deep-dive/01-why-transformers/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Self-Attention from Scratch](phases/07-transformers-deep-dive/02-self-attention-from-scratch/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Multi-Head Attention](phases/07-transformers-deep-dive/03-multi-head-attention/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Positional Encoding: Sinusoidal, RoPE, ALiBi](phases/07-transformers-deep-dive/04-positional-encoding/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [The Full Transformer: Encoder + Decoder](phases/07-transformers-deep-dive/05-full-transformer/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [BERT β€” Masked Language Modeling](phases/07-transformers-deep-dive/06-bert-masked-language-modeling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [GPT β€” Causal Language Modeling](phases/07-transformers-deep-dive/07-gpt-causal-language-modeling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [T5, BART β€” Encoder-Decoder Models](phases/07-transformers-deep-dive/08-t5-bart-encoder-decoder/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 09 | [Vision Transformers (ViT)](phases/07-transformers-deep-dive/09-vision-transformers/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Audio Transformers β€” Whisper Architecture](phases/07-transformers-deep-dive/10-audio-transformers-whisper/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 11 | [Mixture of Experts (MoE)](phases/07-transformers-deep-dive/11-mixture-of-experts/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [KV Cache, Flash Attention & Inference Optimization](phases/07-transformers-deep-dive/12-kv-cache-flash-attention/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Scaling Laws](phases/07-transformers-deep-dive/13-scaling-laws/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 14 | [Build a Transformer from Scratch](phases/07-transformers-deep-dive/14-build-a-transformer-capstone/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-πŸ’— Phase 8 β€” Generative AI  14 lessons  Create images, video, audio, 3D, and more. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Generative Models: Taxonomy & History](phases/08-generative-ai/01-generative-models-taxonomy-history/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Autoencoders & VAE](phases/08-generative-ai/02-autoencoders-vae/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [GANs: Generator vs Discriminator](phases/08-generative-ai/03-gans-generator-discriminator/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Conditional GANs & Pix2Pix](phases/08-generative-ai/04-conditional-gans-pix2pix/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [StyleGAN](phases/08-generative-ai/05-stylegan/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Diffusion Models β€” DDPM from Scratch](phases/08-generative-ai/06-diffusion-ddpm-from-scratch/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Latent Diffusion & Stable Diffusion](phases/08-generative-ai/07-latent-diffusion-stable-diffusion/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [ControlNet, LoRA & Conditioning](phases/08-generative-ai/08-controlnet-lora-conditioning/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Inpainting, Outpainting & Editing](phases/08-generative-ai/09-inpainting-outpainting-editing/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Video Generation](phases/08-generative-ai/10-video-generation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Audio Generation](phases/08-generative-ai/11-audio-generation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [3D Generation](phases/08-generative-ai/12-3d-generation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Flow Matching & Rectified Flows](phases/08-generative-ai/13-flow-matching-rectified-flows/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Evaluation: FID, CLIP Score](phases/08-generative-ai/14-evaluation-fid-clip-score/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟣 Phase 9 β€” Reinforcement Learning  12 lessons  The foundation of RLHF and game-playing AI. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [MDPs, States, Actions & Rewards](phases/09-reinforcement-learning/01-mdps-states-actions-rewards/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Dynamic Programming](phases/09-reinforcement-learning/02-dynamic-programming/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Monte Carlo Methods](phases/09-reinforcement-learning/03-monte-carlo-methods/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Q-Learning, SARSA](phases/09-reinforcement-learning/04-q-learning-sarsa/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Deep Q-Networks (DQN)](phases/09-reinforcement-learning/05-dqn/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Policy Gradients β€” REINFORCE](phases/09-reinforcement-learning/06-policy-gradients-reinforce/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Actor-Critic β€” A2C, A3C](phases/09-reinforcement-learning/07-actor-critic-a2c-a3c/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [PPO](phases/09-reinforcement-learning/08-ppo/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Reward Modeling & RLHF](phases/09-reinforcement-learning/09-reward-modeling-rlhf/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Multi-Agent RL](phases/09-reinforcement-learning/10-multi-agent-rl/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Sim-to-Real Transfer](phases/09-reinforcement-learning/11-sim-to-real-transfer/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [RL for Games](phases/09-reinforcement-learning/12-rl-for-games/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟧 Phase 10 β€” LLMs from Scratch  22 lessons  Build, train, and understand large language models. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Tokenizers: BPE, WordPiece, SentencePiece](phases/10-llms-from-scratch/01-tokenizers/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 02 | [Building a Tokenizer from Scratch](phases/10-llms-from-scratch/02-building-a-tokenizer/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Data Pipelines for Pre-Training](phases/10-llms-from-scratch/03-data-pipelines/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Pre-Training a Mini GPT (124M)](phases/10-llms-from-scratch/04-pre-training-mini-gpt/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Distributed Training, FSDP, DeepSpeed](phases/10-llms-from-scratch/05-scaling-distributed/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Instruction Tuning β€” SFT](phases/10-llms-from-scratch/06-instruction-tuning-sft/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [RLHF β€” Reward Model + PPO](phases/10-llms-from-scratch/07-rlhf/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [DPO β€” Direct Preference Optimization](phases/10-llms-from-scratch/08-dpo/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Constitutional AI & Self-Improvement](phases/10-llms-from-scratch/09-constitutional-ai-self-improvement/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Evaluation β€” Benchmarks, Evals](phases/10-llms-from-scratch/10-evaluation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Quantization: INT8, GPTQ, AWQ, GGUF](phases/10-llms-from-scratch/11-quantization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 πŸ¦€ | -| 12 | [Inference Optimization](phases/10-llms-from-scratch/12-inference-optimization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Building a Complete LLM Pipeline](phases/10-llms-from-scratch/13-building-complete-llm-pipeline/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Open Models: Architecture Walkthroughs](phases/10-llms-from-scratch/14-open-models-architecture-walkthroughs/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 15 | [Speculative Decoding and EAGLE-3](phases/10-llms-from-scratch/15-speculative-decoding-eagle3/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [Differential Attention (V2)](phases/10-llms-from-scratch/16-differential-attention-v2/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Native Sparse Attention (DeepSeek NSA)](phases/10-llms-from-scratch/17-native-sparse-attention/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Multi-Token Prediction (MTP)](phases/10-llms-from-scratch/18-multi-token-prediction/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [DualPipe Parallelism](phases/10-llms-from-scratch/19-dualpipe-parallelism/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | [DeepSeek-V3 Architecture Walkthrough](phases/10-llms-from-scratch/20-deepseek-v3-walkthrough/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 21 | [Jamba β€” Hybrid SSM-Transformer](phases/10-llms-from-scratch/21-jamba-hybrid-ssm-transformer/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [Async and Hogwild! Inference](phases/10-llms-from-scratch/22-async-hogwild-inference/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-πŸŸ₯ Phase 11 β€” LLM Engineering  15 lessons  Put LLMs to work in production. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Prompt Engineering: Techniques & Patterns](phases/11-llm-engineering/01-prompt-engineering/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 02 | [Few-Shot, CoT, Tree-of-Thought](phases/11-llm-engineering/02-few-shot-cot/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Structured Outputs](phases/11-llm-engineering/03-structured-outputs/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟦 | -| 04 | [Embeddings & Vector Representations](phases/11-llm-engineering/04-embeddings/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Context Engineering](phases/11-llm-engineering/05-context-engineering/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟦 | -| 06 | [RAG: Retrieval-Augmented Generation](phases/11-llm-engineering/06-rag/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 🟦 | -| 07 | [Advanced RAG: Chunking, Reranking](phases/11-llm-engineering/07-advanced-rag/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Fine-Tuning with LoRA & QLoRA](phases/11-llm-engineering/08-fine-tuning-lora/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Function Calling & Tool Use](phases/11-llm-engineering/09-function-calling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Evaluation & Testing](phases/11-llm-engineering/10-evaluation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Caching, Rate Limiting & Cost](phases/11-llm-engineering/11-caching-cost/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Guardrails & Safety](phases/11-llm-engineering/12-guardrails/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Building a Production LLM App](phases/11-llm-engineering/13-production-app/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Model Context Protocol (MCP)](phases/11-llm-engineering/14-model-context-protocol/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Prompt Caching & Context Caching](phases/11-llm-engineering/15-prompt-caching/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟩 Phase 12 β€” Multimodal AI  25 lessons  See, hear, read, and reason across modalities β€” from ViT patches to computer-use agents. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Vision Transformers and the Patch-Token Primitive](phases/12-multimodal-ai/01-vision-transformer-patch-tokens/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [CLIP and Contrastive Vision-Language Pretraining](phases/12-multimodal-ai/02-clip-contrastive-pretraining/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [BLIP-2 Q-Former as Modality Bridge](phases/12-multimodal-ai/03-blip2-qformer-bridge/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Flamingo and Gated Cross-Attention](phases/12-multimodal-ai/04-flamingo-gated-cross-attention/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 05 | [LLaVA and Visual Instruction Tuning](phases/12-multimodal-ai/05-llava-visual-instruction-tuning/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Any-Resolution Vision β€” Patch-n'-Pack and NaFlex](phases/12-multimodal-ai/06-any-resolution-patch-n-pack/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Open-Weight VLM Recipes: What Actually Matters](phases/12-multimodal-ai/07-open-weight-vlm-recipes/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 08 | [LLaVA-OneVision: Single, Multi, Video](phases/12-multimodal-ai/08-llava-onevision-single-multi-video/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Qwen-VL Family and Dynamic-FPS Video](phases/12-multimodal-ai/09-qwen-vl-family-dynamic-fps/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 10 | [InternVL3 Native Multimodal Pretraining](phases/12-multimodal-ai/10-internvl3-native-multimodal/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 11 | [Chameleon Early-Fusion Token-Only](phases/12-multimodal-ai/11-chameleon-early-fusion-tokens/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Emu3 Next-Token Prediction for Generation](phases/12-multimodal-ai/12-emu3-next-token-for-generation/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 13 | [Transfusion Autoregressive + Diffusion](phases/12-multimodal-ai/13-transfusion-autoregressive-diffusion/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Show-o Discrete-Diffusion Unified](phases/12-multimodal-ai/14-show-o-discrete-diffusion-unified/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 15 | [Janus-Pro Decoupled Encoders](phases/12-multimodal-ai/15-janus-pro-decoupled-encoders/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [MIO Any-to-Any Streaming](phases/12-multimodal-ai/16-mio-any-to-any-streaming/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 17 | [Video-Language Temporal Grounding](phases/12-multimodal-ai/17-video-language-temporal-grounding/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Long-Video at Million-Token Context](phases/12-multimodal-ai/18-long-video-million-token/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [Audio-Language Models: Whisper to AF3](phases/12-multimodal-ai/19-audio-language-whisper-to-af3/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 20 | [Omni Models: Thinker-Talker Streaming](phases/12-multimodal-ai/20-omni-models-thinker-talker/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 21 | [Embodied VLAs: RT-2, OpenVLA, Ο€0, GR00T](phases/12-multimodal-ai/21-embodied-vlas-openvla-pi0-groot/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [Document and Diagram Understanding](phases/12-multimodal-ai/22-document-diagram-understanding/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 23 | [ColPali Vision-Native Document RAG](phases/12-multimodal-ai/23-colpali-vision-native-rag/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 24 | [Multimodal RAG and Cross-Modal Retrieval](phases/12-multimodal-ai/24-multimodal-rag-cross-modal/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 25 | [Multimodal Agents and Computer-Use (Capstone)](phases/12-multimodal-ai/25-multimodal-agents-computer-use/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟦 Phase 13 β€” Tools & Protocols  23 lessons  The interfaces between AI and the real world. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [The Tool Interface](phases/13-tools-and-protocols/01-the-tool-interface/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Function Calling Deep Dive](phases/13-tools-and-protocols/02-function-calling-deep-dive/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Parallel and Streaming Tool Calls](phases/13-tools-and-protocols/03-parallel-and-streaming-tool-calls/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Structured Output](phases/13-tools-and-protocols/04-structured-output/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Tool Schema Design](phases/13-tools-and-protocols/05-tool-schema-design/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 06 | [MCP Fundamentals](phases/13-tools-and-protocols/06-mcp-fundamentals/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 07 | [Building an MCP Server](phases/13-tools-and-protocols/07-building-an-mcp-server/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Building an MCP Client](phases/13-tools-and-protocols/08-building-an-mcp-client/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [MCP Transports](phases/13-tools-and-protocols/09-mcp-transports/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 10 | [MCP Resources and Prompts](phases/13-tools-and-protocols/10-mcp-resources-and-prompts/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [MCP Sampling](phases/13-tools-and-protocols/11-mcp-sampling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [MCP Roots and Elicitation](phases/13-tools-and-protocols/12-mcp-roots-and-elicitation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [MCP Async Tasks](phases/13-tools-and-protocols/13-mcp-async-tasks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [MCP Apps](phases/13-tools-and-protocols/14-mcp-apps/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [MCP Security I β€” Tool Poisoning](phases/13-tools-and-protocols/15-mcp-security-tool-poisoning/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 16 | [MCP Security II β€” OAuth 2.1](phases/13-tools-and-protocols/16-mcp-security-oauth-2-1/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [MCP Gateways and Registries](phases/13-tools-and-protocols/17-mcp-gateways-and-registries/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 18 | [MCP Auth in Production β€” DCR + JWKS on iii](phases/13-tools-and-protocols/18-mcp-auth-production/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [A2A Protocol](phases/13-tools-and-protocols/19-a2a-protocol/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 20 | [OpenTelemetry GenAI](phases/13-tools-and-protocols/20-opentelemetry-genai/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 21 | [LLM Routing Layer](phases/13-tools-and-protocols/21-llm-routing-layer/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [Skills and Agent SDKs](phases/13-tools-and-protocols/22-skills-and-agent-sdks/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 23 | [Capstone β€” Tool Ecosystem](phases/13-tools-and-protocols/23-capstone-tool-ecosystem/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟧 Phase 14 β€” Agent Engineering  30 lessons  Build agents from first principles β€” loop, memory, planning, frameworks, benchmarks, production. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [The Agent Loop](phases/14-agent-engineering/01-the-agent-loop/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 02 | [ReWOO and Plan-and-Execute](phases/14-agent-engineering/02-rewoo-plan-and-execute/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 03 | [Reflexion and Verbal Reinforcement Learning](phases/14-agent-engineering/03-reflexion-verbal-rl/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 04 | [Tree of Thoughts and LATS](phases/14-agent-engineering/04-tree-of-thoughts-lats/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 05 | [Self-Refine and CRITIC](phases/14-agent-engineering/05-self-refine-and-critic/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Tool Use and Function Calling](phases/14-agent-engineering/06-tool-use-and-function-calling/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 07 | [Memory β€” Virtual Context and MemGPT](phases/14-agent-engineering/07-memory-virtual-context-memgpt/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Memory Blocks and Sleep-Time Compute](phases/14-agent-engineering/08-memory-blocks-sleep-time-compute/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Hybrid Memory β€” Mem0 Vector + Graph + KV](phases/14-agent-engineering/09-hybrid-memory-mem0/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Skill Libraries and Lifelong Learning β€” Voyager](phases/14-agent-engineering/10-skill-libraries-voyager/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Planning with HTN and Evolutionary Search](phases/14-agent-engineering/11-planning-htn-and-evolutionary/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [Anthropic's Workflow Patterns](phases/14-agent-engineering/12-anthropic-workflow-patterns/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [LangGraph β€” Stateful Graphs and Durable Execution](phases/14-agent-engineering/13-langgraph-stateful-graphs/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [AutoGen v0.4 β€” Actor Model](phases/14-agent-engineering/14-autogen-actor-model/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [CrewAI β€” Role-Based Crews and Flows](phases/14-agent-engineering/15-crewai-role-based-crews/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [OpenAI Agents SDK β€” Handoffs, Guardrails, Tracing](phases/14-agent-engineering/16-openai-agents-sdk/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Claude Agent SDK β€” Subagents and Session Store](phases/14-agent-engineering/17-claude-agent-sdk/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Agno and Mastra β€” Production Runtimes](phases/14-agent-engineering/18-agno-and-mastra-runtimes/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 🟦 | -| 19 | [Benchmarks β€” SWE-bench, GAIA, AgentBench](phases/14-agent-engineering/19-benchmarks-swebench-gaia/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | [Benchmarks β€” WebArena and OSWorld](phases/14-agent-engineering/20-benchmarks-webarena-osworld/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 21 | [Computer Use β€” Claude, OpenAI CUA, Gemini](phases/14-agent-engineering/21-computer-use-agents/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 22 | [Voice Agents β€” Pipecat and LiveKit](phases/14-agent-engineering/22-voice-agents-pipecat-livekit/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 23 | [OpenTelemetry GenAI Semantic Conventions](phases/14-agent-engineering/23-otel-genai-conventions/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 24 | [Agent Observability β€” Langfuse, Phoenix, Opik](phases/14-agent-engineering/24-agent-observability-platforms/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 25 | [Multi-Agent Debate and Collaboration](phases/14-agent-engineering/25-multi-agent-debate/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 26 | [Failure Modes β€” Why Agents Break](phases/14-agent-engineering/26-failure-modes-agentic/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 27 | [Prompt Injection and the PVE Defense](phases/14-agent-engineering/27-prompt-injection-defense/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 28 | [Orchestration Patterns β€” Supervisor, Swarm, Hierarchical](phases/14-agent-engineering/28-orchestration-patterns/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 29 | [Production Runtimes β€” Queue, Event, Cron](phases/14-agent-engineering/29-production-runtimes/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 30 | [Eval-Driven Agent Development](phases/14-agent-engineering/30-eval-driven-agent-development/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | - -
- -
-🟩 Phase 15 β€” Autonomous Systems  22 lessons  Long-horizon agents, self-improvement, and the 2026 safety stack. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [From Chatbots to Long-Horizon Agents (METR)](phases/15-autonomous-systems/01-long-horizon-agents/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [STaR, V-STaR, Quiet-STaR: Self-Taught Reasoning](phases/15-autonomous-systems/02-star-family-reasoning/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 03 | [AlphaEvolve: Evolutionary Coding Agents](phases/15-autonomous-systems/03-alphaevolve-evolutionary-coding/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 04 | [Darwin Gâdel Machine: Self-Modifying Agents](phases/15-autonomous-systems/04-darwin-godel-machine/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 05 | [AI Scientist v2: Workshop-Level Research](phases/15-autonomous-systems/05-ai-scientist-v2/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 06 | [Automated Alignment Research (Anthropic AAR)](phases/15-autonomous-systems/06-automated-alignment-research/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 07 | [Recursive Self-Improvement: Capability vs Alignment](phases/15-autonomous-systems/07-recursive-self-improvement/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 08 | [Bounded Self-Improvement Designs](phases/15-autonomous-systems/08-bounded-self-improvement/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 09 | [Autonomous Coding Agent Landscape (SWE-bench, CodeAct)](phases/15-autonomous-systems/09-coding-agent-landscape/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 10 | [Claude Code Permission Modes and Auto Mode](phases/15-autonomous-systems/10-claude-code-permission-modes/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 11 | [Browser Agents and Indirect Prompt Injection](phases/15-autonomous-systems/11-browser-agents/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 12 | [Durable Execution for Long-Running Agents](phases/15-autonomous-systems/12-durable-execution/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 13 | [Action Budgets, Iteration Caps, Cost Governors](phases/15-autonomous-systems/13-cost-governors/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 14 | [Kill Switches, Circuit Breakers, Canary Tokens](phases/15-autonomous-systems/14-kill-switches-canaries/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 15 | [HITL: Propose-Then-Commit](phases/15-autonomous-systems/15-propose-then-commit/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 16 | [Checkpoints and Rollback](phases/15-autonomous-systems/16-checkpoints-rollback/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 17 | [Constitutional AI and Rule Overrides](phases/15-autonomous-systems/17-constitutional-ai/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 18 | [Llama Guard and Input/Output Classification](phases/15-autonomous-systems/18-llama-guard/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 19 | [Anthropic Responsible Scaling Policy v3.0](phases/15-autonomous-systems/19-anthropic-rsp/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | [OpenAI Preparedness Framework and DeepMind FSF](phases/15-autonomous-systems/20-openai-preparedness-deepmind-fsf/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 21 | [METR Time Horizons and External Evaluation](phases/15-autonomous-systems/21-metr-external-evaluation/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [CAIS, CAISI, and Societal-Scale Risk](phases/15-autonomous-systems/22-cais-caisi-societal-risk/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | - -
- -
-🟩 Phase 16 β€” Multi-Agent & Swarms  25 lessons  Coordination, emergence, and collective intelligence. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Why Multi-Agent](phases/16-multi-agent-and-swarms/01-why-multi-agent/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🟦 | -| 02 | [FIPA-ACL Heritage and Speech Acts](phases/16-multi-agent-and-swarms/02-fipa-acl-heritage/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 03 | [Communication Protocols](phases/16-multi-agent-and-swarms/03-communication-protocols/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🟦 | -| 04 | [The Multi-Agent Primitive Model](phases/16-multi-agent-and-swarms/04-primitive-model/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 05 | [Supervisor / Orchestrator-Worker Pattern](phases/16-multi-agent-and-swarms/05-supervisor-orchestrator-pattern/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 06 | [Hierarchical Architecture and Decomposition Drift](phases/16-multi-agent-and-swarms/06-hierarchical-architecture/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 07 | [Society of Mind and Multi-Agent Debate](phases/16-multi-agent-and-swarms/07-society-of-mind-debate/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 08 | [Role Specialization β€” Planner / Critic / Executor / Verifier](phases/16-multi-agent-and-swarms/08-role-specialization/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 09 | [Parallel Swarm and Networked Architectures](phases/16-multi-agent-and-swarms/09-parallel-swarm-networks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 10 | [Group Chat and Speaker Selection](phases/16-multi-agent-and-swarms/10-group-chat-speaker-selection/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 11 | [Handoffs and Routines (Stateless Orchestration)](phases/16-multi-agent-and-swarms/11-handoffs-and-routines/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 12 | [A2A β€” The Agent-to-Agent Protocol](phases/16-multi-agent-and-swarms/12-a2a-protocol/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Shared Memory and Blackboard Patterns](phases/16-multi-agent-and-swarms/13-shared-memory-blackboard/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 14 | [Consensus and Byzantine Fault Tolerance](phases/16-multi-agent-and-swarms/14-consensus-and-bft/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Voting, Self-Consistency, and Debate Topology](phases/16-multi-agent-and-swarms/15-voting-debate-topology/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [Negotiation and Bargaining](phases/16-multi-agent-and-swarms/16-negotiation-bargaining/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [Generative Agents and Emergent Simulation](phases/16-multi-agent-and-swarms/17-generative-agents-simulation/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 18 | [Theory of Mind and Emergent Coordination](phases/16-multi-agent-and-swarms/18-theory-of-mind-coordination/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 19 | [Swarm Optimization (PSO, ACO)](phases/16-multi-agent-and-swarms/19-swarm-optimization-pso-aco/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 20 | [MARL β€” MADDPG, QMIX, MAPPO](phases/16-multi-agent-and-swarms/20-marl-maddpg-qmix-mappo/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 21 | [Agent Economies, Token Incentives, Reputation](phases/16-multi-agent-and-swarms/21-agent-economies/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [Production Scaling β€” Queues, Checkpoints, Durability](phases/16-multi-agent-and-swarms/22-production-scaling-queues-checkpoints/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 23 | [Failure Modes β€” MAST, Groupthink, Monoculture](phases/16-multi-agent-and-swarms/23-failure-modes-mast-groupthink/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 24 | [Evaluation and Coordination Benchmarks](phases/16-multi-agent-and-swarms/24-evaluation-coordination-benchmarks/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 25 | [Case Studies and 2026 State of the Art](phases/16-multi-agent-and-swarms/25-case-studies-2026-sota/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | - -
- -
-⬛ Phase 17 β€” Infrastructure & Production  28 lessons  Ship AI to the real world. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | Managed LLM Platforms β€” Bedrock, Azure OpenAI, Vertex AI | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | Inference Platform Economics β€” Fireworks, Together, Baseten, Modal | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 03 | GPU Autoscaling on Kubernetes β€” Karpenter, KAI Scheduler | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 04 | vLLM Serving Internals β€” PagedAttention, Continuous Batching, Chunked Prefill | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 05 | EAGLE-3 Speculative Decoding in Production | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 06 | SGLang and RadixAttention for Prefix-Heavy Workloads | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 07 | TensorRT-LLM on Blackwell with FP8 and NVFP4 | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 08 | Inference Metrics β€” TTFT, TPOT, ITL, Goodput, P99 | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 09 | Production Quantization β€” AWQ, GPTQ, GGUF, FP8, NVFP4 | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 10 | Cold Start Mitigation for Serverless LLMs | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 11 | Multi-Region LLM Serving and KV Cache Locality | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 12 | Edge Inference β€” ANE, Hexagon, WebGPU, Jetson | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 13 | LLM Observability Stack Selection | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 14 | Prompt Caching and Semantic Caching Economics | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 15 | Batch APIs β€” the 50% Discount as Industry Standard | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 16 | Model Routing as a Cost-Reduction Primitive | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 17 | Disaggregated Prefill/Decode β€” NVIDIA Dynamo and llm-d | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 18 | vLLM Production Stack with LMCache KV Offloading | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 19 | AI Gateways β€” LiteLLM, Portkey, Kong, Bifrost | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | Shadow, Canary, and Progressive Deployment | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 21 | A/B Testing LLM Features β€” GrowthBook and Statsig | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | Load Testing LLM APIs β€” k6, LLMPerf, GenAI-Perf | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 23 | SRE for AI β€” Multi-Agent Incident Response | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 24 | Chaos Engineering for LLM Production | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 25 | Security β€” Secrets, PII Scrubbing, Audit Logs | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 26 | Compliance β€” SOC 2, HIPAA, GDPR, EU AI Act, ISO 42001 | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 27 | FinOps for LLMs β€” Unit Economics and Multi-Tenant Attribution | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 28 | Self-Hosted Serving Selection β€” llama.cpp, Ollama, TGI, vLLM, SGLang | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | - -
- -
-πŸŸͺ Phase 18 β€” Ethics, Safety & Alignment  30 lessons  Build AI that helps humanity. Not optional. -
- -| # | Lesson | Type | Lang | -|:---:|--------|:----:|------| -| 01 | [Instruction-Following as Alignment Signal](phases/18-ethics-safety-alignment/01-instruction-following-alignment-signal/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 02 | [Reward Hacking & Goodhart's Law](phases/18-ethics-safety-alignment/02-reward-hacking-goodhart/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 03 | [Direct Preference Optimization Family](phases/18-ethics-safety-alignment/03-direct-preference-optimization-family/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 04 | [Sycophancy as RLHF Amplification](phases/18-ethics-safety-alignment/04-sycophancy-rlhf-amplification/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 05 | [Constitutional AI & RLAIF](phases/18-ethics-safety-alignment/05-constitutional-ai-rlaif/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 06 | [Mesa-Optimization & Deceptive Alignment](phases/18-ethics-safety-alignment/06-mesa-optimization-deceptive-alignment/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 07 | [Sleeper Agents β€” Persistent Deception](phases/18-ethics-safety-alignment/07-sleeper-agents-persistent-deception/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 08 | [In-Context Scheming in Frontier Models](phases/18-ethics-safety-alignment/08-in-context-scheming-frontier-models/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 09 | [Alignment Faking](phases/18-ethics-safety-alignment/09-alignment-faking/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 10 | [AI Control β€” Safety Despite Subversion](phases/18-ethics-safety-alignment/10-ai-control-subversion/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 11 | [Scalable Oversight & Weak-to-Strong](phases/18-ethics-safety-alignment/11-scalable-oversight-weak-to-strong/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 12 | [Red-Teaming: PAIR & Automated Attacks](phases/18-ethics-safety-alignment/12-red-teaming-pair-automated-attacks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 13 | [Many-Shot Jailbreaking](phases/18-ethics-safety-alignment/13-many-shot-jailbreaking/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 14 | [ASCII Art & Visual Jailbreaks](phases/18-ethics-safety-alignment/14-ascii-art-visual-jailbreaks/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 15 | [Indirect Prompt Injection](phases/18-ethics-safety-alignment/15-indirect-prompt-injection/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 16 | [Red-Team Tooling: Garak, Llama Guard, PyRIT](phases/18-ethics-safety-alignment/16-red-team-tooling-garak-llamaguard-pyrit/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 17 | [WMDP & Dual-Use Capability Evaluation](phases/18-ethics-safety-alignment/17-wmdp-dual-use-evaluation/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 18 | [Frontier Safety Frameworks β€” RSP, PF, FSF](phases/18-ethics-safety-alignment/18-frontier-safety-frameworks-rsp-pf-fsf/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | -| 19 | [Model Welfare Research](phases/18-ethics-safety-alignment/19-model-welfare-research/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 20 | [Bias & Representational Harm](phases/18-ethics-safety-alignment/20-bias-representational-harm/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 21 | [Fairness Criteria: Group, Individual, Counterfactual](phases/18-ethics-safety-alignment/21-fairness-criteria-group-individual-counterfactual/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 22 | [Differential Privacy for LLMs](phases/18-ethics-safety-alignment/22-differential-privacy-for-llms/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 23 | [Watermarking: SynthID, Stable Signature, C2PA](phases/18-ethics-safety-alignment/23-watermarking-synthid-stable-signature-c2pa/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 24 | [Regulatory Frameworks: EU, US, UK, Korea](phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | -| 25 | [EchoLeak & CVEs for AI](phases/18-ethics-safety-alignment/25-echoleak-cves-for-ai/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 26 | [Model, System & Dataset Cards](phases/18-ethics-safety-alignment/26-model-system-dataset-cards/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 27 | [Data Provenance & Training-Data Governance](phases/18-ethics-safety-alignment/27-data-provenance-training-governance/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | 🐍 | -| 28 | [Alignment Research Ecosystem: MATS, Redwood, Apollo, METR](phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | -| 29 | [Moderation Systems: OpenAI, Perspective, Llama Guard](phases/18-ethics-safety-alignment/29-moderation-systems-openai-perspective-llamaguard/) | ![Build](https://img.shields.io/badge/-Build-2ECC71?style=flat-square) | 🐍 | -| 30 | [Dual-Use Risk: Cyber, Bio, Chem, Nuclear](phases/18-ethics-safety-alignment/30-dual-use-risk-cyber-bio-chem-nuclear/) | ![Learn](https://img.shields.io/badge/-Learn-3498DB?style=flat-square) | β€” | - -
- -
-πŸ† Phase 19 β€” Capstone Projects  17 projects  2026 end-to-end shippable products, 20-40 hours each. -
- -| # | Project | Combines | Lang | -|:---:|---------|----------|------| -| 01 | [Terminal-Native Coding Agent](phases/19-capstone-projects/01-terminal-native-coding-agent/) | P0 P5 P7 P10 P11 P13 P14 P15 P17 P18 | 🟦 🐍 | -| 02 | [RAG over Codebase (Cross-Repo Semantic Search)](phases/19-capstone-projects/02-rag-over-codebase/) | P5 P7 P11 P13 P17 | 🐍 🟦 | -| 03 | [Real-Time Voice Assistant (ASR β†’ LLM β†’ TTS)](phases/19-capstone-projects/03-realtime-voice-assistant/) | P6 P7 P11 P13 P14 P17 | 🐍 🟦 | -| 04 | [Multimodal Document QA (Vision-First)](phases/19-capstone-projects/04-multimodal-document-qa/) | P4 P5 P7 P11 P12 P17 | 🐍 🟦 | -| 05 | [Autonomous Research Agent (AI-Scientist Class)](phases/19-capstone-projects/05-autonomous-research-agent/) | P0 P2 P3 P7 P10 P14 P15 P16 P18 | 🐍 | -| 06 | [DevOps Troubleshooting Agent for Kubernetes](phases/19-capstone-projects/06-devops-troubleshooting-agent/) | P11 P13 P14 P15 P17 P18 | 🐍 🟦 | -| 07 | [End-to-End Fine-Tuning Pipeline](phases/19-capstone-projects/07-end-to-end-fine-tuning-pipeline/) | P2 P3 P7 P10 P11 P17 P18 | 🐍 | -| 08 | [Production RAG Chatbot (Regulated Vertical)](phases/19-capstone-projects/08-production-rag-chatbot/) | P5 P7 P11 P12 P17 P18 | 🐍 🟦 | -| 09 | [Code Migration Agent (Repo-Level Upgrade)](phases/19-capstone-projects/09-code-migration-agent/) | P5 P7 P11 P13 P14 P15 P17 | 🐍 🟦 | -| 10 | [Multi-Agent Software Engineering Team](phases/19-capstone-projects/10-multi-agent-software-team/) | P11 P13 P14 P15 P16 P17 | 🐍 🟦 | -| 11 | [LLM Observability & Eval Dashboard](phases/19-capstone-projects/11-llm-observability-dashboard/) | P11 P13 P17 P18 | 🟦 🐍 | -| 12 | [Video Understanding Pipeline (Scene β†’ QA)](phases/19-capstone-projects/12-video-understanding-pipeline/) | P4 P6 P7 P11 P12 P17 | 🐍 🟦 | -| 13 | [MCP Server with Registry and Governance](phases/19-capstone-projects/13-mcp-server-with-registry/) | P11 P13 P14 P17 P18 | 🐍 🟦 | -| 14 | [Speculative-Decoding Inference Server](phases/19-capstone-projects/14-speculative-decoding-server/) | P3 P7 P10 P17 | 🐍 | -| 15 | [Constitutional Safety Harness + Red-Team Range](phases/19-capstone-projects/15-constitutional-safety-harness/) | P10 P11 P13 P14 P18 | 🐍 | -| 16 | [GitHub Issue-to-PR Autonomous Agent](phases/19-capstone-projects/16-github-issue-to-pr-agent/) | P11 P13 P14 P15 P17 | 🐍 🟦 | -| 17 | [Personal AI Tutor (Adaptive, Multimodal)](phases/19-capstone-projects/17-personal-ai-tutor/) | P5 P6 P11 P12 P14 P17 P18 | 🐍 🟦 | - -
- ---- - -
- -## 🧰 Course Output: The Toolkit - -### *Other courses give you a certificate. This one gives you a **toolkit**.* - -
- -Every lesson produces a reusable artifact β€” a prompt, skill, agent, or MCP server you can install and use immediately. By the end of the course you have: +## How each lesson is built ``` -outputs/ -β”œβ”€β”€ πŸ“ prompts/ Prompt templates for every AI task -β”œβ”€β”€ 🎴 skills/ SKILL.md files for AI coding agents -β”œβ”€β”€ πŸ€– agents/ Agent definitions ready to deploy -└── πŸ”Œ mcp-servers/ MCP servers you built during the course +phases/-/-/ +β”œβ”€β”€ code/ runnable implementations (Python, TypeScript, Rust, Julia) +β”œβ”€β”€ docs/ +β”‚ └── en.md lesson narrative +└── outputs/ prompts, skills, agents, or MCP servers this lesson produces ``` -> πŸ’‘ Install them with [**SkillKit**](https://github.com/rohitg00/skillkit). Plug them into Claude Code, Cursor, or any AI agent. **These are real tools, not homework.** +Every lesson follows the same six beats: **motto**, **problem**, **concept**, **build it**, +**use it**, **ship it**. The *Build It / Use It* split is the spine β€” you implement the algorithm +from scratch first, then run the same thing through PyTorch, sklearn, or the production library. +You understand what the framework is doing because you wrote the smaller version yourself. ---- - -
- -## πŸ“ How Each Lesson Works - -
- -``` -phases/XX-phase-name/NN-lesson-name/ -β”œβ”€β”€ πŸ’» code/ Runnable implementations (Python, TS, Rust, Julia) -β”œβ”€β”€ πŸ“– docs/ -β”‚ └── en.md Lesson documentation -└── πŸ“¦ outputs/ Prompts, skills, agents produced by this lesson -``` - -### πŸ”„ Every lesson follows 6 steps - -| Step | What happens | -|------|-------------| -| 🎯 **Motto** | One-line core idea that sticks | -| ❓ **Problem** | A concrete scenario where not knowing this hurts | -| 🧠 **Concept** | Mermaid diagrams and intuition β€” no code yet | -| πŸ”¨ **Build It** | Implement from scratch in pure Python. No frameworks. | -| βš™οΈ **Use It** | Same thing with PyTorch, sklearn, or the real tool | -| 🚒 **Ship It** | The prompt, skill, or agent this lesson produces | - -> πŸ”‘ The **Build It / Use It** split is the key. You understand what the framework does because you built it yourself first. - ---- - -
- -## πŸš€ Getting Started - -
- -### πŸ…°οΈ Option A β€” Just start reading - -Pick any completed lesson from [the website](https://aiengineeringfromscratch.com) or expand any phase above. - -### πŸ…±οΈ Option B β€” Clone and run +## Getting started ```bash git clone https://github.com/rohitg00/ai-engineering-from-scratch.git cd ai-engineering-from-scratch - -python phases/01-math-foundations/01-linear-algebra-intuition/code/vectors.py ``` -### πŸ…² Option C β€” Find your level (recommended) ⭐ +Pick any completed lesson from [the website](https://aiengineeringfromscratch.com) or expand a +phase below. If you already know some ML, skip the assessment forward β€” the table at the bottom +maps backgrounds to starting phases. -If you already know some ML/DL, don't start from Phase 1. Use the built-in assessment: - -```bash -# In Claude Code: -/find-your-level -``` - -This 10-question quiz maps your knowledge to a starting phase and builds a personalized path with hour estimates. - -### βœ… Prerequisites - -- [x] You can write code (Python or any language) -- [x] You want to understand how AI **actually works**, not just call APIs - -### πŸ‘€ Who This Is For - -| πŸ§‘β€πŸ’» You are... | πŸšͺ Start at... | ⏱️ Time to complete | -|---------------|----------------|---------------------| -| 🌱 New to programming + AI | Phase 0 (Setup) | ~306 hours | -| 🐍 Know Python, new to ML | Phase 1 (Math) | ~270 hours | -| πŸ“Š Know ML, new to DL | Phase 3 (Deep Learning) | ~200 hours | -| 🧠 Know DL, want LLMs/agents | Phase 10 (LLMs from Scratch) | ~100 hours | -| πŸš€ Senior eng, want agents only | Phase 14 (Agent Engineering) | ~60 hours | +Inside Claude Code, the bundled `/find-your-level` skill runs a 10-question quiz that maps your +knowledge to a starting phase and produces a personalized path with hour estimates. +`/check-understanding ` quizzes you per phase once you finish it. --- -
+ -## πŸ“° Why This Matters Now +## Contents -
+Twenty phases. Click any phase to expand its lesson list. - - - - - -
+ +### Phase 0: Setup & Tooling `12 lessons` +> Get your environment ready for everything that follows. -### πŸ“ˆ The Industry Signal +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Dev Environment](phases/00-setup-and-tooling/01-dev-environment/) | Build | Python, TypeScript, Rust | +| 02 | [Git & Collaboration](phases/00-setup-and-tooling/02-git-and-collaboration/) | Learn | β€” | +| 03 | [GPU Setup & Cloud](phases/00-setup-and-tooling/03-gpu-setup-and-cloud/) | Build | Python | +| 04 | [APIs & Keys](phases/00-setup-and-tooling/04-apis-and-keys/) | Build | Python, TypeScript | +| 05 | [Jupyter Notebooks](phases/00-setup-and-tooling/05-jupyter-notebooks/) | Build | Python | +| 06 | [Python Environments](phases/00-setup-and-tooling/06-python-environments/) | Build | Python | +| 07 | [Docker for AI](phases/00-setup-and-tooling/07-docker-for-ai/) | Build | Python | +| 08 | [Editor Setup](phases/00-setup-and-tooling/08-editor-setup/) | Build | β€” | +| 09 | [Data Management](phases/00-setup-and-tooling/09-data-management/) | Build | Python | +| 10 | [Terminal & Shell](phases/00-setup-and-tooling/10-terminal-and-shell/) | Learn | β€” | +| 11 | [Linux for AI](phases/00-setup-and-tooling/11-linux-for-ai/) | Learn | β€” | +| 12 | [Debugging & Profiling](phases/00-setup-and-tooling/12-debugging-and-profiling/) | Build | Python | -> *"The hottest new programming language is English."*
-> β€” **Andrej Karpathy** ([tweet](https://x.com/karpathy/status/1617979122625712128)) +
+Phase 1 β€” Math Foundations  22 lessons  The intuition behind every AI algorithm, through code. +
-> *"Software engineering is being remade in front of our eyes."*
-> β€” **Boris Cherny**, creator of Claude Code +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Linear Algebra Intuition](phases/01-math-foundations/01-linear-algebra-intuition/) | Learn | Python, Julia | +| 02 | [Vectors, Matrices & Operations](phases/01-math-foundations/02-vectors-matrices-operations/) | Build | Python, Julia | +| 03 | [Matrix Transformations & Eigenvalues](phases/01-math-foundations/03-matrix-transformations/) | Build | Python, Julia | +| 04 | [Calculus for ML: Derivatives & Gradients](phases/01-math-foundations/04-calculus-for-ml/) | Learn | Python | +| 05 | [Chain Rule & Automatic Differentiation](phases/01-math-foundations/05-chain-rule-and-autodiff/) | Build | Python | +| 06 | [Probability & Distributions](phases/01-math-foundations/06-probability-and-distributions/) | Learn | Python | +| 07 | [Bayes' Theorem & Statistical Thinking](phases/01-math-foundations/07-bayes-theorem/) | Build | Python | +| 08 | [Optimization: Gradient Descent Family](phases/01-math-foundations/08-optimization/) | Build | Python | +| 09 | [Information Theory: Entropy, KL Divergence](phases/01-math-foundations/09-information-theory/) | Learn | Python | +| 10 | [Dimensionality Reduction: PCA, t-SNE, UMAP](phases/01-math-foundations/10-dimensionality-reduction/) | Build | Python | +| 11 | [Singular Value Decomposition](phases/01-math-foundations/11-singular-value-decomposition/) | Build | Python, Julia | +| 12 | [Tensor Operations](phases/01-math-foundations/12-tensor-operations/) | Build | Python | +| 13 | [Numerical Stability](phases/01-math-foundations/13-numerical-stability/) | Build | Python | +| 14 | [Norms & Distances](phases/01-math-foundations/14-norms-and-distances/) | Build | Python | +| 15 | [Statistics for ML](phases/01-math-foundations/15-statistics-for-ml/) | Build | Python | +| 16 | [Sampling Methods](phases/01-math-foundations/16-sampling-methods/) | Build | Python | +| 17 | [Linear Systems](phases/01-math-foundations/17-linear-systems/) | Build | Python | +| 18 | [Convex Optimization](phases/01-math-foundations/18-convex-optimization/) | Build | Python | +| 19 | [Complex Numbers for AI](phases/01-math-foundations/19-complex-numbers/) | Learn | Python | +| 20 | [The Fourier Transform](phases/01-math-foundations/20-fourier-transform/) | Build | Python | +| 21 | [Graph Theory for ML](phases/01-math-foundations/21-graph-theory/) | Build | Python | +| 22 | [Stochastic Processes](phases/01-math-foundations/22-stochastic-processes/) | Learn | Python | -> *"Models will keep getting better. The skill that compounds is **knowing what to build**."*
-> β€” Industry consensus, 2026 +
-		 +
+Phase 2 β€” ML Fundamentals  18 lessons  Classical ML β€” still the backbone of most production AI. +
-### πŸ“š Foundational Papers Covered +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [What Is Machine Learning](phases/02-ml-fundamentals/01-what-is-machine-learning/) | Learn | Python | +| 02 | [Linear Regression from Scratch](phases/02-ml-fundamentals/02-linear-regression/) | Build | Python | +| 03 | [Logistic Regression & Classification](phases/02-ml-fundamentals/03-logistic-regression/) | Build | Python | +| 04 | [Decision Trees & Random Forests](phases/02-ml-fundamentals/04-decision-trees/) | Build | Python | +| 05 | [Support Vector Machines](phases/02-ml-fundamentals/05-support-vector-machines/) | Build | Python | +| 06 | [KNN & Distance Metrics](phases/02-ml-fundamentals/06-knn-and-distances/) | Build | Python | +| 07 | [Unsupervised Learning: K-Means, DBSCAN](phases/02-ml-fundamentals/07-unsupervised-learning/) | Build | Python | +| 08 | [Feature Engineering & Selection](phases/02-ml-fundamentals/08-feature-engineering/) | Build | Python | +| 09 | [Model Evaluation: Metrics, Cross-Validation](phases/02-ml-fundamentals/09-model-evaluation/) | Build | Python | +| 10 | [Bias, Variance & the Learning Curve](phases/02-ml-fundamentals/10-bias-variance/) | Learn | Python | +| 11 | [Ensemble Methods: Boosting, Bagging, Stacking](phases/02-ml-fundamentals/11-ensemble-methods/) | Build | Python | +| 12 | [Hyperparameter Tuning](phases/02-ml-fundamentals/12-hyperparameter-tuning/) | Build | Python | +| 13 | [ML Pipelines & Experiment Tracking](phases/02-ml-fundamentals/13-ml-pipelines/) | Build | Python | +| 14 | [Naive Bayes](phases/02-ml-fundamentals/14-naive-bayes/) | Build | Python | +| 15 | [Time Series Fundamentals](phases/02-ml-fundamentals/15-time-series/) | Build | Python | +| 16 | [Anomaly Detection](phases/02-ml-fundamentals/16-anomaly-detection/) | Build | Python | +| 17 | [Handling Imbalanced Data](phases/02-ml-fundamentals/17-imbalanced-data/) | Build | Python | +| 18 | [Feature Selection](phases/02-ml-fundamentals/18-feature-selection/) | Build | Python | -- πŸ“„ **Attention Is All You Need** *(Vaswani et al., 2017)* β†’ [Phase 7](#phase-7) -- πŸ“„ **GPT-3: Language Models are Few-Shot Learners** β†’ [Phase 10](#phase-10) -- πŸ“„ **Denoising Diffusion Probabilistic Models** β†’ [Phase 8](#phase-8) -- πŸ“„ **InstructGPT / RLHF** β†’ [Phase 10](#phase-10) -- πŸ“„ **Direct Preference Optimization (DPO)** β†’ [Phase 10](#phase-10) -- πŸ“„ **Chain-of-Thought Prompting** β†’ [Phase 11](#phase-11) -- πŸ“„ **ReAct: Reasoning + Acting in LLMs** β†’ [Phase 14](#phase-14) -- πŸ“„ **MCP: Model Context Protocol** *(Anthropic)* β†’ [Phase 13](#phase-13) +
-
+
+Phase 3 β€” Deep Learning Core  13 lessons  Neural networks from first principles. No frameworks until you build one. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [The Perceptron: Where It All Started](phases/03-deep-learning-core/01-the-perceptron/) | Build | Python | +| 02 | [Multi-Layer Networks & Forward Pass](phases/03-deep-learning-core/02-multi-layer-networks/) | Build | Python | +| 03 | [Backpropagation from Scratch](phases/03-deep-learning-core/03-backpropagation/) | Build | Python | +| 04 | [Activation Functions: ReLU, Sigmoid, GELU & Why](phases/03-deep-learning-core/04-activation-functions/) | Build | Python | +| 05 | [Loss Functions: MSE, Cross-Entropy, Contrastive](phases/03-deep-learning-core/05-loss-functions/) | Build | Python | +| 06 | [Optimizers: SGD, Momentum, Adam, AdamW](phases/03-deep-learning-core/06-optimizers/) | Build | Python | +| 07 | [Regularization: Dropout, Weight Decay, BatchNorm](phases/03-deep-learning-core/07-regularization/) | Build | Python | +| 08 | [Weight Initialization & Training Stability](phases/03-deep-learning-core/08-weight-initialization/) | Build | Python | +| 09 | [Learning Rate Schedules & Warmup](phases/03-deep-learning-core/09-learning-rate-schedules/) | Build | Python | +| 10 | [Build Your Own Mini Framework](phases/03-deep-learning-core/10-mini-framework/) | Build | Python | +| 11 | [Introduction to PyTorch](phases/03-deep-learning-core/11-intro-to-pytorch/) | Build | Python | +| 12 | [Introduction to JAX](phases/03-deep-learning-core/12-intro-to-jax/) | Build | Python | +| 13 | [Debugging Neural Networks](phases/03-deep-learning-core/13-debugging-neural-networks/) | Build | Python | + +
+ +
+Phase 4 β€” Computer Vision  28 lessons  From pixels to understanding β€” image, video, 3D, VLMs, and world models. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Image Fundamentals: Pixels, Channels, Color Spaces](phases/04-computer-vision/01-image-fundamentals/) | Learn | Python | +| 02 | [Convolutions from Scratch](phases/04-computer-vision/02-convolutions-from-scratch/) | Build | Python | +| 03 | [CNNs: LeNet to ResNet](phases/04-computer-vision/03-cnns-lenet-to-resnet/) | Build | Python | +| 04 | [Image Classification](phases/04-computer-vision/04-image-classification/) | Build | Python | +| 05 | [Transfer Learning & Fine-Tuning](phases/04-computer-vision/05-transfer-learning/) | Build | Python | +| 06 | [Object Detection β€” YOLO from Scratch](phases/04-computer-vision/06-object-detection-yolo/) | Build | Python | +| 07 | [Semantic Segmentation β€” U-Net](phases/04-computer-vision/07-semantic-segmentation-unet/) | Build | Python | +| 08 | [Instance Segmentation β€” Mask R-CNN](phases/04-computer-vision/08-instance-segmentation-mask-rcnn/) | Build | Python | +| 09 | [Image Generation β€” GANs](phases/04-computer-vision/09-image-generation-gans/) | Build | Python | +| 10 | [Image Generation β€” Diffusion Models](phases/04-computer-vision/10-image-generation-diffusion/) | Build | Python | +| 11 | [Stable Diffusion β€” Architecture & Fine-Tuning](phases/04-computer-vision/11-stable-diffusion/) | Build | Python | +| 12 | [Video Understanding β€” Temporal Modeling](phases/04-computer-vision/12-video-understanding/) | Build | Python | +| 13 | [3D Vision: Point Clouds, NeRFs](phases/04-computer-vision/13-3d-vision-nerf/) | Build | Python | +| 14 | [Vision Transformers (ViT)](phases/04-computer-vision/14-vision-transformers/) | Build | Python | +| 15 | [Real-Time Vision: Edge Deployment](phases/04-computer-vision/15-real-time-edge/) | Build | Python, Rust | +| 16 | [Build a Complete Vision Pipeline](phases/04-computer-vision/16-vision-pipeline-capstone/) | Build | Python | +| 17 | [Self-Supervised Vision β€” SimCLR, DINO, MAE](phases/04-computer-vision/17-self-supervised-vision/) | Build | Python | +| 18 | [Open-Vocabulary Vision β€” CLIP](phases/04-computer-vision/18-open-vocab-clip/) | Build | Python | +| 19 | [OCR & Document Understanding](phases/04-computer-vision/19-ocr-document-understanding/) | Build | Python | +| 20 | [Image Retrieval & Metric Learning](phases/04-computer-vision/20-image-retrieval-metric/) | Build | Python | +| 21 | [Keypoint Detection & Pose Estimation](phases/04-computer-vision/21-keypoint-pose/) | Build | Python | +| 22 | [3D Gaussian Splatting from Scratch](phases/04-computer-vision/22-3d-gaussian-splatting/) | Build | Python | +| 23 | [Diffusion Transformers & Rectified Flow](phases/04-computer-vision/23-diffusion-transformers-rectified-flow/) | Build | Python | +| 24 | [SAM 3 & Open-Vocabulary Segmentation](phases/04-computer-vision/24-sam3-open-vocab-segmentation/) | Build | Python | +| 25 | [Vision-Language Models (ViT-MLP-LLM)](phases/04-computer-vision/25-vision-language-models/) | Build | Python | +| 26 | [Monocular Depth & Geometry Estimation](phases/04-computer-vision/26-monocular-depth/) | Build | Python | +| 27 | [Multi-Object Tracking & Video Memory](phases/04-computer-vision/27-multi-object-tracking/) | Build | Python | +| 28 | [World Models & Video Diffusion](phases/04-computer-vision/28-world-models-video-diffusion/) | Build | Python | + +
+ +
+Phase 5 β€” NLP: Foundations to Advanced  29 lessons  Language is the interface to intelligence. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Text Processing: Tokenization, Stemming, Lemmatization](phases/05-nlp-foundations-to-advanced/01-text-processing/) | Build | Python | +| 02 | [Bag of Words, TF-IDF & Text Representation](phases/05-nlp-foundations-to-advanced/02-bag-of-words-tfidf/) | Build | Python | +| 03 | [Word Embeddings: Word2Vec from Scratch](phases/05-nlp-foundations-to-advanced/03-word-embeddings-word2vec/) | Build | Python | +| 04 | [GloVe, FastText & Subword Embeddings](phases/05-nlp-foundations-to-advanced/04-glove-fasttext-subword/) | Build | Python | +| 05 | [Sentiment Analysis](phases/05-nlp-foundations-to-advanced/05-sentiment-analysis/) | Build | Python | +| 06 | [Named Entity Recognition (NER)](phases/05-nlp-foundations-to-advanced/06-named-entity-recognition/) | Build | Python | +| 07 | [POS Tagging & Syntactic Parsing](phases/05-nlp-foundations-to-advanced/07-pos-tagging-parsing/) | Build | Python | +| 08 | [Text Classification β€” CNNs & RNNs for Text](phases/05-nlp-foundations-to-advanced/08-cnns-rnns-for-text/) | Build | Python | +| 09 | [Sequence-to-Sequence Models](phases/05-nlp-foundations-to-advanced/09-sequence-to-sequence/) | Build | Python | +| 10 | [Attention Mechanism β€” The Breakthrough](phases/05-nlp-foundations-to-advanced/10-attention-mechanism/) | Build | Python | +| 11 | [Machine Translation](phases/05-nlp-foundations-to-advanced/11-machine-translation/) | Build | Python | +| 12 | [Text Summarization](phases/05-nlp-foundations-to-advanced/12-text-summarization/) | Build | Python | +| 13 | [Question Answering Systems](phases/05-nlp-foundations-to-advanced/13-question-answering/) | Build | Python | +| 14 | [Information Retrieval & Search](phases/05-nlp-foundations-to-advanced/14-information-retrieval-search/) | Build | Python | +| 15 | [Topic Modeling: LDA, BERTopic](phases/05-nlp-foundations-to-advanced/15-topic-modeling/) | Build | Python | +| 16 | [Text Generation](phases/05-nlp-foundations-to-advanced/16-text-generation-pre-transformer/) | Build | Python | +| 17 | [Chatbots: Rule-Based to Neural](phases/05-nlp-foundations-to-advanced/17-chatbots-rule-to-neural/) | Build | Python | +| 18 | [Multilingual NLP](phases/05-nlp-foundations-to-advanced/18-multilingual-nlp/) | Build | Python | +| 19 | [Subword Tokenization: BPE, WordPiece, Unigram, SentencePiece](phases/05-nlp-foundations-to-advanced/19-subword-tokenization/) | Learn | Python | +| 20 | [Structured Outputs & Constrained Decoding](phases/05-nlp-foundations-to-advanced/20-structured-outputs-constrained-decoding/) | Build | Python | +| 21 | [NLI & Textual Entailment](phases/05-nlp-foundations-to-advanced/21-nli-textual-entailment/) | Learn | Python | +| 22 | [Embedding Models Deep Dive](phases/05-nlp-foundations-to-advanced/22-embedding-models-deep-dive/) | Learn | Python | +| 23 | [Chunking Strategies for RAG](phases/05-nlp-foundations-to-advanced/23-chunking-strategies-rag/) | Build | Python | +| 24 | [Coreference Resolution](phases/05-nlp-foundations-to-advanced/24-coreference-resolution/) | Learn | Python | +| 25 | [Entity Linking & Disambiguation](phases/05-nlp-foundations-to-advanced/25-entity-linking/) | Build | Python | +| 26 | [Relation Extraction & Knowledge Graph Construction](phases/05-nlp-foundations-to-advanced/26-relation-extraction-kg/) | Build | Python | +| 27 | [LLM Evaluation: RAGAS, DeepEval, G-Eval](phases/05-nlp-foundations-to-advanced/27-llm-evaluation-frameworks/) | Build | Python | +| 28 | [Long-Context Evaluation: NIAH, RULER, LongBench, MRCR](phases/05-nlp-foundations-to-advanced/28-long-context-evaluation/) | Learn | Python | +| 29 | [Dialogue State Tracking](phases/05-nlp-foundations-to-advanced/29-dialogue-state-tracking/) | Build | Python | + +
+ +
+Phase 6 β€” Speech & Audio  17 lessons  Hear, understand, speak. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Audio Fundamentals: Waveforms, Sampling, FFT](phases/06-speech-and-audio/01-audio-fundamentals) | Learn | Python | +| 02 | [Spectrograms, Mel Scale & Audio Features](phases/06-speech-and-audio/02-spectrograms-mel-features) | Build | Python | +| 03 | [Audio Classification](phases/06-speech-and-audio/03-audio-classification) | Build | Python | +| 04 | [Speech Recognition (ASR)](phases/06-speech-and-audio/04-speech-recognition-asr) | Build | Python | +| 05 | [Whisper: Architecture & Fine-Tuning](phases/06-speech-and-audio/05-whisper-architecture-finetuning) | Build | Python | +| 06 | [Speaker Recognition & Verification](phases/06-speech-and-audio/06-speaker-recognition-verification) | Build | Python | +| 07 | [Text-to-Speech (TTS)](phases/06-speech-and-audio/07-text-to-speech) | Build | Python | +| 08 | [Voice Cloning & Voice Conversion](phases/06-speech-and-audio/08-voice-cloning-conversion) | Build | Python | +| 09 | [Music Generation](phases/06-speech-and-audio/09-music-generation) | Build | Python | +| 10 | [Audio-Language Models](phases/06-speech-and-audio/10-audio-language-models) | Build | Python | +| 11 | [Real-Time Audio Processing](phases/06-speech-and-audio/11-real-time-audio-processing) | Build | Python, Rust | +| 12 | [Build a Voice Assistant Pipeline](phases/06-speech-and-audio/12-voice-assistant-pipeline) | Build | Python | +| 13 | [Neural Audio Codecs β€” EnCodec, SNAC, Mimi, DAC](phases/06-speech-and-audio/13-neural-audio-codecs) | Learn | Python | +| 14 | [Voice Activity Detection & Turn-Taking](phases/06-speech-and-audio/14-voice-activity-detection-turn-taking) | Build | Python | +| 15 | [Streaming Speech-to-Speech β€” Moshi, Hibiki](phases/06-speech-and-audio/15-streaming-speech-to-speech-moshi-hibiki) | Learn | Python | +| 16 | [Voice Anti-Spoofing & Audio Watermarking](phases/06-speech-and-audio/16-anti-spoofing-audio-watermarking) | Build | Python | +| 17 | [Audio Evaluation β€” WER, MOS, MMAU, Leaderboards](phases/06-speech-and-audio/17-audio-evaluation-metrics) | Learn | Python | + +
+ +
+Phase 7 β€” Transformers Deep Dive  14 lessons  The architecture that changed everything. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Why Transformers: The Problems with RNNs](phases/07-transformers-deep-dive/01-why-transformers/) | Learn | Python | +| 02 | [Self-Attention from Scratch](phases/07-transformers-deep-dive/02-self-attention-from-scratch/) | Build | Python | +| 03 | [Multi-Head Attention](phases/07-transformers-deep-dive/03-multi-head-attention/) | Build | Python | +| 04 | [Positional Encoding: Sinusoidal, RoPE, ALiBi](phases/07-transformers-deep-dive/04-positional-encoding/) | Build | Python | +| 05 | [The Full Transformer: Encoder + Decoder](phases/07-transformers-deep-dive/05-full-transformer/) | Build | Python | +| 06 | [BERT β€” Masked Language Modeling](phases/07-transformers-deep-dive/06-bert-masked-language-modeling/) | Build | Python | +| 07 | [GPT β€” Causal Language Modeling](phases/07-transformers-deep-dive/07-gpt-causal-language-modeling/) | Build | Python | +| 08 | [T5, BART β€” Encoder-Decoder Models](phases/07-transformers-deep-dive/08-t5-bart-encoder-decoder/) | Learn | Python | +| 09 | [Vision Transformers (ViT)](phases/07-transformers-deep-dive/09-vision-transformers/) | Build | Python | +| 10 | [Audio Transformers β€” Whisper Architecture](phases/07-transformers-deep-dive/10-audio-transformers-whisper/) | Learn | Python | +| 11 | [Mixture of Experts (MoE)](phases/07-transformers-deep-dive/11-mixture-of-experts/) | Build | Python | +| 12 | [KV Cache, Flash Attention & Inference Optimization](phases/07-transformers-deep-dive/12-kv-cache-flash-attention/) | Build | Python | +| 13 | [Scaling Laws](phases/07-transformers-deep-dive/13-scaling-laws/) | Learn | Python | +| 14 | [Build a Transformer from Scratch](phases/07-transformers-deep-dive/14-build-a-transformer-capstone/) | Build | Python | + +
+ +
+Phase 8 β€” Generative AI  14 lessons  Create images, video, audio, 3D, and more. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Generative Models: Taxonomy & History](phases/08-generative-ai/01-generative-models-taxonomy-history/) | Learn | Python | +| 02 | [Autoencoders & VAE](phases/08-generative-ai/02-autoencoders-vae/) | Build | Python | +| 03 | [GANs: Generator vs Discriminator](phases/08-generative-ai/03-gans-generator-discriminator/) | Build | Python | +| 04 | [Conditional GANs & Pix2Pix](phases/08-generative-ai/04-conditional-gans-pix2pix/) | Build | Python | +| 05 | [StyleGAN](phases/08-generative-ai/05-stylegan/) | Build | Python | +| 06 | [Diffusion Models β€” DDPM from Scratch](phases/08-generative-ai/06-diffusion-ddpm-from-scratch/) | Build | Python | +| 07 | [Latent Diffusion & Stable Diffusion](phases/08-generative-ai/07-latent-diffusion-stable-diffusion/) | Build | Python | +| 08 | [ControlNet, LoRA & Conditioning](phases/08-generative-ai/08-controlnet-lora-conditioning/) | Build | Python | +| 09 | [Inpainting, Outpainting & Editing](phases/08-generative-ai/09-inpainting-outpainting-editing/) | Build | Python | +| 10 | [Video Generation](phases/08-generative-ai/10-video-generation/) | Build | Python | +| 11 | [Audio Generation](phases/08-generative-ai/11-audio-generation/) | Build | Python | +| 12 | [3D Generation](phases/08-generative-ai/12-3d-generation/) | Build | Python | +| 13 | [Flow Matching & Rectified Flows](phases/08-generative-ai/13-flow-matching-rectified-flows/) | Build | Python | +| 14 | [Evaluation: FID, CLIP Score](phases/08-generative-ai/14-evaluation-fid-clip-score/) | Build | Python | + +
+ +
+Phase 9 β€” Reinforcement Learning  12 lessons  The foundation of RLHF and game-playing AI. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [MDPs, States, Actions & Rewards](phases/09-reinforcement-learning/01-mdps-states-actions-rewards/) | Learn | Python | +| 02 | [Dynamic Programming](phases/09-reinforcement-learning/02-dynamic-programming/) | Build | Python | +| 03 | [Monte Carlo Methods](phases/09-reinforcement-learning/03-monte-carlo-methods/) | Build | Python | +| 04 | [Q-Learning, SARSA](phases/09-reinforcement-learning/04-q-learning-sarsa/) | Build | Python | +| 05 | [Deep Q-Networks (DQN)](phases/09-reinforcement-learning/05-dqn/) | Build | Python | +| 06 | [Policy Gradients β€” REINFORCE](phases/09-reinforcement-learning/06-policy-gradients-reinforce/) | Build | Python | +| 07 | [Actor-Critic β€” A2C, A3C](phases/09-reinforcement-learning/07-actor-critic-a2c-a3c/) | Build | Python | +| 08 | [PPO](phases/09-reinforcement-learning/08-ppo/) | Build | Python | +| 09 | [Reward Modeling & RLHF](phases/09-reinforcement-learning/09-reward-modeling-rlhf/) | Build | Python | +| 10 | [Multi-Agent RL](phases/09-reinforcement-learning/10-multi-agent-rl/) | Build | Python | +| 11 | [Sim-to-Real Transfer](phases/09-reinforcement-learning/11-sim-to-real-transfer/) | Build | Python | +| 12 | [RL for Games](phases/09-reinforcement-learning/12-rl-for-games/) | Build | Python | + +
+ +
+Phase 10 β€” LLMs from Scratch  22 lessons  Build, train, and understand large language models. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Tokenizers: BPE, WordPiece, SentencePiece](phases/10-llms-from-scratch/01-tokenizers/) | Build | Python | +| 02 | [Building a Tokenizer from Scratch](phases/10-llms-from-scratch/02-building-a-tokenizer/) | Build | Python | +| 03 | [Data Pipelines for Pre-Training](phases/10-llms-from-scratch/03-data-pipelines/) | Build | Python | +| 04 | [Pre-Training a Mini GPT (124M)](phases/10-llms-from-scratch/04-pre-training-mini-gpt/) | Build | Python | +| 05 | [Distributed Training, FSDP, DeepSpeed](phases/10-llms-from-scratch/05-scaling-distributed/) | Build | Python | +| 06 | [Instruction Tuning β€” SFT](phases/10-llms-from-scratch/06-instruction-tuning-sft/) | Build | Python | +| 07 | [RLHF β€” Reward Model + PPO](phases/10-llms-from-scratch/07-rlhf/) | Build | Python | +| 08 | [DPO β€” Direct Preference Optimization](phases/10-llms-from-scratch/08-dpo/) | Build | Python | +| 09 | [Constitutional AI & Self-Improvement](phases/10-llms-from-scratch/09-constitutional-ai-self-improvement/) | Build | Python | +| 10 | [Evaluation β€” Benchmarks, Evals](phases/10-llms-from-scratch/10-evaluation/) | Build | Python | +| 11 | [Quantization: INT8, GPTQ, AWQ, GGUF](phases/10-llms-from-scratch/11-quantization/) | Build | Python, Rust | +| 12 | [Inference Optimization](phases/10-llms-from-scratch/12-inference-optimization/) | Build | Python | +| 13 | [Building a Complete LLM Pipeline](phases/10-llms-from-scratch/13-building-complete-llm-pipeline/) | Build | Python | +| 14 | [Open Models: Architecture Walkthroughs](phases/10-llms-from-scratch/14-open-models-architecture-walkthroughs/) | Learn | Python | +| 15 | [Speculative Decoding and EAGLE-3](phases/10-llms-from-scratch/15-speculative-decoding-eagle3/) | Build | Python | +| 16 | [Differential Attention (V2)](phases/10-llms-from-scratch/16-differential-attention-v2/) | Build | Python | +| 17 | [Native Sparse Attention (DeepSeek NSA)](phases/10-llms-from-scratch/17-native-sparse-attention/) | Build | Python | +| 18 | [Multi-Token Prediction (MTP)](phases/10-llms-from-scratch/18-multi-token-prediction/) | Build | Python | +| 19 | [DualPipe Parallelism](phases/10-llms-from-scratch/19-dualpipe-parallelism/) | Learn | Python | +| 20 | [DeepSeek-V3 Architecture Walkthrough](phases/10-llms-from-scratch/20-deepseek-v3-walkthrough/) | Learn | Python | +| 21 | [Jamba β€” Hybrid SSM-Transformer](phases/10-llms-from-scratch/21-jamba-hybrid-ssm-transformer/) | Learn | Python | +| 22 | [Async and Hogwild! Inference](phases/10-llms-from-scratch/22-async-hogwild-inference/) | Build | Python | + +
+ +
+Phase 11 β€” LLM Engineering  15 lessons  Put LLMs to work in production. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Prompt Engineering: Techniques & Patterns](phases/11-llm-engineering/01-prompt-engineering/) | Build | Python | +| 02 | [Few-Shot, CoT, Tree-of-Thought](phases/11-llm-engineering/02-few-shot-cot/) | Build | Python | +| 03 | [Structured Outputs](phases/11-llm-engineering/03-structured-outputs/) | Build | Python, TypeScript | +| 04 | [Embeddings & Vector Representations](phases/11-llm-engineering/04-embeddings/) | Build | Python | +| 05 | [Context Engineering](phases/11-llm-engineering/05-context-engineering/) | Build | Python, TypeScript | +| 06 | [RAG: Retrieval-Augmented Generation](phases/11-llm-engineering/06-rag/) | Build | Python, TypeScript | +| 07 | [Advanced RAG: Chunking, Reranking](phases/11-llm-engineering/07-advanced-rag/) | Build | Python | +| 08 | [Fine-Tuning with LoRA & QLoRA](phases/11-llm-engineering/08-fine-tuning-lora/) | Build | Python | +| 09 | [Function Calling & Tool Use](phases/11-llm-engineering/09-function-calling/) | Build | Python | +| 10 | [Evaluation & Testing](phases/11-llm-engineering/10-evaluation/) | Build | Python | +| 11 | [Caching, Rate Limiting & Cost](phases/11-llm-engineering/11-caching-cost/) | Build | Python | +| 12 | [Guardrails & Safety](phases/11-llm-engineering/12-guardrails/) | Build | Python | +| 13 | [Building a Production LLM App](phases/11-llm-engineering/13-production-app/) | Build | Python | +| 14 | [Model Context Protocol (MCP)](phases/11-llm-engineering/14-model-context-protocol/) | Build | Python | +| 15 | [Prompt Caching & Context Caching](phases/11-llm-engineering/15-prompt-caching/) | Build | Python | + +
+ +
+Phase 12 β€” Multimodal AI  25 lessons  See, hear, read, and reason across modalities β€” from ViT patches to computer-use agents. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Vision Transformers and the Patch-Token Primitive](phases/12-multimodal-ai/01-vision-transformer-patch-tokens/) | Learn | Python | +| 02 | [CLIP and Contrastive Vision-Language Pretraining](phases/12-multimodal-ai/02-clip-contrastive-pretraining/) | Build | Python | +| 03 | [BLIP-2 Q-Former as Modality Bridge](phases/12-multimodal-ai/03-blip2-qformer-bridge/) | Build | Python | +| 04 | [Flamingo and Gated Cross-Attention](phases/12-multimodal-ai/04-flamingo-gated-cross-attention/) | Learn | Python | +| 05 | [LLaVA and Visual Instruction Tuning](phases/12-multimodal-ai/05-llava-visual-instruction-tuning/) | Build | Python | +| 06 | [Any-Resolution Vision β€” Patch-n'-Pack and NaFlex](phases/12-multimodal-ai/06-any-resolution-patch-n-pack/) | Build | Python | +| 07 | [Open-Weight VLM Recipes: What Actually Matters](phases/12-multimodal-ai/07-open-weight-vlm-recipes/) | Learn | Python | +| 08 | [LLaVA-OneVision: Single, Multi, Video](phases/12-multimodal-ai/08-llava-onevision-single-multi-video/) | Build | Python | +| 09 | [Qwen-VL Family and Dynamic-FPS Video](phases/12-multimodal-ai/09-qwen-vl-family-dynamic-fps/) | Learn | Python | +| 10 | [InternVL3 Native Multimodal Pretraining](phases/12-multimodal-ai/10-internvl3-native-multimodal/) | Learn | Python | +| 11 | [Chameleon Early-Fusion Token-Only](phases/12-multimodal-ai/11-chameleon-early-fusion-tokens/) | Build | Python | +| 12 | [Emu3 Next-Token Prediction for Generation](phases/12-multimodal-ai/12-emu3-next-token-for-generation/) | Learn | Python | +| 13 | [Transfusion Autoregressive + Diffusion](phases/12-multimodal-ai/13-transfusion-autoregressive-diffusion/) | Build | Python | +| 14 | [Show-o Discrete-Diffusion Unified](phases/12-multimodal-ai/14-show-o-discrete-diffusion-unified/) | Learn | Python | +| 15 | [Janus-Pro Decoupled Encoders](phases/12-multimodal-ai/15-janus-pro-decoupled-encoders/) | Build | Python | +| 16 | [MIO Any-to-Any Streaming](phases/12-multimodal-ai/16-mio-any-to-any-streaming/) | Learn | Python | +| 17 | [Video-Language Temporal Grounding](phases/12-multimodal-ai/17-video-language-temporal-grounding/) | Build | Python | +| 18 | [Long-Video at Million-Token Context](phases/12-multimodal-ai/18-long-video-million-token/) | Build | Python | +| 19 | [Audio-Language Models: Whisper to AF3](phases/12-multimodal-ai/19-audio-language-whisper-to-af3/) | Build | Python | +| 20 | [Omni Models: Thinker-Talker Streaming](phases/12-multimodal-ai/20-omni-models-thinker-talker/) | Build | Python | +| 21 | [Embodied VLAs: RT-2, OpenVLA, Ο€0, GR00T](phases/12-multimodal-ai/21-embodied-vlas-openvla-pi0-groot/) | Learn | Python | +| 22 | [Document and Diagram Understanding](phases/12-multimodal-ai/22-document-diagram-understanding/) | Build | Python | +| 23 | [ColPali Vision-Native Document RAG](phases/12-multimodal-ai/23-colpali-vision-native-rag/) | Build | Python | +| 24 | [Multimodal RAG and Cross-Modal Retrieval](phases/12-multimodal-ai/24-multimodal-rag-cross-modal/) | Build | Python | +| 25 | [Multimodal Agents and Computer-Use (Capstone)](phases/12-multimodal-ai/25-multimodal-agents-computer-use/) | Build | Python | + +
+ +
+Phase 13 β€” Tools & Protocols  23 lessons  The interfaces between AI and the real world. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [The Tool Interface](phases/13-tools-and-protocols/01-the-tool-interface/) | Learn | Python | +| 02 | [Function Calling Deep Dive](phases/13-tools-and-protocols/02-function-calling-deep-dive/) | Build | Python | +| 03 | [Parallel and Streaming Tool Calls](phases/13-tools-and-protocols/03-parallel-and-streaming-tool-calls/) | Build | Python | +| 04 | [Structured Output](phases/13-tools-and-protocols/04-structured-output/) | Build | Python | +| 05 | [Tool Schema Design](phases/13-tools-and-protocols/05-tool-schema-design/) | Learn | Python | +| 06 | [MCP Fundamentals](phases/13-tools-and-protocols/06-mcp-fundamentals/) | Learn | Python | +| 07 | [Building an MCP Server](phases/13-tools-and-protocols/07-building-an-mcp-server/) | Build | Python | +| 08 | [Building an MCP Client](phases/13-tools-and-protocols/08-building-an-mcp-client/) | Build | Python | +| 09 | [MCP Transports](phases/13-tools-and-protocols/09-mcp-transports/) | Learn | Python | +| 10 | [MCP Resources and Prompts](phases/13-tools-and-protocols/10-mcp-resources-and-prompts/) | Build | Python | +| 11 | [MCP Sampling](phases/13-tools-and-protocols/11-mcp-sampling/) | Build | Python | +| 12 | [MCP Roots and Elicitation](phases/13-tools-and-protocols/12-mcp-roots-and-elicitation/) | Build | Python | +| 13 | [MCP Async Tasks](phases/13-tools-and-protocols/13-mcp-async-tasks/) | Build | Python | +| 14 | [MCP Apps](phases/13-tools-and-protocols/14-mcp-apps/) | Build | Python | +| 15 | [MCP Security I β€” Tool Poisoning](phases/13-tools-and-protocols/15-mcp-security-tool-poisoning/) | Learn | Python | +| 16 | [MCP Security II β€” OAuth 2.1](phases/13-tools-and-protocols/16-mcp-security-oauth-2-1/) | Build | Python | +| 17 | [MCP Gateways and Registries](phases/13-tools-and-protocols/17-mcp-gateways-and-registries/) | Learn | Python | +| 18 | [MCP Auth in Production β€” DCR + JWKS on iii](phases/13-tools-and-protocols/18-mcp-auth-production/) | Build | Python | +| 19 | [A2A Protocol](phases/13-tools-and-protocols/19-a2a-protocol/) | Build | Python | +| 20 | [OpenTelemetry GenAI](phases/13-tools-and-protocols/20-opentelemetry-genai/) | Build | Python | +| 21 | [LLM Routing Layer](phases/13-tools-and-protocols/21-llm-routing-layer/) | Learn | Python | +| 22 | [Skills and Agent SDKs](phases/13-tools-and-protocols/22-skills-and-agent-sdks/) | Learn | Python | +| 23 | [Capstone β€” Tool Ecosystem](phases/13-tools-and-protocols/23-capstone-tool-ecosystem/) | Build | Python | + +
+ +
+Phase 14 β€” Agent Engineering  30 lessons  Build agents from first principles β€” loop, memory, planning, frameworks, benchmarks, production. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [The Agent Loop](phases/14-agent-engineering/01-the-agent-loop/) | Build | Python | +| 02 | [ReWOO and Plan-and-Execute](phases/14-agent-engineering/02-rewoo-plan-and-execute/) | Build | Python | +| 03 | [Reflexion and Verbal Reinforcement Learning](phases/14-agent-engineering/03-reflexion-verbal-rl/) | Build | Python | +| 04 | [Tree of Thoughts and LATS](phases/14-agent-engineering/04-tree-of-thoughts-lats/) | Build | Python | +| 05 | [Self-Refine and CRITIC](phases/14-agent-engineering/05-self-refine-and-critic/) | Build | Python | +| 06 | [Tool Use and Function Calling](phases/14-agent-engineering/06-tool-use-and-function-calling/) | Build | Python | +| 07 | [Memory β€” Virtual Context and MemGPT](phases/14-agent-engineering/07-memory-virtual-context-memgpt/) | Build | Python | +| 08 | [Memory Blocks and Sleep-Time Compute](phases/14-agent-engineering/08-memory-blocks-sleep-time-compute/) | Build | Python | +| 09 | [Hybrid Memory β€” Mem0 Vector + Graph + KV](phases/14-agent-engineering/09-hybrid-memory-mem0/) | Build | Python | +| 10 | [Skill Libraries and Lifelong Learning β€” Voyager](phases/14-agent-engineering/10-skill-libraries-voyager/) | Build | Python | +| 11 | [Planning with HTN and Evolutionary Search](phases/14-agent-engineering/11-planning-htn-and-evolutionary/) | Build | Python | +| 12 | [Anthropic's Workflow Patterns](phases/14-agent-engineering/12-anthropic-workflow-patterns/) | Build | Python | +| 13 | [LangGraph β€” Stateful Graphs and Durable Execution](phases/14-agent-engineering/13-langgraph-stateful-graphs/) | Build | Python | +| 14 | [AutoGen v0.4 β€” Actor Model](phases/14-agent-engineering/14-autogen-actor-model/) | Build | Python | +| 15 | [CrewAI β€” Role-Based Crews and Flows](phases/14-agent-engineering/15-crewai-role-based-crews/) | Build | Python | +| 16 | [OpenAI Agents SDK β€” Handoffs, Guardrails, Tracing](phases/14-agent-engineering/16-openai-agents-sdk/) | Build | Python | +| 17 | [Claude Agent SDK β€” Subagents and Session Store](phases/14-agent-engineering/17-claude-agent-sdk/) | Build | Python | +| 18 | [Agno and Mastra β€” Production Runtimes](phases/14-agent-engineering/18-agno-and-mastra-runtimes/) | Learn | Python, TypeScript | +| 19 | [Benchmarks β€” SWE-bench, GAIA, AgentBench](phases/14-agent-engineering/19-benchmarks-swebench-gaia/) | Learn | Python | +| 20 | [Benchmarks β€” WebArena and OSWorld](phases/14-agent-engineering/20-benchmarks-webarena-osworld/) | Learn | Python | +| 21 | [Computer Use β€” Claude, OpenAI CUA, Gemini](phases/14-agent-engineering/21-computer-use-agents/) | Build | Python | +| 22 | [Voice Agents β€” Pipecat and LiveKit](phases/14-agent-engineering/22-voice-agents-pipecat-livekit/) | Build | Python | +| 23 | [OpenTelemetry GenAI Semantic Conventions](phases/14-agent-engineering/23-otel-genai-conventions/) | Build | Python | +| 24 | [Agent Observability β€” Langfuse, Phoenix, Opik](phases/14-agent-engineering/24-agent-observability-platforms/) | Learn | Python | +| 25 | [Multi-Agent Debate and Collaboration](phases/14-agent-engineering/25-multi-agent-debate/) | Build | Python | +| 26 | [Failure Modes β€” Why Agents Break](phases/14-agent-engineering/26-failure-modes-agentic/) | Build | Python | +| 27 | [Prompt Injection and the PVE Defense](phases/14-agent-engineering/27-prompt-injection-defense/) | Build | Python | +| 28 | [Orchestration Patterns β€” Supervisor, Swarm, Hierarchical](phases/14-agent-engineering/28-orchestration-patterns/) | Build | Python | +| 29 | [Production Runtimes β€” Queue, Event, Cron](phases/14-agent-engineering/29-production-runtimes/) | Learn | Python | +| 30 | [Eval-Driven Agent Development](phases/14-agent-engineering/30-eval-driven-agent-development/) | Build | Python | + +
+ +
+Phase 15 β€” Autonomous Systems  22 lessons  Long-horizon agents, self-improvement, and the 2026 safety stack. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [From Chatbots to Long-Horizon Agents (METR)](phases/15-autonomous-systems/01-long-horizon-agents/) | Learn | Python | +| 02 | [STaR, V-STaR, Quiet-STaR: Self-Taught Reasoning](phases/15-autonomous-systems/02-star-family-reasoning/) | Learn | Python | +| 03 | [AlphaEvolve: Evolutionary Coding Agents](phases/15-autonomous-systems/03-alphaevolve-evolutionary-coding/) | Learn | Python | +| 04 | [Darwin GΓΆdel Machine: Self-Modifying Agents](phases/15-autonomous-systems/04-darwin-godel-machine/) | Learn | Python | +| 05 | [AI Scientist v2: Workshop-Level Research](phases/15-autonomous-systems/05-ai-scientist-v2/) | Learn | Python | +| 06 | [Automated Alignment Research (Anthropic AAR)](phases/15-autonomous-systems/06-automated-alignment-research/) | Learn | Python | +| 07 | [Recursive Self-Improvement: Capability vs Alignment](phases/15-autonomous-systems/07-recursive-self-improvement/) | Learn | Python | +| 08 | [Bounded Self-Improvement Designs](phases/15-autonomous-systems/08-bounded-self-improvement/) | Learn | Python | +| 09 | [Autonomous Coding Agent Landscape (SWE-bench, CodeAct)](phases/15-autonomous-systems/09-coding-agent-landscape/) | Learn | Python | +| 10 | [Claude Code Permission Modes and Auto Mode](phases/15-autonomous-systems/10-claude-code-permission-modes/) | Learn | Python | +| 11 | [Browser Agents and Indirect Prompt Injection](phases/15-autonomous-systems/11-browser-agents/) | Learn | Python | +| 12 | [Durable Execution for Long-Running Agents](phases/15-autonomous-systems/12-durable-execution/) | Learn | Python | +| 13 | [Action Budgets, Iteration Caps, Cost Governors](phases/15-autonomous-systems/13-cost-governors/) | Learn | Python | +| 14 | [Kill Switches, Circuit Breakers, Canary Tokens](phases/15-autonomous-systems/14-kill-switches-canaries/) | Learn | Python | +| 15 | [HITL: Propose-Then-Commit](phases/15-autonomous-systems/15-propose-then-commit/) | Learn | Python | +| 16 | [Checkpoints and Rollback](phases/15-autonomous-systems/16-checkpoints-rollback/) | Learn | Python | +| 17 | [Constitutional AI and Rule Overrides](phases/15-autonomous-systems/17-constitutional-ai/) | Learn | Python | +| 18 | [Llama Guard and Input/Output Classification](phases/15-autonomous-systems/18-llama-guard/) | Learn | Python | +| 19 | [Anthropic Responsible Scaling Policy v3.0](phases/15-autonomous-systems/19-anthropic-rsp/) | Learn | Python | +| 20 | [OpenAI Preparedness Framework and DeepMind FSF](phases/15-autonomous-systems/20-openai-preparedness-deepmind-fsf/) | Learn | Python | +| 21 | [METR Time Horizons and External Evaluation](phases/15-autonomous-systems/21-metr-external-evaluation/) | Learn | Python | +| 22 | [CAIS, CAISI, and Societal-Scale Risk](phases/15-autonomous-systems/22-cais-caisi-societal-risk/) | Learn | Python | + +
+ +
+Phase 16 β€” Multi-Agent & Swarms  25 lessons  Coordination, emergence, and collective intelligence. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Why Multi-Agent](phases/16-multi-agent-and-swarms/01-why-multi-agent/) | Learn | TypeScript | +| 02 | [FIPA-ACL Heritage and Speech Acts](phases/16-multi-agent-and-swarms/02-fipa-acl-heritage/) | Learn | Python | +| 03 | [Communication Protocols](phases/16-multi-agent-and-swarms/03-communication-protocols/) | Build | TypeScript | +| 04 | [The Multi-Agent Primitive Model](phases/16-multi-agent-and-swarms/04-primitive-model/) | Learn | Python | +| 05 | [Supervisor / Orchestrator-Worker Pattern](phases/16-multi-agent-and-swarms/05-supervisor-orchestrator-pattern/) | Build | Python | +| 06 | [Hierarchical Architecture and Decomposition Drift](phases/16-multi-agent-and-swarms/06-hierarchical-architecture/) | Learn | Python | +| 07 | [Society of Mind and Multi-Agent Debate](phases/16-multi-agent-and-swarms/07-society-of-mind-debate/) | Build | Python | +| 08 | [Role Specialization β€” Planner / Critic / Executor / Verifier](phases/16-multi-agent-and-swarms/08-role-specialization/) | Build | Python | +| 09 | [Parallel Swarm and Networked Architectures](phases/16-multi-agent-and-swarms/09-parallel-swarm-networks/) | Build | Python | +| 10 | [Group Chat and Speaker Selection](phases/16-multi-agent-and-swarms/10-group-chat-speaker-selection/) | Build | Python | +| 11 | [Handoffs and Routines (Stateless Orchestration)](phases/16-multi-agent-and-swarms/11-handoffs-and-routines/) | Build | Python | +| 12 | [A2A β€” The Agent-to-Agent Protocol](phases/16-multi-agent-and-swarms/12-a2a-protocol/) | Build | Python | +| 13 | [Shared Memory and Blackboard Patterns](phases/16-multi-agent-and-swarms/13-shared-memory-blackboard/) | Build | Python | +| 14 | [Consensus and Byzantine Fault Tolerance](phases/16-multi-agent-and-swarms/14-consensus-and-bft/) | Build | Python | +| 15 | [Voting, Self-Consistency, and Debate Topology](phases/16-multi-agent-and-swarms/15-voting-debate-topology/) | Build | Python | +| 16 | [Negotiation and Bargaining](phases/16-multi-agent-and-swarms/16-negotiation-bargaining/) | Build | Python | +| 17 | [Generative Agents and Emergent Simulation](phases/16-multi-agent-and-swarms/17-generative-agents-simulation/) | Build | Python | +| 18 | [Theory of Mind and Emergent Coordination](phases/16-multi-agent-and-swarms/18-theory-of-mind-coordination/) | Build | Python | +| 19 | [Swarm Optimization (PSO, ACO)](phases/16-multi-agent-and-swarms/19-swarm-optimization-pso-aco/) | Build | Python | +| 20 | [MARL β€” MADDPG, QMIX, MAPPO](phases/16-multi-agent-and-swarms/20-marl-maddpg-qmix-mappo/) | Learn | Python | +| 21 | [Agent Economies, Token Incentives, Reputation](phases/16-multi-agent-and-swarms/21-agent-economies/) | Learn | Python | +| 22 | [Production Scaling β€” Queues, Checkpoints, Durability](phases/16-multi-agent-and-swarms/22-production-scaling-queues-checkpoints/) | Build | Python | +| 23 | [Failure Modes β€” MAST, Groupthink, Monoculture](phases/16-multi-agent-and-swarms/23-failure-modes-mast-groupthink/) | Learn | Python | +| 24 | [Evaluation and Coordination Benchmarks](phases/16-multi-agent-and-swarms/24-evaluation-coordination-benchmarks/) | Learn | Python | +| 25 | [Case Studies and 2026 State of the Art](phases/16-multi-agent-and-swarms/25-case-studies-2026-sota/) | Learn | Python | + +
+ +
+Phase 17 β€” Infrastructure & Production  28 lessons  Ship AI to the real world. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | Managed LLM Platforms β€” Bedrock, Azure OpenAI, Vertex AI | Learn | Python | +| 02 | Inference Platform Economics β€” Fireworks, Together, Baseten, Modal | Learn | Python | +| 03 | GPU Autoscaling on Kubernetes β€” Karpenter, KAI Scheduler | Learn | Python | +| 04 | vLLM Serving Internals β€” PagedAttention, Continuous Batching, Chunked Prefill | Learn | Python | +| 05 | EAGLE-3 Speculative Decoding in Production | Learn | Python | +| 06 | SGLang and RadixAttention for Prefix-Heavy Workloads | Learn | Python | +| 07 | TensorRT-LLM on Blackwell with FP8 and NVFP4 | Learn | Python | +| 08 | Inference Metrics β€” TTFT, TPOT, ITL, Goodput, P99 | Learn | Python | +| 09 | Production Quantization β€” AWQ, GPTQ, GGUF, FP8, NVFP4 | Learn | Python | +| 10 | Cold Start Mitigation for Serverless LLMs | Learn | Python | +| 11 | Multi-Region LLM Serving and KV Cache Locality | Learn | Python | +| 12 | Edge Inference β€” ANE, Hexagon, WebGPU, Jetson | Learn | Python | +| 13 | LLM Observability Stack Selection | Learn | Python | +| 14 | Prompt Caching and Semantic Caching Economics | Learn | Python | +| 15 | Batch APIs β€” the 50% Discount as Industry Standard | Learn | Python | +| 16 | Model Routing as a Cost-Reduction Primitive | Learn | Python | +| 17 | Disaggregated Prefill/Decode β€” NVIDIA Dynamo and llm-d | Learn | Python | +| 18 | vLLM Production Stack with LMCache KV Offloading | Learn | Python | +| 19 | AI Gateways β€” LiteLLM, Portkey, Kong, Bifrost | Learn | Python | +| 20 | Shadow, Canary, and Progressive Deployment | Learn | Python | +| 21 | A/B Testing LLM Features β€” GrowthBook and Statsig | Learn | Python | +| 22 | Load Testing LLM APIs β€” k6, LLMPerf, GenAI-Perf | Build | Python | +| 23 | SRE for AI β€” Multi-Agent Incident Response | Learn | Python | +| 24 | Chaos Engineering for LLM Production | Learn | Python | +| 25 | Security β€” Secrets, PII Scrubbing, Audit Logs | Learn | Python | +| 26 | Compliance β€” SOC 2, HIPAA, GDPR, EU AI Act, ISO 42001 | Learn | Python | +| 27 | FinOps for LLMs β€” Unit Economics and Multi-Tenant Attribution | Learn | Python | +| 28 | Self-Hosted Serving Selection β€” llama.cpp, Ollama, TGI, vLLM, SGLang | Learn | Python | + +
+ +
+Phase 18 β€” Ethics, Safety & Alignment  30 lessons  Build AI that helps humanity. Not optional. +
+ +| # | Lesson | Type | Lang | +|:---:|--------|:----:|------| +| 01 | [Instruction-Following as Alignment Signal](phases/18-ethics-safety-alignment/01-instruction-following-alignment-signal/) | Learn | Python | +| 02 | [Reward Hacking & Goodhart's Law](phases/18-ethics-safety-alignment/02-reward-hacking-goodhart/) | Learn | Python | +| 03 | [Direct Preference Optimization Family](phases/18-ethics-safety-alignment/03-direct-preference-optimization-family/) | Learn | Python | +| 04 | [Sycophancy as RLHF Amplification](phases/18-ethics-safety-alignment/04-sycophancy-rlhf-amplification/) | Learn | Python | +| 05 | [Constitutional AI & RLAIF](phases/18-ethics-safety-alignment/05-constitutional-ai-rlaif/) | Learn | Python | +| 06 | [Mesa-Optimization & Deceptive Alignment](phases/18-ethics-safety-alignment/06-mesa-optimization-deceptive-alignment/) | Learn | Python | +| 07 | [Sleeper Agents β€” Persistent Deception](phases/18-ethics-safety-alignment/07-sleeper-agents-persistent-deception/) | Learn | Python | +| 08 | [In-Context Scheming in Frontier Models](phases/18-ethics-safety-alignment/08-in-context-scheming-frontier-models/) | Learn | Python | +| 09 | [Alignment Faking](phases/18-ethics-safety-alignment/09-alignment-faking/) | Learn | Python | +| 10 | [AI Control β€” Safety Despite Subversion](phases/18-ethics-safety-alignment/10-ai-control-subversion/) | Learn | Python | +| 11 | [Scalable Oversight & Weak-to-Strong](phases/18-ethics-safety-alignment/11-scalable-oversight-weak-to-strong/) | Learn | Python | +| 12 | [Red-Teaming: PAIR & Automated Attacks](phases/18-ethics-safety-alignment/12-red-teaming-pair-automated-attacks/) | Build | Python | +| 13 | [Many-Shot Jailbreaking](phases/18-ethics-safety-alignment/13-many-shot-jailbreaking/) | Learn | Python | +| 14 | [ASCII Art & Visual Jailbreaks](phases/18-ethics-safety-alignment/14-ascii-art-visual-jailbreaks/) | Build | Python | +| 15 | [Indirect Prompt Injection](phases/18-ethics-safety-alignment/15-indirect-prompt-injection/) | Build | Python | +| 16 | [Red-Team Tooling: Garak, Llama Guard, PyRIT](phases/18-ethics-safety-alignment/16-red-team-tooling-garak-llamaguard-pyrit/) | Build | Python | +| 17 | [WMDP & Dual-Use Capability Evaluation](phases/18-ethics-safety-alignment/17-wmdp-dual-use-evaluation/) | Learn | Python | +| 18 | [Frontier Safety Frameworks β€” RSP, PF, FSF](phases/18-ethics-safety-alignment/18-frontier-safety-frameworks-rsp-pf-fsf/) | Learn | β€” | +| 19 | [Model Welfare Research](phases/18-ethics-safety-alignment/19-model-welfare-research/) | Learn | Python | +| 20 | [Bias & Representational Harm](phases/18-ethics-safety-alignment/20-bias-representational-harm/) | Build | Python | +| 21 | [Fairness Criteria: Group, Individual, Counterfactual](phases/18-ethics-safety-alignment/21-fairness-criteria-group-individual-counterfactual/) | Learn | Python | +| 22 | [Differential Privacy for LLMs](phases/18-ethics-safety-alignment/22-differential-privacy-for-llms/) | Build | Python | +| 23 | [Watermarking: SynthID, Stable Signature, C2PA](phases/18-ethics-safety-alignment/23-watermarking-synthid-stable-signature-c2pa/) | Build | Python | +| 24 | [Regulatory Frameworks: EU, US, UK, Korea](phases/18-ethics-safety-alignment/24-regulatory-frameworks-eu-us-uk-korea/) | Learn | β€” | +| 25 | [EchoLeak & CVEs for AI](phases/18-ethics-safety-alignment/25-echoleak-cves-for-ai/) | Learn | Python | +| 26 | [Model, System & Dataset Cards](phases/18-ethics-safety-alignment/26-model-system-dataset-cards/) | Build | Python | +| 27 | [Data Provenance & Training-Data Governance](phases/18-ethics-safety-alignment/27-data-provenance-training-governance/) | Learn | Python | +| 28 | [Alignment Research Ecosystem: MATS, Redwood, Apollo, METR](phases/18-ethics-safety-alignment/28-alignment-research-ecosystem/) | Learn | β€” | +| 29 | [Moderation Systems: OpenAI, Perspective, Llama Guard](phases/18-ethics-safety-alignment/29-moderation-systems-openai-perspective-llamaguard/) | Build | Python | +| 30 | [Dual-Use Risk: Cyber, Bio, Chem, Nuclear](phases/18-ethics-safety-alignment/30-dual-use-risk-cyber-bio-chem-nuclear/) | Learn | β€” | + +
+ +
+Phase 19 β€” Capstone Projects  17 projects  2026 end-to-end shippable products, 20-40 hours each. +
+ +| # | Project | Combines | Lang | +|:---:|---------|----------|------| +| 01 | [Terminal-Native Coding Agent](phases/19-capstone-projects/01-terminal-native-coding-agent/) | P0 P5 P7 P10 P11 P13 P14 P15 P17 P18 | TypeScript, Python | +| 02 | [RAG over Codebase (Cross-Repo Semantic Search)](phases/19-capstone-projects/02-rag-over-codebase/) | P5 P7 P11 P13 P17 | Python, TypeScript | +| 03 | [Real-Time Voice Assistant (ASR β†’ LLM β†’ TTS)](phases/19-capstone-projects/03-realtime-voice-assistant/) | P6 P7 P11 P13 P14 P17 | Python, TypeScript | +| 04 | [Multimodal Document QA (Vision-First)](phases/19-capstone-projects/04-multimodal-document-qa/) | P4 P5 P7 P11 P12 P17 | Python, TypeScript | +| 05 | [Autonomous Research Agent (AI-Scientist Class)](phases/19-capstone-projects/05-autonomous-research-agent/) | P0 P2 P3 P7 P10 P14 P15 P16 P18 | Python | +| 06 | [DevOps Troubleshooting Agent for Kubernetes](phases/19-capstone-projects/06-devops-troubleshooting-agent/) | P11 P13 P14 P15 P17 P18 | Python, TypeScript | +| 07 | [End-to-End Fine-Tuning Pipeline](phases/19-capstone-projects/07-end-to-end-fine-tuning-pipeline/) | P2 P3 P7 P10 P11 P17 P18 | Python | +| 08 | [Production RAG Chatbot (Regulated Vertical)](phases/19-capstone-projects/08-production-rag-chatbot/) | P5 P7 P11 P12 P17 P18 | Python, TypeScript | +| 09 | [Code Migration Agent (Repo-Level Upgrade)](phases/19-capstone-projects/09-code-migration-agent/) | P5 P7 P11 P13 P14 P15 P17 | Python, TypeScript | +| 10 | [Multi-Agent Software Engineering Team](phases/19-capstone-projects/10-multi-agent-software-team/) | P11 P13 P14 P15 P16 P17 | Python, TypeScript | +| 11 | [LLM Observability & Eval Dashboard](phases/19-capstone-projects/11-llm-observability-dashboard/) | P11 P13 P17 P18 | TypeScript, Python | +| 12 | [Video Understanding Pipeline (Scene β†’ QA)](phases/19-capstone-projects/12-video-understanding-pipeline/) | P4 P6 P7 P11 P12 P17 | Python, TypeScript | +| 13 | [MCP Server with Registry and Governance](phases/19-capstone-projects/13-mcp-server-with-registry/) | P11 P13 P14 P17 P18 | Python, TypeScript | +| 14 | [Speculative-Decoding Inference Server](phases/19-capstone-projects/14-speculative-decoding-server/) | P3 P7 P10 P17 | Python | +| 15 | [Constitutional Safety Harness + Red-Team Range](phases/19-capstone-projects/15-constitutional-safety-harness/) | P10 P11 P13 P14 P18 | Python | +| 16 | [GitHub Issue-to-PR Autonomous Agent](phases/19-capstone-projects/16-github-issue-to-pr-agent/) | P11 P13 P14 P15 P17 | Python, TypeScript | +| 17 | [Personal AI Tutor (Adaptive, Multimodal)](phases/19-capstone-projects/17-personal-ai-tutor/) | P5 P6 P11 P12 P14 P17 P18 | Python, TypeScript | + +
--- -
+## The toolkit -## 🀝 Contributing +Every lesson produces a reusable artifact. By the end you have: -
+``` +outputs/ +β”œβ”€β”€ prompts/ prompt templates for every AI task +β”œβ”€β”€ skills/ SKILL.md files for AI coding agents +β”œβ”€β”€ agents/ agent definitions ready to deploy +└── mcp-servers/ MCP servers built during the course +``` -We welcome contributions of all kinds β€” new lessons, translations, fixes, and outputs. +Install them with [SkillKit](https://github.com/rohitg00/skillkit). Plug them into Claude Code, +Cursor, or any MCP-compatible agent. Real tools, not homework. -| πŸ“‹ Want to... | πŸ‘‰ Read | -|--------------|--------| +## Where to start + +| Background | Start at | Estimated time | +|---|---|---| +| New to programming and AI | Phase 0 β€” Setup | ~306 hours | +| Know Python, new to ML | Phase 1 β€” Math Foundations | ~270 hours | +| Know ML, new to deep learning | Phase 3 β€” Deep Learning Core | ~200 hours | +| Know deep learning, want LLMs and agents | Phase 10 β€” LLMs from Scratch | ~100 hours | +| Senior engineer, only want agent engineering | Phase 14 β€” Agent Engineering | ~60 hours | + +## Foundational papers covered + +- *Attention Is All You Need* β€” Vaswani et al., 2017 β†’ Phase 7 +- *Language Models are Few-Shot Learners* (GPT-3) β†’ Phase 10 +- *Denoising Diffusion Probabilistic Models* β†’ Phase 8 +- *InstructGPT / RLHF* β†’ Phase 10 +- *Direct Preference Optimization* β†’ Phase 10 +- *Chain-of-Thought Prompting* β†’ Phase 11 +- *ReAct: Reasoning + Acting in LLMs* β†’ Phase 14 +- *Model Context Protocol* (Anthropic) β†’ Phase 13 + +## Contributing + +| Goal | Read | +|---|---| | Contribute a lesson or fix | [CONTRIBUTING.md](CONTRIBUTING.md) | | Fork for your team or school | [FORKING.md](FORKING.md) | -| See the lesson template | [LESSON_TEMPLATE.md](LESSON_TEMPLATE.md) | +| Lesson template | [LESSON_TEMPLATE.md](LESSON_TEMPLATE.md) | | Track progress | [ROADMAP.md](ROADMAP.md) | +| Glossary | [glossary/terms.md](glossary/terms.md) | | Code of conduct | [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md) | ---- +## License -
+MIT. Use it however you want β€” fork it, teach it, sell it, ship it. Attribution appreciated, not +required. -## ⭐ Star History - -[![Star History Chart](https://api.star-history.com/svg?repos=rohitg00/ai-engineering-from-scratch&type=Date)](https://star-history.com/#rohitg00/ai-engineering-from-scratch&Date) - -### 🌟 If this helped you, please star the repo! It keeps the project alive. - -### πŸ’š Built with care by [Rohit Ghumare](https://github.com/rohitg00) and the community. - -[![Twitter Follow](https://img.shields.io/twitter/follow/ghumare64?style=for-the-badge&logo=x&labelColor=0D1117)](https://x.com/ghumare64) -[![Website](https://img.shields.io/badge/Website-aiengineeringfromscratch.com-D97757?style=for-the-badge&logo=googlechrome&logoColor=white&labelColor=0D1117)](https://aiengineeringfromscratch.com) - -πŸ“œ MIT License β€” Use it however you want. Fork it. Teach it. Sell it. Ship it. - -✨ From linear algebra to autonomous agent swarms β€” one lesson at a time. ✨ - -
+Maintained by [Rohit Ghumare](https://github.com/rohitg00) and the community. diff --git a/ROADMAP.md b/ROADMAP.md index 9ed5049b7..fd364dcc8 100644 --- a/ROADMAP.md +++ b/ROADMAP.md @@ -1,10 +1,12 @@ # Roadmap -Progress tracking for every phase and lesson. +Status tracker for every phase and lesson. The status glyphs in this file feed +the website (`site/build.js` parses them into `site/data.js`); do not change +their shape. -**Total estimated time: ~304 hours (at your own pace)** +Total estimated time: ~304 hours, at your own pace. -**Legend:** βœ… Complete | 🚧 In Progress | ⬚ Planned +**Legend:** βœ… Complete  Β·  🚧 In Progress  Β·  ⬚ Planned ## Phase 0: Setup & Tooling β€” βœ… (~14 hours) diff --git a/assets/banner.svg b/assets/banner.svg index f945f345a..f98fb77e3 100644 --- a/assets/banner.svg +++ b/assets/banner.svg @@ -1,132 +1,104 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + - + + - - - - - - - - - - - + + FIG_000 β€” REFERENCE MANUAL V1.0 + + + Β© 2026 Β· OPEN SOURCE Β· MIT LICENSE - - - - - - - - - - + + AI ENGINEERING + FROM SCRATCH. - - - - - - - - - - + + A reference manual for people who want to design and build AI systems from first principles. + + + 20 PHASES Β· 280+ LESSONS Β· PYTHON Β· TYPESCRIPT Β· RUST Β· JULIA - - - + + + FIG_000.A β€” CURRICULUM STACK + + + + + + AGENTS Β· SWARMS Β· PRODUCTION + + + + + LLMS Β· TRANSFORMERS Β· MULTIMODAL + + + + + VISION Β· SPEECH Β· NLP + + + + + DEEP LEARNING Β· RL + + + + + ML FUNDAMENTALS + + + + + MATH FOUNDATIONS + + + + + SETUP & TOOLING + + + + + + + + + + + + + PHASE 00 + PHASE 01 + PHASE 02 Β· 03 Β· 09 + PHASE 04 Β· 05 Β· 06 + PHASE 07 Β· 08 Β· 12 + PHASE 10 Β· 11 Β· 13 + PHASE 14–19 + - - - - - - - - - - - - - - - - AI Engineering - - - FROM SCRATCH - - - - - - Learn it. Build it. Ship it for others. - - - - - 260+ lessons · 20 phases · 60 complete · Math to Agent Swarms - - - - - - Python - - - TypeScript - - - Rust - - - Julia - - - - - OPEN SOURCE · MIT LICENSE · ROHITG00 - - + diff --git a/site/data.js b/site/data.js index f9861c683..93d2299dd 100644 --- a/site/data.js +++ b/site/data.js @@ -1,12 +1,12 @@ // Auto-generated by build.js β€” do not edit manually. -// Last built: 2026-05-08T11:17:38.687Z +// Last built: 2026-05-09T12:32:56.925Z const PHASES = [ { "id": 0, "name": "Setup & Tooling", "status": "complete", - "desc": "πŸ› οΈ *Get your environment ready for everything that follows.*", + "desc": "Get your environment ready for everything that follows.", "lessons": [ { "name": "Dev Environment",