Curated Resources
Every resource hand-picked, explained, and contextualized. Quality over quantity, always.
Attention Is All You Need
arXiv / NeurIPS 2017 • Vaswani et al. (Google Brain)3-4 hours
The foundational paper introducing the Transformer architecture that powers GPT, BERT, and virtually all modern LLMs.
Our take: This 2017 paper revolutionized AI. Understanding the attention mechanism is essential for understanding modern language models. Read it multiple times.
Prompt Engineering Guide
OpenAI • OpenAI Team2 hours
Official guide on prompt engineering and getting the best results from GPT models. Covers strategies, tactics, and best practices.
Our take: Essential reading for anyone working with LLMs. These are the techniques that professionals use to get reliable, high-quality outputs from language models.
Language Models are Few-Shot Learners (GPT-3)
arXiv / NeurIPS 2020 • Brown et al. (OpenAI)4-5 hours
The GPT-3 paper demonstrating that large language models can perform tasks with minimal examples. Introduced the era of few-shot learning.
Our take: This paper kicked off the LLM revolution. Understanding scaling laws and in-context learning is essential for understanding modern AI capabilities.
The Illustrated Transformer
Jay Alammar's Blog • Jay Alammar1 hour
Visual, step-by-step explanation of the Transformer architecture. The clearest explanation of attention mechanisms available online.
Our take: Before reading the original paper, read this. Jay Alammar's visualizations make the Transformer architecture genuinely understandable.
Natural Language Processing with Deep Learning (CS224N)
Stanford University • Prof. Christopher Manning10 weeks
Stanford's flagship NLP course covering word vectors, transformers, pretraining, and large language models. Includes assignments in PyTorch.
Our take: The gold standard for NLP education. Prof. Manning is a co-inventor of key NLP techniques. Free lecture videos, slides, and assignments available online.
OpenAI Academy
OpenAI • OpenAI TeamSelf-paced
Official learning platform from OpenAI covering prompting techniques, API usage, fine-tuning, and building with GPT models. From beginner to advanced.
Our take: Learn directly from the creators of ChatGPT and GPT-4. The most authoritative resource for understanding and building with OpenAI's technology stack.
NLP Course
Hugging Face • Hugging Face TeamSelf-paced
Comprehensive course on using Transformers for NLP tasks. Learn to fine-tune models, build applications, and use the Hugging Face ecosystem.
Our take: Hugging Face is the GitHub of ML models. This course teaches you to use their ecosystem effectively, which is essential knowledge for working with LLMs in production.
BERT: Pre-training of Deep Bidirectional Transformers
arXiv / NAACL 2019 • Devlin et al. (Google AI)2-3 hours
The paper that introduced BERT, revolutionizing NLP by showing how bidirectional pre-training dramatically improves language understanding.
Our take: BERT changed how we approach NLP. Understanding masked language modeling and fine-tuning is crucial for modern NLP work.
LLaMA: Open and Efficient Foundation Language Models
arXiv • Touvron et al. (Meta AI)2-3 hours
Meta's open-source LLM that matches GPT-3 performance with fewer parameters. The paper that democratized large language model research.
Our take: LLaMA opened up LLM research to the broader community. Understanding efficient training and model architecture choices is increasingly important.
Scaling Laws for Neural Language Models
arXiv • Kaplan et al. (OpenAI)2-3 hours
The paper that revealed predictable scaling laws for language models. Shows how performance improves with model size, data, and compute.
Our take: Understanding scaling laws is crucial for understanding why bigger models keep getting better, and the economics of AI development.
Generative AI Learning Path
Google Cloud • Google Cloud Training8 hours
Comprehensive learning path covering generative AI fundamentals, large language models, responsible AI, and practical applications with Google's AI tools.
Our take: Google's structured approach to GenAI education. Includes hands-on labs and quizzes. Earn skill badges to validate your knowledge.
Hugging Face NLP Course
Hugging Face • Hugging Face Team20 hours
Free, practical course on NLP using the Transformers library. Covers tokenization, fine-tuning pretrained models, and building NLP applications.
Our take: Hugging Face is the de facto standard for sharing and using pretrained models. This course teaches you to use their ecosystem which powers most modern NLP work.
* Affiliate Disclosure: Some links may earn us a commission at no extra cost to you. We only recommend resources we genuinely believe in.
Sponsored
Recommended Books
Hand-picked books from industry experts. Only the best resources that we genuinely recommend.
Affiliate Disclosure: Some links may earn us a commission at no extra cost to you.
Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow
The most practical guide to ML. Covers everything from linear regression to deep neural networks with hands-on code examples.
Industry standard for practical ML. Used by Google engineers and top bootcamps.
Topics covered:
Deep Learning
The definitive textbook on deep learning. Comprehensive coverage of mathematical foundations and modern techniques.
Written by pioneers of the field. The "bible" of deep learning used in top universities.
Topics covered:
Pattern Recognition and Machine Learning
Rigorous mathematical treatment of ML algorithms. Essential for understanding the theory behind modern methods.
Gold standard for ML theory. Required reading at Cambridge, Stanford, and MIT.
Topics covered:
Artificial Intelligence: A Modern Approach
The most comprehensive AI textbook covering search, planning, reasoning, learning, and perception.
Used in 1,500+ universities worldwide. Written by Google Director of Research.
Topics covered:
Speech and Language Processing
Comprehensive introduction to NLP and computational linguistics. Covers classical and neural approaches.
Stanford standard NLP textbook. Authors are leading researchers in the field.
Topics covered:
Natural Language Processing with Transformers
Practical guide to using Hugging Face Transformers for NLP tasks. From text classification to question answering.
Written by Hugging Face engineers. The go-to guide for modern NLP with transformers.
Topics covered:
Machine Learning Design Patterns
Solutions to common challenges in ML systems. Covers data representation, problem framing, and production deployment.
Written by Google Cloud AI engineers. Bridges the gap between ML theory and production.
Topics covered:
Building Machine Learning Pipelines
Automate model life cycles with TensorFlow Extended (TFX). From data validation to serving.
Essential for MLOps and deploying ML models at scale. Used by production ML teams.
Topics covered:
Probabilistic Robotics
The standard textbook for robot perception and navigation. Covers localization, mapping, and SLAM.
Written by the founder of Google X and Waymo. Essential for autonomous systems.
Topics covered:
Modern Robotics: Mechanics, Planning, and Control
Modern approach to robot kinematics, dynamics, and control with accompanying video lectures.
Accompanies popular Coursera specialization. Clear explanations with practical focus.
Topics covered:
Robotics, Vision and Control
Practical introduction to robotics with MATLAB examples. Covers vision, arms, and mobile robots.
Excellent for hands-on learners. Comes with MATLAB Robotics Toolbox.
Topics covered:
Python Machine Learning
Practical introduction to ML with Python. Great for beginners transitioning from programming to ML.
Best selling ML book for Python developers. Excellent code examples.
Topics covered:
Fluent Python
Master Python's most powerful features. Essential for writing clean, efficient ML code.
Best Python book for intermediate developers. Makes you a better Python programmer.
Topics covered:
Reinforcement Learning: An Introduction
The definitive introduction to reinforcement learning. Covers theory and algorithms comprehensively.
Written by the pioneers of RL. Free PDF available but physical copy recommended for study.
Topics covered:
Deep Learning for Computer Vision
Practical guide to CNN architectures for image classification, detection, and segmentation.
Hands-on approach to computer vision with deep learning. Great code examples.
Topics covered:
Programming Computer Vision with Python
Hands-on introduction to computer vision using Python. From basics to 3D reconstruction.
Classic introduction to CV with Python. Great for building foundations.
Topics covered:
Mathematics for Machine Learning
Essential mathematics for understanding ML algorithms. Linear algebra, calculus, and probability.
Free PDF available. Perfect bridge from math basics to ML. Written by Imperial College professors.
Topics covered:
Generative Deep Learning
Comprehensive guide to generative models including VAEs, GANs, Transformers, and Diffusion models.
Most up-to-date book on generative AI. Covers latest architectures including GPT and Stable Diffusion.
Topics covered:
Building LLM Apps
Practical guide to building applications with large language models using LangChain and OpenAI APIs.
Perfect for developers wanting to build with GPT-4, Claude, and other LLMs.
Topics covered:
Build a Large Language Model (From Scratch)
Step-by-step guide to building a GPT-like LLM from the ground up. Covers tokenization, attention mechanisms, pretraining, and fine-tuning with clear code.
The only book that walks you through building an LLM from absolute scratch. Transforms your understanding of how ChatGPT-style models actually work.
Topics covered:
Designing Machine Learning Systems
An iterative process for designing production ML systems. Covers data engineering, model development, deployment, monitoring, and responsible AI.
Written by a Stanford lecturer and industry veteran. The bridge between academic ML and real-world production systems that most courses skip.
Topics covered:
AI for Robotics: Toward Embodied Intelligence
Approaches robotics from a deep learning perspective. Covers embodied AI, perception, manipulation, navigation, and human-robot interaction.
One of the first books to bridge modern deep learning with practical robotics. Essential reading for anyone at the intersection of AI and physical systems.
Topics covered: