System design
Learning paths
Topics
Roadmaps
Games
Search articles, topics...
⌘K
Library
Topics
LLMs
How models work, what they cost, and how to talk to them.
Path
System design
AI engineering
Articles
Level
Foundation
Core
Senior
Staff
Design questions only
Patterns
Admit at the door
Narrow
Scaling
3
Estimation
1
Load balancing
1
Caching
2
Real-time
1
Security
1
Observability
1
Retrieval (RAG)
1
Agents
4
16 pages
Design an LLM inference platform
System design · Staff · 38 min
Scaling
Load balancing
How an LLM works
AI engineering · Foundation · 9 min
Tokens, context and cost
AI engineering · Foundation · 7 min
Estimation
Prompting as an interface
AI engineering · Foundation · 7 min
Structured output and tools
AI engineering · Core · 8 min
Agents
Context engineering and memory
AI engineering · Senior · 8 min
Agents
Guardrails and prompt injection
AI engineering · Senior · 9 min
Security
Latency and cost
AI engineering · Senior · 9 min
Caching
Observability
RAG vs fine-tuning vs long context
Articles · Core · 11 min
Retrieval (RAG)
Fine-tune a model on your PC
Articles · Core · 13 min
KV vs prompt vs semantic cache
Articles · Senior · 11 min
Caching
FP16 vs INT8 vs INT4
Articles · Senior · 11 min
Scaling
Reasoning vs standard models
Articles · Senior · 12 min
Agents
SFT vs RLHF vs DPO
Articles · Senior · 12 min
Dense vs mixture of experts
Articles · Senior · 11 min
Scaling
Voice agents
Articles · Senior · 13 min
Real-time
Agents