System design
Learning paths
Articles
Topics
Roadmaps
Playground
Search articles, topics...
⌘K
Library
Topics
LLMs
How models work, what they cost, and how to talk to them.
Path
System design
AI engineering
Level
Foundation
Core
Senior
Staff
Design questions only
Narrow
Scaling
1
Estimation
1
Load balancing
1
Caching
1
Security
1
Observability
1
Agents
2
8 pages
Design an LLM inference platform
System design · Staff · 33 min
Scaling
Load balancing
How an LLM works
AI engineering · Foundation · 9 min
Tokens, context and cost
AI engineering · Foundation · 7 min
Estimation
Prompting as an interface
AI engineering · Foundation · 7 min
Structured output and tools
AI engineering · Core · 8 min
Agents
Context engineering and memory
AI engineering · Senior · 8 min
Agents
Guardrails and prompt injection
AI engineering · Senior · 9 min
Security
Latency and cost
AI engineering · Senior · 9 min
Caching
Observability