Learning Notes & Tutorials
Build the mathematical, algorithmic, and systems foundations for understanding LLMs.
What do these statuses mean?
Status describes reading readiness within the current scope. Ready to Read articles may still receive updates.
Ready to Read A coherent treatment of the current scope, ready for end-to-end reading.
In Progress Substantial content is available; sections, derivations, or validation are still being developed.
Outline An outline, source collection, or early notes.
- Learning Notes Ready to ReadLLM Resource Computation: Parameters, FLOPs and Memory
理解大模型参数量、计算量与显存开销，建立训练资源估算的基础。
- Learning Notes Ready to ReadReinforcement Learning for Large Language Models: An Overview
从强化学习基础到大模型训练，串起价值估计、策略优化与关键推导。
- Learning Notes Ready to ReadHands on LLM (1) Tokenizer
从文本到 token：理解分词方法，以及词表与编码的基本取舍。
- Learning Notes In ProgressHands on LLM(2) Transformer
基于Qwen3讲解transformer的架构以及核心代码
- Learning Notes In ProgressOverview of Parallelism
- Learning Notes In ProgressTheory of scalability
- Learning Notes In ProgressMath Foundations
- Learning Notes In ProgressGPU vs TPU: A Comprehensive Guide to Specialized Hardware Accelerators
An in-depth exploration of Graphics Processing Units and Tensor Processing Units, comparing their computational capabilities, memory architectures, and applications in machine learning, deep learning, and scientific computing.
- Learning Notes OutlineDeep Learning Techniques