Skip to main content
Avatar

Mao Song(毛松)'s Homepage

Delving into the Latent Unknown.

  1. Bilibili
  2. Google Scholar
  1. Home
  2. Archives
  3. Search
  4. Tags
  5. About
    1. Dark Mode

Categories

LLM LeetCode MLLM Infra Tutorial Machine Learning Reasoning Math NLP Terminal Deep Learning RAG RL Unified MLLM 随笔

Tags

MoE Qwen Medium Attention Reasoning Google Deepseek DFS Position Encoding Matrix Array DP RL String Transformer Tree BFS Bit Manipulation Hard Distributed Training

Archives

2026 12
2025 102
2024 51
2023 1
LLM

Unified perspective on dLLM and LLM

MLE和KL divergence之间的等价性推导
June 28, 2025
1 min read
diffusion
Machine Learning

Relationship between MLE and KL divergence

MLE和KL divergence之间的等价性推导
June 27, 2025
2 min read
MLE KL divergence
MLLM   Reasoning

Notes on MiMo-VL

MiMo-VL基于MiMo-7B,是一个多模态推理大语言模型
June 5, 2025
3 min read
xiaomi
LLM

Hands on LLM(1) Tokenizer

Tokenizer总结与BPE的高效实现
May 24, 2025
12 min read
transformer
LLM

Notes on attention bias

为什么transformer没有QKV bias
May 22, 2025
6 min read
transformer
1 … 17 18 19 … 34
© 2020 - 2026 Mao Song(毛松)'s Homepage
Built with Hugo
Theme Stack designed by Jimmy