🍥

Mao Song(毛松)'s Homepage

Never stop learning.

Home
Archives
Search
About
Tags
1. Dark Mode

Search

Archives

Categories

LLM LeetCode MLLM Reasoning Infra Machine Learning NLP Terminal Deep Learning RAG 随笔

Tags

Medium Qwen Reasoning DFS Attention Matrix Array DP String Tree BFS Bit Manipulation Hard Distributed Training Easy Kimi Optimizer RL Transformer GRPO

Tags

8 pages

Attention

Notes on QK-Norm

Notes on GQA

Notes on MQA

1 2

© 2020 - 2025 Mao Song(毛松)'s Homepage

Built with Hugo
Theme Stack designed by Jimmy