🍥

Mao Song(毛松)'s Homepage

Never stop learning.

Home
Archives
Search
About
Tags
1. Dark Mode

Search

Archives

Categories

LLM LeetCode MLLM Reasoning Infra Machine Learning NLP Terminal Deep Learning RAG 随笔

Tags

MoE Qwen Medium Reasoning Attention DFS Deepseek Matrix Array DP RL String Tree BFS Bit Manipulation Google Hard Distributed Training Easy Kimi

Tags

17 pages

MoE

Mixstral 8x7B

Notes on olmoe

GShard

ST-MoE

Switch Transformer

1 2 3 4

© 2020 - 2025 Mao Song(毛松)'s Homepage

Built with Hugo
Theme Stack designed by Jimmy