🍥

Mao Song(毛松)'s Homepage

Never stop learning.

Home
Archives
Search
About
Tags
1. Dark Mode

Search

Archives

Categories

LLM LeetCode MLLM Reasoning Infra Machine Learning NLP Terminal Deep Learning RAG 随笔

Tags

Medium Qwen Reasoning DFS Attention MoE Matrix Array DP String Tree BFS Bit Manipulation Hard Distributed Training Easy Kimi Optimizer RL Transformer

Tags

8 pages

MoE

Mixstral 8x7B

ST-MoE

GShard

ST-MoE

Switch Transformer

1 2

© 2020 - 2025 Mao Song(毛松)'s Homepage

Built with Hugo
Theme Stack designed by Jimmy