Homepage
Delving into the latent unknown.
Mao Song's technical blog covering machine learning, large language models (LLMs), deep learning research, and AI innovations.
News
- Make this blog framework as a blog template
A blog template for research articles and blog posts.
- Update the blog framework from Hugo to Astro
I update the blog framework from Hugo to Astro. Now the blog is more flexible and easier to maintain.
- Investigating Redundancy in Multimodal Large Language Models with Multiple Vision Encoders
We invalidate the hypothesis that 'adding more vision encoders will always improve the performance of multimodal large language models'. Accetpted by ICLR2026.
Latest
- LLM Overview of DeepSeek series
- LLM MoE tutorial
本 blog 详细介绍了 MoE 模型的一些关键设计与相关实验结果，为 MoE 模型的学习提供基础。
- Infra Overview of Parallelism
- LLM LLM Memory Computation
本文中，我们将介绍如何计算 LLM 在训练和推理过程中的内存需求以及简要介绍对应的优化方法。