Homepage
Delving into the latent unknown.
Mao Song's technical blog covering machine learning, large language models (LLMs), deep learning research, and AI innovations.
News
- Make this blog framework as a blog template
A blog template for research articles and blog posts.
- Update the blog framework from Hugo to Astro
I update the blog framework from Hugo to Astro. Now the blog is more flexible and easier to maintain.
- Investigating Redundancy in Multimodal Large Language Models with Multiple Vision Encoders
We invalidate the hypothesis that 'adding more vision encoders will always improve the performance of multimodal large language models'. Accetpted by ICLR2026.
Latest
- Infra GPU vs TPU: A Comprehensive Guide to Specialized Hardware Accelerators
An in-depth exploration of Graphics Processing Units and Tensor Processing Units, comparing their computational capabilities, memory architectures, and applications in machine learning, deep learning, and scientific computing.
- LLM Overview of DeepSeek series
- LLM MoE tutorial
本 blog 详细介绍了 MoE 模型的一些关键设计与相关实验结果，为 MoE 模型的学习提供基础。
- LLM DeepSeek-R1: the first open sourced reasoning models