About
School of Intelligence Science and Technology. Peking University.
Peking University
Beijing, China
Yansheng Mao is a Ph.D. student in the School of Intelligence Science and Technology at Peking University, advised by Muhan Zhang in Μμ Lab. He studies large language models, especially training infrastructure.
He received his bachelor’s degree from the School of Electronics Engineering and Computer Science at Peking University in 2026, where he was a member of the Zhi Class, a special class for excellent students majoring in artificial intelligence, and was awarded the Zhi Class scholarship in 2024 and 2025.
Since its founding in 2026, he has also been a member of the founding team of Norizon (无涯智远), an early-stage AI startup in Beijing, where he is responsible for the company’s training infrastructure.
Research Interests
Training Infrastructure
I'm currently exploring the systems side of large model training, focusing on training frameworks such as Megatron-LM and the parallelism strategies (data, tensor, pipeline, and sequence parallelism) that scale training across large GPU clusters. As a planned next step, I aim to go a layer lower and work on high-performance operators and kernels.
Recursive Self-Improvement (RSI)
Models that keep learning after deployment, internalizing verified experience into parameters as reusable capabilities (in-parameter learning), with improved capability in turn accelerating further learning. I'm interested in making this loop near real time — e.g., hypernetworks that generate weight updates in a single forward pass — and in sustaining long-term growth without forgetting or interference.
Latest Posts
| Nov 09, 2024 | Blogs up-coming |
|---|