Chenyu Zheng (郑晨宇)   Ph.D. Student Gaoling School of Artificial Intelligence Renmin University of China Email: chenyu.zheng666[at]gmail[dot]com Links: [Google Scholar] [Github] [知乎] [CV]

About me

I am a second-year Ph.D. student in the GSAI-ML Group, Renmin University of China, advised by Prof. Chongxuan Li fortunately. Before that, I received my B.E. degree from the School of Computer Science, Wuhan University in 2023.

Research interests

My primary interest is machine learning (theory). Recently, I focus on the optimization and scalability in deep learning.

Selected Papers

[* indicates the equal contribution, # indicates the corresponding author]

Optimization and Scalability (2023~)

• Scaling Diffusion Transformers Efficiently via μP
  Chenyu Zheng, Xinyu Zhang, Rongzhen Wang, Wei Huang, Zhi Tian, Weilin Huang, Jun Zhu, Chongxuan Li
  Preprint, 2025
  [Paper] [Code] [机器之心]
• On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability
  Chenyu Zheng, Wei Huang, Rongzhen Wang, Guoqiang Wu, Jun Zhu, Chongxuan Li
  Advances in Neural Information Processing Systems (NeurIPS), 2024
  [Paper] [Code]
• Lower Bounds of Uniform Stability in Gradient-Based Bilevel Algorithms for Hyperparameter Optimization
  Rongzhen Wang, Chenyu Zheng, Guoqiang Wu, Xu Min, Xiaolu Zhang, Jun Zhou, Chongxuan Li
  Advances in Neural Information Processing Systems (NeurIPS), 2024
  [Paper]

Machine Learning Theory (2022~)

• A Theory for Conditional Generative Modeling on Multiple Data Sources
  Rongzhen Wang, Yan Zhang, Chenyu Zheng, Chongxuan Li, Guoqiang Wu
  International Conference on Machine Learning (ICML), 2025
  [Paper]
• Toward Understanding Generative Data Augmentation
  Chenyu Zheng, Guoqiang Wu, Chongxuan Li
  Advances in Neural Information Processing Systems (NeurIPS), 2023
  [Paper] [Code] [Slides] [Blog] [Poster]
• Revisiting Discriminative vs. Generative Classifiers: Theory and Implications
  Chenyu Zheng, Guoqiang Wu, Fan Bao, Yue Cao, Chongxuan Li, Jun Zhu
  International Conference on Machine Learning (ICML), 2023
  [Paper] [Code] [Slides] [Blog] [Poster]

Remote Sensing (2021~2022)

• Domain Adaptive Land-Cover Classification via Local Consistency and Global Diversity
  Ailong Ma, Chenyu Zheng#, Junjue Wang, Yanfei Zhong
  IEEE Transactions on Geoscience and Remote Sensing (TGRS), 2023
  [Paper] [Code]

Experience

• Research Intern, ByteDance Seed, Beijing, China (2024.11 - Present)
  Mentors: Dr. Zhi Tian and Dr. Weilin Huang

• Research Intern, RSIDEA Group, LIESMARS, Wuhan, China (2021.01 - 2022.08)
  Advisors: Ph.D. candidate Junjue Wang (now researcher@UoT) and Prof. Ailong Ma

Selected Honors

• Outstanding Innovative Talents Cultivation Funded Programs, Renmin Univertity of China, 2025
• Outstanding Graduate & Bachelor Thesis Award, Wuhan University, 2023
• Finalist, International Mathematical Contest in Modeling (MCM), 2022
• China National Scholarship, Ministry of Education of China, 2020

Academic Services

Journal Reviewer

• IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
• IEEE Transactions on Signal Processing (TSP)

Conference Reviewer

• Advances in Neural Information Processing Systems (NeurIPS): 2024, 2025
• International Conference on Machine Learning (ICML): 2025
• International Conference on Learning Representations (ICLR): 2025
• International Conference on Artificial Intelligence and Statistics (AISTATS): 2025

Tutorials/Talks

• Tutorial: A Brief Review of In-Context Learning Theory, 2024.05 [Slides]
• Tutorial: Classical Machine Learning Theory, 2023.06 [Slides]

Miscellaneous

• Platform Sutra and meditation teach me a lot. [Platform Sutra viedo] [meditation viedo]