Tianzhu Ye 叶天竺

About Me

I’m a researcher at Microsoft Research Asia.
My research interests: building more capable and generalizable AI foundation models; self-improving AI with online learning and continual learning.

If you’re interested in a research internship, feel free to reach out via email.
Email: tianzhuye@microsoft.com
Secondary Email: yetianzhu2022@gmail.com

Google Scholar

Blogs

• Differential Transformer V2
  Tianzhu Ye, Li Dong, Yutao Sun, Furu Wei
  Blog | Code

Selected Publications

• Online Experiential Learning for Language Models
  Tianzhu Ye, Li Dong, Qingxiu Dong, Xun Wu, Shaohan Huang, Furu Wei
  Paper | Code

• On-Policy Context Distillation for Language Models
  Tianzhu Ye, Li Dong, Xun Wu, Shaohan Huang, Furu Wei
  Paper | Code

• Black-Box On-Policy Distillation of Large Language Models
  Tianzhu Ye, Li Dong, Zewen Chi, Xun Wu, Shaohan Huang, Furu Wei
  Paper | Code

• Differential Transformer
  Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
  International Conference on Learning Representations (ICLR), 2025 (Oral)
  Paper | Code

Career and Education

• Researcher, Microsoft Research (2026 - )
• Undergrauate student, Tsinghua University (2020 - 2024)

Internship

• Research intern, GenAI at Microsoft Research Asia, mentored by Li Dong (2023 - 2025)
• Research intern, Megvii Technology (2022 - 2023)