Tianzhu Ye 叶天竺

About Me

I’m a first-year PhD student in Department of Automation at Tsinghua University, advised by Gao Huang. I also work as a research intern with Natural Language Computing group at Microsoft Research Asia, mentored by Li Dong. My research focuses on building more capable and generalizable AI foundation models.

Email: ytz24@mails.tsinghua.edu.cn

Google Scholar: GS

Selected Publications

• Differential Transformer
  Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
  International Conference on Learning Representations (ICLR), 2025 (Oral)
  paper | code

• Agent Attention: On the Integration of Softmax and Linear Attention
  Dongchen Han, Tianzhu Ye, Yizeng Han, Zhuofan Xia, Siyuan Pan, Pengfei Wan, Shiji Song, Gao Huang
  European Conference on Computer Vision (ECCV), 2024
  paper | code

• Slide-Transformer: Hierarchical Vision Transformer with Local Self-Attention
  Xuran Pan, Tianzhu Ye, Zhuofan Xia, Shiji Song, Gao Huang
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
  paper | code

Education

• Ph.D. student, Tsinghua University (2024 - )
• Undergrauate student, Tsinghua University (2020 - 2024)

Internship

• Research intern, Natural Language Computing group at Microsoft Research Asia, mentored by Li Dong (2023 - )
• Research intern, Megvii Technology (2022 - 2023)