Hi, I’m Hengyuan!

Hengyuan Xu Hi! I’m Hengyuan Xu, and this site is a documentation of myself. Contact me by email: doby-xu@outlook.com

⚠️
Notification: This site is currently under permanent construction, just as the person behind it.
ℹ️
News: My first paper has been accepted by CVPR 2024! If you ever wondered what exactly is permutation equivariance of Transformer, check it out!

About me

I am a Master’s student in FVL at the School of Computer Science, Fudan University, advised by Xingjun Ma. I received my bachelor degree from SEIEE in Shanghai Jiao Tong University and I was a research intern at John Hopcroft Center for Computer Science, advised by Liyao Xiang. Here is my sincere gratitude to my mentors and collaborators.

I am still exploring potential research directions I am interested in. My previous research explores the mathematical properties of Transformers and their potential applications in privacy-preserving deep learning and model intellectual property protections.

Publications

  • Hengyuan Xu, Liyao Xiang, Xingjun Ma, Borui Yang, Baochun Li. “Hufu: A Modality-Agnostic Watermarking System for Pre-Trained Transformers via Permutation Equivariance” arXiv preprint arXiv:2403.05842

  • Hengyuan Xu, Liyao Xiang, Hangyu Ye, Dixi Yao, Pengzhi Chu, Baochun Li. “Permutation Equivariance of Transformers and Its Applications” in Proceedings of The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR)

    My Work Accepted by CVPR'24My Work Accepted by CVPR'24
    Permutation Equivariance of Transformer

  • Dixi Yao, Liyao Xiang, Hengyuan Xu, Hangyu Ye, Yingqi Chen. “Privacy-Preserving Split Learning via Patch Shuffling over Transformers” in Proceedings of the 22nd IEEE International Conference on Data Mining (ICDM)