Publications
* indicates equal contribution
Dynamic Low-rank Estimation for Transformer-based Language Models
Ting Hua*, Xiao Li*, Shangqian Gao, Yen-Chang Hsu, Yilin Shen, Hongxia Jin. The 2023 Conference on Empirical Methods in Natural Language Processing. EMNLP 2023 Findings.
Understanding Deep Representation Learning via Layerwise Feature Compression and Discrimination
Peng Wang*, Xiao Li*, Can Yaras, Zhihui Zhu, Laura Balzano, Wei Hu, Qing Qu. Preprint 2023.
Neural Collapse in Multi-label Learning with Pick-all-label Loss
Pengyu Li*, Yutong Wang*, Xiao Li, Qing Qu. Preprint 2023.
Investigating the Catastrophic Forgetting in Multimodal Large Language Models
Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, Yi Ma. Preprint 2023.
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse
Xiao Li*, Sheng Liu*, Jinxin Zhou, Xinyu Lu, Carlos Fernandez-Granda, Zhihui Zhu, Qing Qu. Preprint 2023.
Are All Losses Created Equal: A Neural Collapse Perspective
Jinxin Zhou, Chong You, Xiao Li, Kangning Liu, Sheng Liu, Qing Qu, Zhihui Zhu. The 35th Conference on Neural Information Processing Systems. NeurIPS 2022.
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features
Jinxin Zhou*, Xiao Li*, Tianyu Ding, Chong You, Qing Qu, Zhihui Zhu. The 39th International Conference on Machine Learning. ICML 2022.
Deep-SMOLM: deep learning resolves the 3D orientations and 2D positions of overlapping single molecules with optimal nanoscale resolution
Tingting Wu, Peng Lu, Md Ashequr Rahman, Xiao Li, Matthew D Lew. Optics Express 30 (20), 36761-36773. Optics Expres 2022.
A Geometric Analysis of Neural Collapse with Unconstrained Features
Zhihui Zhu*, Tianyu Ding*, Jinxin Zhou, Xiao Li, Chong You, Jeremias Sulam, Qing Qu. The 35th Conference on Neural Information Processing Systems. NeurIPS 2021.
Convolutional normalization: Improving deep convolutional network robustness and training
Sheng Liu*, Xiao Li*, Yuexiang Zhai, Chong You, Zhihui Zhu, Carlos Fernandez-Granda, Qing Qu. The 35th Conference on Neural Information Processing Systems. NeurIPS 2021.