About me

Hi! I'm a second-year Ph.D. student at the Electrical and Computer Engineering Department of Carnegie Mellon University. I am fortunate to be advised by Prof. Yuejie Chi. Previously I spent one year at Peking University for a data science master’s program. Before that, I received my B.S. in Mathematics (Honors Program) from Xi'an Jiaotong University. Here is my CV.

Research Interests

I have eclectic interests in machine learning, deep learning, reinforcement learning, optimization and game theory. Specifically, I am interested in developing sample and computationally efficient algorithms for some fundamental machine learning problems.

Publications

• Faster WIND: Accelerating Iterative Best-of-N Distillation for LLM Alignment
  Preprint, 2024
  Tong Yang, Jincheng Mei, Hanjun Dai, Zixin Wen, Shicong Cen, Dale Schuurmans, Yuejie Chi, Bo Dai
  [PDF] [BibTex] @misc{yang2024fasterwindacceleratingiterative, title={Faster WIND: Accelerating Iterative Best-of-$N$ Distillation for LLM Alignment}, author={Tong Yang and Jincheng Mei and Hanjun Dai and Zixin Wen and Shicong Cen and Dale Schuurmans and Yuejie Chi and Bo Dai}, year={2024}, eprint={2410.20727}, archivePrefix={arXiv}, primaryClass={cs.LG}, url={https://arxiv.org/abs/2410.20727}, }

• In-Context Learning with Representations: Contextual Generalization of Trained Transformers
  NeurIPS 2024
  Tong Yang, Yu Huang, Yingbin Liang, Yuejie Chi
  [PDF] [BibTex] @article{yang2024context, title={In-context learning with representations: Contextual generalization of trained transformers}, author={Yang, Tong and Huang, Yu and Liang, Yingbin and Chi, Yuejie}, journal={arXiv preprint arXiv:2408.10147}, year={2024} }

• Federated Natural Policy Gradient and Actor Critic Methods for Multi-task Reinforcement Learning
  NeurIPS 2024
  Tong Yang, Shicong Cen, Yuting Wei, Yuxin Chen, Yuejie Chi
  [PDF] [BibTex] @article{yang2023federated, title={Federated natural policy gradient methods for multi-task reinforcement learning}, author={Yang, Tong and Cen, Shicong and Wei, Yuting and Chen, Yuxin and Chi, Yuejie}, journal={arXiv preprint arXiv:2311.00201}, year={2023} }

• A Primal-Dual Approach to Solving Variational Inequalities with General Constraints
  ICLR 2024
  Tatjana Chavdarova*, Tong Yang*, Matteo Pagliardini, Michael I. Jordan (*equal contribution, order is alphabetical.)
  [PDF] [Poster (OPT@NeurIPS '22)] [BibTex] @article{chavdarova2022acvi, title = {Revisiting the ACVI Method for Constrained Variational Inequalities}, author = {Chavdarova, Tatjana and Pagliardini, Matteo and Yang, Tong and Jordan, Michael I.}, journal= {ArXiv:2210.15659}, year = {2022}, }

• Solving Constrained Variational Inequalities via an Interior Point Method
  ICLR 2023 Spotlight!
  Tong Yang*, Michael I. Jrodan*, Tatjana Chavdarova* (*equal contribution)
  [PDF] [Poster (WiML@ICML '22)] [Code] [BibTex] @article{yang2022acvi, title = {Solving Constrained Variational Inequalities via an Interior Point Method}, author = {Tong Yang and Michael I. Jordan and Tatjana Chavdarova}, journal = {ArXiv:2206.10575}, year = {2022}, }

• Optimization for Amortized Inverse Problems
  ICML 2023
  Tianci Liu*, Tong Yang*, Quan Zhang, Qi Lei (*equal contribution)
  [PDF] [BibTex] @inproceedings{liu2023optimization, title={Optimization for amortized inverse problems}, author={Liu, Tianci and Yang, Tong and Zhang, Quan and Lei, Qi}, booktitle={International Conference on Machine Learning}, pages={22289--22319}, year={2023}, organization={PMLR} }

• Value-Incentivized Preference Optimization: A Unified Approach to Online and Offline RLHF
  Preprint, 2024
  Shicong Cen, Jincheng Mei, Katayoon Goshvadi, Hanjun Dai, Tong Yang, Sherry Yang, Dale Schuurmans, Yuejie Chi, Bo Dai
  [PDF] [BibTex] @misc{cen2024valueincentivized, title={Value-Incentivized Preference Optimization: A Unified Approach to Online and Offline RLHF}, author={Shicong Cen and Jincheng Mei and Katayoon Goshvadi and Hanjun Dai and Tong Yang and Sherry Yang and Dale Schuurmans and Yuejie Chi and Bo Dai}, year={2024}, eprint={2405.19320}, archivePrefix={arXiv}, primaryClass={cs.LG} }