Hi! This is Nuoya Xiong’s (熊诺亚) personal page. I am a second-year PhD student in CMU, Machine Learning Department, advised by Prof. Aarti Singh. During the 2025 summer, I spent a perfect time at Meta NYC, working with Zhuokai Zhao. Before that, I was an undergraduate student at IIIS(Yao class), Tsinghua University.

In theory, my recent research focuses on the foundations of decision-making, Multi-agent RL and RLHF, with an emphasis on developing theoretically elegant and implementation-friendly algorithms for decision-making. Empirically, I study the post-training and alignment of large language models, focusing on efficient and robust RLHF methods and multi-model collaboration in practical settings. My research goal is to understand the phenomenon of machine learning and provide new, efficient algorithms from a theoretical aspect, serving as a guide for the application of machine learning.

I was immensely fortunate to receive guidance from several kind and inspiring professors. I am deeply thankful to them for their support and mentorship:

• Prof. Aarti Singh
• Prof. Zhuokai Zhao
• Prof. Wei Chen
• Prof. Longbo Huang
• Prof. Zhuoran Yang
• Prof. Zhaoran Wang
• Prof. Simon S. Du

I am also grateful to all my collaborators.

Recent News

• 2025.05 Starting an internship at Meta NYC with mentor Zhuokai Zhao and Yao Zhang!
• 2025.02 My work on multi-objective RLHF is accepted by ICML 2025! https://arxiv.org/pdf/2502.15145
• 2024.09 Start the PhD in CMU!
• 2024.04 One paper was accepted by ICML 2024!
• 2024.01 Two papers were accepted by ICLR 2024! One paper is selected as the spotlight paper.
• 2023.10 I get the Tsinghua Comprehensive Excellence Scholarship.
• 2023.09 I get the “Yao Award” in IIIS, Tsinghua University (top 9) (Bronze Metal).
• 2023.09 One paper was accepted by NeurIPS 2023！
• 2023.02 Arrive the University of Washington to work with Professor Simon S. Du
• 2023.01 One paper was accepted by ICLR 2023!