FrontierCS 2: A Benchmark for Computer Science R&D
Published in arXiv Preprint, 2026
Authors: Qiuyang Mang, Wenhao Chai, Runyuan He, …, Kaiyuan Liu, et al.
Publications
You can also find my articles on my Google Scholar profile.
Manuscripts
EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics
Published in arXiv Preprint, 2026
Authors: Zeyu Shen, Haoxiang You, Yilang Liu, …, Kaiyuan Liu, et al.
AutoCode-RL: Climbing the Difficulty Pyramid with Verifiable Synthetic Problems
Published in Under Review at ICLR 2027, 2026
Authors: Kaiyuan Liu, Zhiming Wang, Zeyu Shen, et al.
When Agents Slow Down: Understanding LLM Agents’ Test-Time Strategies via Elo-per-token Analysis
Published in arXiv Preprint, 2026
Authors: Kaiyuan Liu, Qiuyang Mang, Bo Peng, Wenhao Chai, Hanchen Li, Shreyas Pimpalgaonkar, Luke Zettlemoyer, Alex Dimakis, Alvin Cheung
OpenDeepThink: Parallel Reasoning via Bradley-Terry Aggregation
Published in Under Review at ICLR 2027, 2026
Authors: Shang Zhou, Wenhao Chai, Kaiyuan Liu, Huanzhi Mao, Qiuyang Mang, Jingbo Shang
Conference Papers
Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation
Published in NeurIPS 2026, 2026
Authors: Lin Shi, Haowei Lin, Zixuan Zhu, …, Kaiyuan Liu, et al.
Agents’ Last Exam
Published in NeurIPS 2026, 2026
Authors: Yiyou Sun, Xinyang Han, Weichen Zhang, …, Kaiyuan Liu, …, Dawn Song
FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale
Published in NeurIPS 2026 (Spotlight), 2026
Authors: Runyuan He, Qiuyang Mang, Shang Zhou, Kaiyuan Liu, Hanchen Li, Huanzhi Mao, et al.
FrontierCS: Evolving Challenges for Evolving Intelligence
Published in ICML 2026, 2025
Authors: Qiuyang Mang*, Wenhao Chai*, Zhifei Li*, Huanzhi Mao*, Shang Zhou*, …, Kaiyuan Liu, et al.
AutoCode: LLMs as Problem Setters for Competitive Programming
Published in ICLR 2026, 2025
Authors: Shang Zhou*, Zihan Zheng*, Kaiyuan Liu*, et al.
LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
Published in Neurips 2025, 2025
Authors: Zihan Zheng*, Zerui Cheng*, Zeyu Shen*, Shang Zhou*, Kaiyuan Liu*, et al.
Workshop Papers
Evaluating LLM Agents as Human Simulators in Climate Social Dilemmas
Published in ICLR 2026 MALGAI Workshop (Oral), 2026
Authors: Kaiyuan Liu*, Xiaoxuan Hou*, Carrie Yuan, Natasha Jaques.