FrontierCS: Evolving Challenges for Evolving Intelligence

Published in ICML 2026, 2026

Authors: Qiuyang Mang, Wenhao Chai, …, Zhaozi Wang, …, Alvin Cheung. Full author list.

Venue: Proceedings of the 43rd International Conference on Machine Learning (ICML 2026), PMLR 306:86255–86277.

Links: ProceedingsPaper PDFarXivProjectCode

FrontierCS evaluates language models on challenging computer science tasks whose best solutions are not known in advance. Solutions are submitted as executable programs and assessed by automatic evaluators, allowing progress to be measured beyond binary correctness.