A long-horizon software-engineering benchmark in which models reimplement real programs from specifications without internet access and are evaluated on hidden held-out tests.

Recent stories
1 linked story
A long-horizon software-engineering benchmark in which models reimplement real programs from specifications without internet access and are evaluated on hidden held-out tests.
