MirrorCode: What's the largest software project AI can complete on its own? | Epoch AI
- AI has made rapid progress on software engineering benchmarks in the past few years.
- However, most such benchmarks tend to focus on shorter tasks like fixing bugs or implementing individual features.
- MirrorCode is our benchmark, co-developed with METR, to test AI models on long-horizon coding tasks.
Unverified
- AI has made rapid progress on software engineering benchmarks in the past few years.
- However, most such benchmarks tend to focus on shorter tasks like fixing bugs or implementing individual features.
- MirrorCode is our benchmark, co-developed with METR, to test AI models on long-horizon coding tasks.
Sources: Epoch