FrontierHarness Eval
- Pass rateMedian cost per successful taskMedian cost per taskMedian cache hit rate per successful taskMedian time per successful taskBeyond the numbers01OpenCode: failures excluded.
- Count failed attempts and the number becomes $3.24 per task.02Cache hit rate is not cost.
- A cached 300-turn failure can still burn more than a short cache miss.03Quality and cost can diverge.
Unverified
- Pass rateMedian cost per successful taskMedian cost per taskMedian cache hit rate per successful taskMedian time per successful taskBeyond the numbers01OpenCode: failures excluded.
- Count failed attempts and the number becomes $3.24 per task.02Cache hit rate is not cost.
- A cached 300-turn failure can still burn more than a short cache miss.03Quality and cost can diverge.
Sources: Frontierharness