Benchmarking Coding Agents on Databricks’ Multi-Million Line Codebase
- At Databricks, the way we build software is changing quickly as we aggressively adopt AI for engineering.
- The landscape of models and harnesses for code authoring has rapidly expanded in the last year, giving developers more choices than ever.
- With more options, it has become increasingly important to understand which coding agents offer the best performance on real-world coding tasks as well as understanding how task-performance varies with price.
Unverified
- At Databricks, the way we build software is changing quickly as we aggressively adopt AI for engineering.
- The landscape of models and harnesses for code authoring has rapidly expanded in the last year, giving developers more choices than ever.
- With more options, it has become increasingly important to understand which coding agents offer the best performance on real-world coding tasks as well as understanding how task-performance varies with price.
Sources: Databricks