Energy-Based Reasoners: Your Recurrent Reasoner Should Be an Energy-Based Model
- 1Duke University2UIUC3Harvard University arXiv Code TL;DR – We introduce Energy-Based Reasoners (EBRs), reasoning models that learn an energy function over latent reasoning states and formulate looped updates as gradient descent on this energy.
- Its value scores candidate predictions without requiring an external verifier, while its gradient guides refinement and provides a natural signal for stopping.
- With only 1.8M parameters, EBRs achieve 99.9% accuracy on Sudoku-Extreme while using 345× less inference compute than the next-best model.
Unverified
- 1Duke University2UIUC3Harvard University arXiv Code TL;DR – We introduce Energy-Based Reasoners (EBRs), reasoning models that learn an energy function over latent reasoning states and formulate looped updates as gradient descent on this energy.
- Its value scores candidate predictions without requiring an external verifier, while its gradient guides refinement and provides a natural signal for stopping.
- With only 1.8M parameters, EBRs achieve 99.9% accuracy on Sudoku-Extreme while using 345× less inference compute than the next-best model.
Sources: Github