44% on ARC-AGI-1 in 67 cents
- I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRMThis is an upgrade to my previous model Faster, better, cheaper and still open source.
- Also gets 7% on ARC-2Discussion on Twitter, Code on github Performance on ARC-1 public eval.
- I only compare against models that do similar test time training This is the 3rd blog in a series of works on ARC-AGI.
Unverified
- I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRMThis is an upgrade to my previous model Faster, better, cheaper and still open source.
- Also gets 7% on ARC-2Discussion on Twitter, Code on github Performance on ARC-1 public eval.
- I only compare against models that do similar test time training This is the 3rd blog in a series of works on ARC-AGI.
Sources: Github