Frame selection is the whole game: engineering notes from making LLMs watch video
- A video is not an article about the video Why feed a model a video at all, when a writeup of the same thing costs way fewer tokens?
- Because an article is someone's compression of an event.
- A human watched it, decided what mattered, threw the rest away.
Unverified
- A video is not an article about the video Why feed a model a video at all, when a writeup of the same thing costs way fewer tokens?
- Because an article is someone's compression of an event.
- A human watched it, decided what mattered, threw the rest away.
Sources: Leoaido