A Jev-like wrapper for LLMs, including vision models
- I was intrigued by Jev and the self-hostable projects appearing around it, such as OpenJev and SemIf.
- Reading about them introduced me to a neat trick: reading an LLM's token probabilities.
- Apparently this is an old trick for some people.
Unverified
- I was intrigued by Jev and the self-hostable projects appearing around it, such as OpenJev and SemIf.
- Reading about them introduced me to a neat trick: reading an LLM's token probabilities.
- Apparently this is an old trick for some people.
Sources: Blogspot