Continuous diffusion language models
- A flurry of recent activity in the space of continuous diffusion models for language, after a few years of relative dormancy, suggests that this approach is making something of a comeback.
- Fully discrete diffusion methods had largely supplanted earlier attempts to make continuous diffusion work for language, but the tide is starting to turn.
- In this post, I want to take a closer look at what’s going on, and why it is happening now.
Unverified
- A flurry of recent activity in the space of continuous diffusion models for language, after a few years of relative dormancy, suggests that this approach is making something of a comeback.
- Fully discrete diffusion methods had largely supplanted earlier attempts to make continuous diffusion work for language, but the tide is starting to turn.
- In this post, I want to take a closer look at what’s going on, and why it is happening now.
Sources: Sander