Google's text diffusion experiment

On stage at I/O last week Sundar Pichai called Gemini Diffusion an “experiment.” That is polite understatement. The new model abandons the token-by-token playbook that has defined every large language model since GPT-2 and instead treats language the way Imagen treats pixels: add noise, then learn to remove it. The result? A research prototype that spit…