Google's open-source diffusion language model generates 256 tokens in parallel and self-corrects, hitting 4x speed on one GPU ...
LCLMs compress LLM context before decode — 8.8x faster at 16x compression, beating every KV cache method tested. Open-sourced by NYU and Columbia.
DiffusionGemma hits 1,000 tokens per second by ditching word-by-word generation entirely. It just doesn't run on most ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results