ByteDance's "iLLaDA" is a diffusion language model that keeps up with Qwen2.5
Researchers from Renmin University and Bytedance have released iLLaDA, an 8B language model that works differently from ChatGPT. It matches Qwen2. 5 at the base level but falls behind after fine-tuning.
Read on The-decoder ↗