inference optimization | byteiota

Tag: inference optimization

NVIDIA GPU chip with three generation modes converging into one model checkpoint

Performance

NVIDIA Nemotron-Labs-Diffusion Kills the Draft Model

NVIDIA Nemotron-Labs-Diffusion hits Hugging Face with three generation modes and 6.82 tokens per step in ...

July 10, 2026

DiffusionGemma neural network visualization showing parallel token generation with blue diffusion waves on dark background

AI & Development

DiffusionGemma: Google’s 4x Faster Text Diffusion Model

Google DeepMind’s DiffusionGemma generates 256 tokens in parallel at 1,000+ tokens/sec. Here’s how it works, ...

June 14, 2026

Featured image for Flash-Moe Runs 397B Models on Mac with 48GB RAM

AI & Development

Flash-Moe Runs 397B Models on Mac with 48GB RAM

Dan Woods released Flash-Moe in March 2026, a pure C/Metal inference engine that runs Qwen3.5-397B—a ...

March 22, 2026