inference optimization | byteiota

Tag: inference optimization

DiffusionGemma neural network visualization showing parallel token generation with blue diffusion waves on dark background

AI & Development

DiffusionGemma: Google’s 4x Faster Text Diffusion Model

Google DeepMind’s DiffusionGemma generates 256 tokens in parallel at 1,000+ tokens/sec. Here’s how it works, ...

1 day ago

Featured image for Flash-Moe Runs 397B Models on Mac with 48GB RAM

AI & Development

Flash-Moe Runs 397B Models on Mac with 48GB RAM

Dan Woods released Flash-Moe in March 2026, a pure C/Metal inference engine that runs Qwen3.5-397B—a ...

March 22, 2026