← back

mostly technical writings

language diffusion pt 1: arithmetic intensity primer

diffusion

Deriving decode arithmetic intensity for GQA attention and MoE layers, where they sit relative to the roofline ridge, and how block diffusion multiplies both by the block size.