SemiAnalysisSilicon
Computation and Data Movement for Inference

Mixture of Experts, now widely used in frontier models, has changed both the structure of serving and the economics of useful inference. It did more than increase parameter count.
Read at SemiAnalysis ↗More from SemiAnalysis on Accept All

SiliconEngrams Embedding Entendre: Codesign for Efficient DRAM/SSD Offloading SemiAnalysis

SiliconEveryone Says Datacenter Moratoriums Are Killing the US Buildout. We disagree SemiAnalysis

SiliconVera Rubin NVL72 Agentic Inference: 67x better Performance per Dollar SemiAnalysis

SiliconA Brain Too Big to Carry — On-Device vs Datacenter Inference SemiAnalysis

SiliconLong Live the Short King: Why 4-hi HBM Wins SemiAnalysis
