/

SemiAnalysis

10 stories

xAI’s Colossus 2 – First Gigawatt Datacenter In The World, Unique RL Methodology, Capital Raise

SemiAnalysisSiliconxAI’s Colossus 2 – First Gigawatt Datacenter In The World, Unique RL Methodology, Capital Raise Much has been written about xAI’s Colossus 1. The Memphis build belongs in the history books: the largest AI training cluster, erected from scratch in 122 days. With roughly 200,000 H100/H200s and ~30,000 GB200 NVL72, it

September 16
Another Giant Leap: The Rubin CPX Specialized Accelerator & Rack

SemiAnalysisSiliconAnother Giant Leap: The Rubin CPX Specialized Accelerator & Rack Nvidia announced the Rubin CPX, a solution that is specifically designed to be optimized for the prefill phase, with the single-die Rubin CPX heavily emphasizing compute FLOPS over memory bandwidth. This is a game change

September 10
Huawei Ascend Production Ramp: Die Banks, TSMC Continued Production, HBM is The Bottleneck

SemiAnalysisSiliconHuawei Ascend Production Ramp: Die Banks, TSMC Continued Production, HBM is The Bottleneck Compute is the lifeblood of AI. He who controls the spice controls the universe the compute will control the production of tokens and reap the benefits of AI. Without compute you do not have a seat at the table. The Unit

September 8
Amazon’s AI Resurgence: AWS & Anthropic’s Multi-Gigawatt Trainium Expansion

SemiAnalysisSiliconAmazon’s AI Resurgence: AWS & Anthropic’s Multi-Gigawatt Trainium Expansion Two-and-a-half years ago, we flagged a looming “cloud crisis” at AWS. Today, the evidence has mounted. AWS is the crown jewel of the Amazon empire, generating ~60% of group profits, and dominating the lucrative Cloud Com

September 3
H100 vs GB200 NVL72 Training Benchmarks – Power, TCO, and Reliability Analysis, Software Improvement Over Time

SemiAnalysisSiliconH100 vs GB200 NVL72 Training Benchmarks – Power, TCO, and Reliability Analysis, Software Improvement Over Time Frontier model training has pushed GPUs and AI systems to their absolute limits, making cost, efficiency, power, performance per TCO, and reliability central to the discussion on effective training. The Hopper vs Blackwe

August 20
GPT-5 Set the Stage for Ad Monetization and the SuperApp

SemiAnalysisSiliconGPT-5 Set the Stage for Ad Monetization and the SuperApp To many power users (Pro and Plus), GPT5 was a disappointing release. But with closer inspection, the real release is focused on the vast majority of ChatGPT’s users, which is the 700m+ free userbase that is growing rapi

August 13
Scaling the Memory Wall: The Rise and Roadmap of HBM

SemiAnalysisSiliconScaling the Memory Wall: The Rise and Roadmap of HBM The first portion of this report will explain HBM, the manufacturing process, dynamics between vendors, KVCache offload, disaggregated prefill decode, and wide / high-rank EP. The rest of the report will dive deeply into

August 12
Robotics Levels of Autonomy

SemiAnalysisSiliconRobotics Levels of Autonomy Robots have powered manufacturing for decades, yet they stayed single-purpose and thrived only in perfect settings. Previous attempts at intelligent machines overpromised and underdelivered. But they were too early. Toda

July 30
Intel 18A Details & Cost, Future of DRAM 4F2 vs 3D, Backside Power Adoption (or Not), China’s FlipFET, Digital Twins from Atoms to Fabs, and More

SemiAnalysisSiliconIntel 18A Details & Cost, Future of DRAM 4F2 vs 3D, Backside Power Adoption (or Not), China’s FlipFET, Digital Twins from Atoms to Fabs, and More Long time readers will recall that SemiAnalysis covers more than just datacenters and AMD. Today we’re back to semiconductors with a tech-focused roundup of the best from this year’s VLSI conference, the premiere design

July 21
Meta Superintelligence – Leadership Compute, Talent, and Data

SemiAnalysisSiliconMeta Superintelligence – Leadership Compute, Talent, and Data Meta’s shocking purchase of 49% of Scale AI at a ~$30B valuation shows that money is of no concern for the $100B annual cashflow ad machine. Despite seemingly unlimited resources, Meta has been falling behind foundation

July 11