SemiAnalysis
SemiAnalysis analysis across multiple production benchmarks demonstrates that 4-hi HBM stacks deliver equivalent bandwidth at 12-26% lower system TCO than 8-hi or 12-hi alternatives, with only marginal throughput sacrifices that don't justify the cost premium. Real InferenceX benchmarks on Kimi K3 show that restricting HBM by 36-44% for KVCache storage maintained throughput until concurrency exceeded 70 users, at which point DRAM offloading techniques mitigated capacity pressure—validating that secondary memory tiers can absorb KVCache without proportional performance loss. This architectural shift reflects both HBM supply constraints and the industry's transition from capacity-constrained to bandwidth-constrained inference paradigms as compute allocation tilts toward post-training and inference workloads, with rack-scale systems now providing 18x more aggregate memory than prior generations, making taller stacks economically unjustifiable.
Fortune via Techmeme
Anthropic has signed $517 billion in compute capacity agreements over the past 11 months—nearly tripling its December 2025 announcement of $180 billion in server rental commitments—securing 14.8GW of capacity across Google, AWS, and multiple infrastructure providers, while confidentially filing for an IPO with the SEC in June and signaling to investors it will achieve profitability for a second consecutive quarter with 80%+ gross margins. In contrast, OpenAI CEO Sam Altman confirmed the company will not pursue a 2026 IPO, stating "given everything happening with safety, right now would be an ill-advised moment to go public," citing the need to address AI safety and alignment concerns before entering public markets. The divergent capital strategies underscore different risk postures among frontier labs: Anthropic's aggressive infrastructure buildout and public market preparation versus OpenAI's deliberate delay despite potential $1 trillion valuation.
Huxiu via ChinAI Newsletter
ByteDance's Seedance 2.0/2.5 video generation models produced all visuals for "The Later Journey to the West," which premiered on mainstream Chinese satellite TV in August, completing the project in six months versus the traditional 1-2 years for live-action dramas. Per-episode production budgets averaged 900,000 RMB with compute accounting for roughly 25% of costs, demonstrating feasibility of AI-generated longform content at commercial scale, though technical limitations persist around facial expressions, complex movements, and sequence consistency.