Today's News
Bloomberg via Techmeme
Nvidia has notified major customers—including Microsoft, Google, and Oracle—of price increases exceeding 15% on servers with its flagship Blackwell and Vera Rubin chips, effective early 2027. The hikes reflect surging DRAM costs from Samsung, SK Hynix, and Micron, signaling that even Nvidia's 75% gross margins face pressure from memory supply constraints. Despite competitive threats from custom silicon and Chinese alternatives, the price increases suggest confidence in sustained demand.
In parallel, a new framework called Hawkeye demonstrates how AI coding agents can optimize GPU kernels for emerging hardware. By grounding agents in a minimal taxonomy of 10 unit tests per architecture (covering optimization strategies like vectorized memory loading and tensor core utilization), Hawkeye enables agents to generate kernels that match or exceed expert-written Triton implementations—achieving 18.9× speedup on emerging attention variants across Ampere, Hopper, Blackwell, and AMD MI350 architectures. This work signals that curated human knowledge can bootstrap agents to solve specialized infrastructure problems, reducing the overhead of supporting new accelerators.
SemiAnalysis via SemiAnalysis Newsletter
SemiAnalysis has released AgentX 1.0, an open-source multi-turn agentic coding inference benchmark at 1M context length, backed by $3M in dataset construction. The benchmark reflects a fundamental shift in production inference: agentic workloads now dominate traffic, with enterprise token usage shifting from 36% ChatGPT to 64% agentic/codex workloads between August 2025 and June 2026. Unlike fixed sequence-length benchmarks, AgentX captures realistic multi-turn, long-context, high-prefix-reuse patterns with sub-agent bursts and tool calls—characteristics that make agentic inference a systems problem rather than a chip performance problem.
The benchmark has already catalyzed over 70 upstream pull requests across vLLM, SGLang, TensorRT-LLM, and other frameworks, implementing concrete optimizations including KV cache offloading strategies, disaggregated prefill/decode configurations, context parallelism, and speculative decoding fixes. Most improvements are directly transferable to production traffic. The full matrix runs on ~2MW of continuously operated compute across over 1000 chips, including MI355X, GB300, GB200, B300, B200, MI325, MI300X, H200, and RTX Pro Servers, with results open-sourced and consumed by tier-1 AI lab capacity planning teams. This signals that agentic inference is becoming the primary optimization target across the hardware and software stack.
Unknown via Azeem Azhar, Exponential View
AI agents have become the dominant consumer of tokens in production systems. Agent token usage surpassed human token usage in February 2026 and has since grown at a 14x rate, while human token usage grew only 2.8x—a fundamental shift in AI infrastructure demand patterns. This acceleration reflects the maturation of agentic workflows (exemplified by Claude Code's rapid adoption) and signals that infrastructure planning must now optimize for multi-turn, long-context, stateful agent interactions rather than single-turn user queries.
Simultaneously, open-weight models have doubled their token share over 12 months while closed-weight tokens grew 7x, approaching a 1:1 ratio. Enterprise adoption is accelerating: AT&T now routes 40% of employee AI usage to open models with plans to increase to 60–70%, indicating that open alternatives are becoming viable for non-critical work. This bifurcation—agents driving explosive growth while open models capture increasing share—reshapes competitive dynamics and infrastructure economics across the AI stack.
Chinese Robotics Valuations Detached from Technical Reality; Seven Firms Exceed $3B Despite 15-Minute Towel-Folding Demos
ChinAI Newsletter
Seven Chinese embodied AI companies have surpassed 20 billion RMB (~$3B) valuations despite demonstrating only narrow, low-capability tasks—15-minute towel-folding operations and 90-second box-moving demonstrations. Valuations are driven by circular revenue schemes where state-owned entities simultaneously invest in, partner with, and purchase from the same robotics companies. Unitree, the largest player, generated over 70% of 2025 revenue from research applications rather than actual industrial deployment, revealing a speculative bubble disconnected from technical progress or commercial viability. This contrasts sharply with the concrete infrastructure and capability metrics driving valuations in the U.S. AI hardware market.