Daily Newsletter Digest

Google's TPUv7 Ironwood beats NVIDIA on inference cost by 50%

November 6th 2026

Today's News

Maude Lemaire joins Cursor after scaling Slack and GitHub infrastructure at massive scale

The Pragmatic Engineer

Maude Lemaire, a principal engineer who spent nearly eight years leading Slack's backend performance team and recently tackled GitHub's database scaling challenges, has joined Cursor to work on performance improvements including time to first token. Her experience managing massive-scale systems—handling 500,000+ concurrent WebSocket connections and managing 16+ database shards—is directly applicable to the infrastructure demands of AI-native developer tools.

OpenAI launches GPT-6 Cyber, discovering 81 Firefox vulnerabilities and 948 Linux kernel exploits at $1.2M API cost

Techmeme

OpenAI released GPT-6 Cyber, a specialized model demonstrating concrete capability gains in AI-assisted security research. The model identified 81 previously unknown Firefox vulnerabilities and 948 Linux kernel exploits, with the research consuming $1.2M in API costs. This represents a new specialized model tier competing with general-purpose systems and signals OpenAI's strategy to develop domain-specific variants alongside flagship models.

Real 2027 data center supply will be 16.7–22.6GW, not speculative 50GW forecast; power connections, not construction, are the binding constraint

Azeem Azhar, Exponential View

Azeem Azhar's infrastructure analysis reveals that actual 2027 data center supply will reach only 16.7–22.6GW, far below the speculative 50GW forecast circulating in markets. The critical constraint is power connection timelines, not physical construction: hyperscalers have already locked most 2027 power agreements while speculative shells face cancellation. The average US wait time for a power connection is four years, while data center shells take only 18–24 months to build. This creates a 20GW supply gap emerging in 2028 and gives communities and local governments genuine leverage to extract benefits before capacity becomes abundant. Azhar notes that a 1GW data center with ~400,000 B300 chips costs ~$40B upfront but generates only ~$800M annual operating expenditure (roughly 2.5% of CapEx). Since each B300 chip generates ~$8/hour in revenue, every month of delay costs hyperscalers hundreds of millions. This asymmetry gives communities negotiating power. The North Lanarkshire deal in Scotland sets a benchmark: DataVita agreed to pay up to $100,000 per megawatt per year to a local fund—$50M annually at full 500MW capacity, or $543M over 15 years. By contrast, Oracle's New Mexico deal offered only $84,000 per megawatt as a one-time fee. At the North Lanarkshire benchmark, every GW of connection could yield $100M to local communities—only 0.2% of the $10–40B per GW that infrastructure companies can earn.

Agent cloud infrastructure emerging as larger market than traditional cloud, with sandboxes, persistent state, and inference routers as core pillars

Clouded Judgement by Jamin Ball

Jamin Ball argues that the infrastructure stack for AI agents fundamentally differs from legacy cloud computing, which optimized for throughput across shared machines. Agent infrastructure instead requires isolated sandboxes per task, persistent state management, inference routing across models, and RL/training loops. This architectural shift suggests agent infrastructure could dwarf classical cloud application infrastructure in total addressable market, representing a structural shift in how compute will be provisioned and priced.

Slack limits custom emoji reactions to 23 to prevent thundering herd failures

The Pragmatic Engineer

The platform discovered that emoji reactions in large channels create exponential fan-out load—a 100,000-member channel with 100 custom emoji reactions generates 10 million fan-outs across the network. By capping custom emojis at 23, Slack prevents infrastructure collapse while maintaining user experience, illustrating how product constraints solve infrastructure problems at scale.

Worth Reading

The Iron(wood) Throne: Google's TPU Stakes Its Claim on Inference

SemiAnalysis

SemiAnalysis published a comprehensive analysis of Google's TPUv7 Ironwood inference performance against NVIDIA Blackwell. Main takeaways:

  • TPUv7 delivers up to 50% better performance per dollar than B200/B300 on FP8 inference at 100 tok/s/user ($0.181 vs $0.222-$0.276 per million tokens)
  • NVIDIA leadership responding with 24/7 engineering effort and agent swarms; GB300 FP4 counter-submission still 1.64x worse per dollar than TPUv7 FP8 for external customers
  • Google TPU ecosystem maturing rapidly with TorchTPU native PyTorch backend replacing previous TorchAX translation layer; Meta Muse Spark Open and Kimi K3 shipping with day-0 TPU support
  • TPU software stack (vLLM, SGLang, llm-d, Ray) gaining upstream maintainer support; NVIDIA facing bureaucratic delays on driver features vs AMD/Google startup-like responsiveness
  • InferenceX benchmark now industry standard across hyperscalers (Microsoft Azure, Oracle, Meta) with support from PyTorch Foundation, vLLM, SGLang; TPUv7 competitive or superior on realistic agentic multi-turn workloads
Read more

Descent into the Computational Sublime: From Dark Forest to Strange Forest Through the Hardness Wars

Contraptions

Venkatesh Rao in Contraptions published an essay titled "Descent into the Computational Sublime: From Dark Forest to Strange Forest Through the Hardness Wars". Main takeaways:

  • Black October (October 2026) marks a watershed moment: AI models have reached capability levels where they can autonomously find and exploit zero-day vulnerabilities faster than the institutional machinery of patching and disclosure can respond, inverting the historical scarcity of skilled attackers.
  • The Binance $6.34B breach exemplifies the convergence of AI-assisted intrusion, cryptographic protocol hardness (EIP-7702 delegation), and automated asset laundering—showing how intelligence and cryptographic hardness interact as dual capabilities available to competing participants.
  • The essay frames an emerging three-act transformation: (1) current vulnerability explosion phase, (2) cryptographic migration and defensive hardening, (3) a deeper restructuring of computational civilization toward what Rao calls the 'computational sublime'—a descent into previously opaque layers of infrastructure now exposed to adversarial AI examination.
Read more

Don't waste a good backlash

Exponential View

Exponential View published an original essay on data center politics and AI infrastructure economics following the 2026 midterm elections. Main takeaways:

  • Voters rejected 43 of 44 local data center measures, creating political leverage for communities to negotiate better terms with hyperscalers.
  • North Lanarkshire's DataVita deal ($100k/MW/year community fund) provides a template; Oracle's New Mexico offer ($84k/MW one-time) was 18x stingier despite similar scale.
  • At current surge pricing ($10-40B per GW), a $100M/GW community levy represents only 0.2-1% of infrastructure revenue, leaving substantial room for negotiation.
  • Real employment from data centers remains minimal (~20 people per $1B invested at Meta Louisiana, 16 at Anthropic); permanent jobs don't justify infrastructure costs alone.
  • Exponential View forecasts 16.7-22.6GW US data center energization in 2027 vs. SemiAnalysis's 50GW estimate; 2028 faces a 20GW power supply gap that could yield $2B/year in community levies at Lanarkshire rates.
Read more

The Agent Cloud

Clouded Judgement

Clouded Judgement published an essay on the emerging infrastructure stack required to support AI agents at scale. Main takeaways:

  • Agent cloud infrastructure inverts traditional cloud design: instead of one app serving millions of users, millions of agents each run isolated, short-lived tasks with diverse workloads and unpredictable burst patterns.
  • Core pillars of agent cloud infrastructure include sandboxes (disposable isolated compute per task), persistent state storage (filesystem surviving individual tasks), inference routing across models, RL/training loops for model customization, and underlying CPU/storage/network at much greater scale.
  • Secondary infrastructure layer includes workflow/durable execution, browser infrastructure for agent web access, CI/CD for agent-generated code, git backends handling petabytes daily, identity/payment rails, and observability systems for agent-generated metrics.
  • Agent cloud infrastructure is projected to dwarf traditional cloud application infrastructure in total addressable market due to the multiplicative increase in underlying compute units and services required.
Read more

The End of Feature Discovery as We Know It

Elena's Growth Scoop / Lenny's Newsletter

Elena Verna in Elena's Growth Scoop / Lenny's Newsletter published an essay titled "The End of Feature Discovery as We Know It". Main takeaways:

  • Feature discovery and adoption—decades-long product/growth focus—becomes largely unnecessary when AI agents invoke functionality based on user intent rather than requiring human navigation
  • The new product constraint shifts from 'getting users to click on features' to 'building trust in software that operates autonomously,' making reliability, transparency, and control actual growth levers
  • AI-native products risk replicating the feature-discovery problem if treated as another feature to adopt rather than as the core product interface itself
  • Use case discovery (what's possible) replaces feature discovery (where to find it), requiring fundamentally different onboarding and communication strategies
  • Engagement metrics may decline while customer value increases, forcing recalibration of traditional growth dashboards and KPIs
Read more

Articles Read