Why is compute infrastructure so central to the AI race, and who currently controls it?
TechnologyAI Infrastructure & ComputeAI Market CompetitionAI Geopolitics
Compute infrastructure is central to the AI race due to its dominance in costs and operational demands, accounting for over 50% of expenses at major AI firms like Anthropic and others, making AI development highly capital-intensive [2]. The shift from software competition to controlling vertically integrated infrastructure stacks by large AI labs underscores this, as scarcity in data centers, chips, and power creates severe bottlenecks, with build times of 18-36 months and power grid waits of 3-5 years limiting scalability [1][6]. Additionally, power constraints, not just compute, are a key issue, with inferencing costs up to 15 times higher than training and expected to consume 75% of AI compute by 2030, while lack of compute makes AI expensive and restricts it to high-value tasks [8][9]. Base resources like training clusters, high-end GPUs, electricity, and cooling are concentrated in a handful of "super-platforms," where big software companies have become hardware players with heavy capital expenditures [10].
Control of compute infrastructure is held by a limited set of hyperscalers and large AI labs, with examples like Anthropic leveraging multi-provider strategies across Google TPUs, AWS Trainium2, and Nvidia GPUs for cost and iteration advantages [12]. These super-platforms manage the core resources amid skyrocketing data center costs and demand from sectors pulling in robotics and materials [6][10][11].
Sources
- AI is Quietly Shifting to Infrastructure Control — Daily Brew
- Compute Costs Dominate AI Company Expenses — Exponential View
- The AI infrastructure crisis: Why identity controls matter now more than ever — siliconangle
- AI storage moves into the spotlight as density, speed and margins converge — siliconangle
- AI Infrastructure Expands Beyond GPUs — Daily Brew
- AI Infrastructure Faces Severe Scarcity — Exponential View
- AI Infrastructure Costs Skyrocket — The Register
- AI's Real Bottleneck Isn't Compute, It's Power—An Infrastructure Problem IT Can Solve — Forbes
- A big determinant of AI's job impact is driven by the lack of compute, especially for agentic work, which takes a lot of it. That makes AI expensive. — @emollick
- The Fourth Revolution: The Present and Future of Artificial Intelligence — Substack
- AI Infrastructure Costs Soar as Demand for Data Centers Grows — Daily Brew #1488
- Anthropic's Compute Advantage — Daily AI News March 9, 2026
- OII | The political geography of AI infrastructure — OII
Related questions
- →does china use more tokens for AI than the us?
- →What does meaningful AI development look like for countries without access to frontier compute — and what alternatives exist?
- →What is the real impact of US semiconductor export controls on China's AI development trajectory?
- →How are hyperscalers sourcing energy for AI data centres, and what pressure does this place on grids and energy markets?