Court Exhibit·12 JUL 2017
Compute Is the Constraint, Not Cleverness
If the bottleneck is hardware, the winner is whoever buys the most of it first.
Source document — Musk v. Altman (OpenAI) — Docket 351-41 · Musk v. Altman (OpenAI) · 4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
Excerpt · In Ilya Sutskever's own words
We usually decide that problems are hard because smart people have worked on them unsuccessfully for a long time. It's easy to think that this is true about AI. However, the past five years of progress have shown that the earliest and simplest ideas about AI - neural networks - were right all along, and we needed modern hardware to get them working. Historically, AI breakthroughs have consistently happened with models that take between 7-10 days to train. This means that hardware defines the surface of potential AI breakthroughs. It's not so much that AI progress is a hardware game, any more than physics is a particle accelerator game. But if our computers are too slow, no amount of cleverness will result in AGI, just like if a particle accelerator is too small, we have no shot at figuring out how the universe works. Fast enough computers are a necessary ingredient, and all past failures may have been caused by computers being too slow for AGI. We estimate that Brain has around 100k GPUs, FAIR has around 15-20k, and DeepMind allocates 50 per researcher no questions asked. There is good reason to believe that deep learning hardware will speed up 10x each year for the next four to five years. The world is used to the comparatively leisurely pace of Moore's Law, and is not prepared for the drastic changes in capability this hardware acceleration will bring. Within the next three years, robotics should be completely solved, AI should solve a long-standing unproven theorem, and programming competitions should be won consistently by AIs.
The daily letter · Free
This edition is for members — but the daily letter is free.
One real corporate email, and the lesson it teaches, in your inbox every weekday morning. Free. Unsubscribe in one click.
How this surfaced
- Source type
- Court Exhibit
- Case / record
- Musk v. Altman (OpenAI)
- Citation
- 4:24-cv-04722 (CAND), Doc. 379-77, filed 2026-01-06
- Date authored
- July 12, 2017
- License
- Public domain
- Original
- View the primary source →
More from Elon Musk
Elon Musk & Andrej Karpathy ·OpenAI ·1 FEB 2018
Open Research Without Scale Feeds Your Competitor
If you can't match a giant's scale, publishing your best ideas is a subsidy to them, not a strategy against them.
Ilya Sutskever ·OpenAI ·1 JAN 2018
Ilya Sutskever Writes Elon Musk a New Year's Note from Inside OpenAI
Written just weeks before Musk's departure from the OpenAI board, this note captures a moment of genuine collegiality between two figures who would later become adversaries in court.
Elon Musk & Ilya Sutskever ·OpenAI ·13 SEP 2017
Design Board Math Before You Need It
Control isn't a feeling — it's a seat count, and smart founders draw the arithmetic before the fight, not during it.
Elon Musk & Andrej Karpathy ·OpenAI ·1 FEB 2018
Open Research Without Scale Feeds Your Competitor
If you can't match a giant's scale, publishing your best ideas is a subsidy to them, not a strategy against them.
Elon Musk & Greg Brockman & Ilya Sutskever & Jared Birchall ·OpenAI ·21 JUL 2017
Musk and Brockman Debate OpenAI's Future While Musk Gifts Founders Model 3s
A single email thread from mid-2017 captures OpenAI at the exact moment its founders were already sketching a path from nonprofit to for-profit to government project — while Musk was simultaneously cementing personal loyalty with early Tesla hardware.
Dario Amodei & Emil Michael ·Anthropic ·26 FEB 2026
How to Walk Away Without Burning the Bridge
When the other side rewrites your redlines into meaningless words, name the trick precisely — then keep the door open.