Technology
<strong>Anjney Midha's Plan to Radically Lower the Price of Compute</strong>
Key Points
Anjney Midha's Plan to Radically Lower the Price of Compute A conversation with the founder of AMP PBC about turning GPUs into a utility. Listen to Odd Lots on Apple Podcasts Listen to Odd Lots on Spotify Watch Odd Lots on YouTube Subscribe to the newsletter Anjney Midha wrote the first check to Anthropic.
Anjney Midha's Plan to Radically Lower the Price of Compute
A conversation with the founder of AMP PBC about turning GPUs into a utility.
Listen to Odd Lots on Apple Podcasts
Listen to Odd Lots on Spotify
Watch Odd Lots on YouTube
Subscribe to the newsletter
Anjney Midha wrote the first check to Anthropic. He teaches a viral course at Stanford on how AI works. And he was, until recently, a partner at a16z. In other words, he is AI-industry royalty. Midha's new project is AMP PBC, a company that believes it can radically lower the price of compute. To accomplish that, he is working on building a compute grid that turns GPUs into a standardized utility. But right now, compute is too fragmented. It's too heterogeneous. And given the way contracts are structured, he says that labs are being forced to spend money on capacity that often goes unused. In other words, small labs are forced to pay up for big, long-term contracts, even though their own demand (particularly during model training) may be very spiky. On this episode, Midha explains how the market for compute currently works and why he believes there's a software solution that could significantly improve compute utilization. He also tells us why he does not anticipate one company will emerge as the dominate player and that instead we'll have a wide range of models, each optimally used in specific applications.
[Image text:] DISRUPT
DISROPT
DISR
SRUPT
DISRUP
DISRUPT
DISR
SRUP
IPT