Podcast Episode

Building the Cloud for an Agentic World | AWS CEO Matt Garman

The a16z Show
Episode 1222Oct 8, 202656 minEN

Who’s talking

3 speakers
Matt Garman45 min · 82%
Raghu Raghuram9 min · 16%
Speaker 31 min · 2%

Transcript

589 turns · 56 min
MG
Matt Garman0:00

Agentic workflows tend to perform better on AWS than anywhere else. Compute sandboxes, gateways, agent permissions versus people, a lot of those are things that we have built and are building and thinking actively about.

RR
Raghu Raghuram0:12

The top frontier labs gobble up every available GPUs. At the same time-

MG
Matt Garman0:15

Yeah

RR
Raghu Raghuram0:15

... you want to promote newer companies that are gonna become the enterprises of tomorrow. How are you thinking about balancing?

MG
Matt Garman0:21

From the very beginning of when we launched AWS, startups have been the lifeblood of the core of what we do. These are the innovators that are at the edge of technology, understanding what's possible. We're very intentional about keeping capacity available for the startups. We recently announced we're gonna be buying two million NVIDIA GPUs over the next couple of years. We've been-

RR
Raghu Raghuram0:39

Your CapEx this year is what, two hundred or something?

MG
Matt Garman0:41

Two hundred and twenty billion dollars for '26, and we don't anticipate slowing down anytime soon because the demand is just massive.

RR
Raghu Raghuram0:48

With all the debate around AI, extinction risk, and the Hugging Face attack, what are CEOs asking you about all these things?

MG
Matt Garman0:56

Amazon plans to spend two hundred and twenty billion dollars in capital this year, and AWS CEO Matt Garman says they don't anticipate slowing down anytime soon. In this episode, a16z's Raghu Raghuram sits down with Matt to unpack what's driving one of the largest infrastructure build-outs in history and how AI is changing the cloud itself. They discuss how AWS decides who gets scarce GPU capacity, the shifting bottlenecks from power and chips to memory and construction, and the company's bet on custom silicon like Trainium. They also get into what changes when agents increasingly write code and manage infrastructure. And Matt shares what AWS is seeing inside its own teams, where agents now write code and engineers increasingly manage teams of agents, accelerating how quickly new products can be built.

RR
Raghu Raghuram1:47

Welcome to the pod, Matt. What a time we are living in. So I have a lot of topics to talk to you about.

MG
Matt Garman1:52

Awesome.

RR
Raghu Raghuram1:52

So-

MG
Matt Garman1:52

Thanks for having me. I'm excited.

RR
Raghu Raghuram1:54

Yeah, absolutely. So let's start actually right from the beginning. So you were the first GM for EC2.

MG
Matt Garman2:03

Mm-hmm.

RR
Raghu Raghuram2:04

And that was two thousand and six, right? And today you guys are, what, one sixty, one seventy billion in revenue?

MG
Matt Garman2:11

Yeah, about a hundred and sixty-nine, hundred and seventy billion. Yep.

RR
Raghu Raghuram2:13

Yeah, growing thirty-five-

MG
Matt Garman2:15

Thirty-seven. Thirty-seven percent. Yeah.

RR
Raghu Raghuram2:17

That's thirty-seven percent at one sixty-nine.

MG
Matt Garman2:20

Yeah.

RR
Raghu Raghuram2:20

Crazy.

MG
Matt Garman2:20

There's a ton of op-- It's interesting to think about it from day one when-

RR
Raghu Raghuram2:23

Yeah. Yeah

MG
Matt Garman2:23

... the first dollar of revenue, but-

RR
Raghu Raghuram2:25

Yeah

MG
Matt Garman2:25

... yeah. The interesting thing is we're still at the early stages of what the business can be and what the opportunity is for customers. Most workloads, there's a huge amount of workloads still that live on-prem today, and the amount of compute that people are doing every single day is more than it was the day before. And so you see the tailwind from AI, you see the tailwind from migration into the cloud, and the business has grown really fast. It's been a super fun thing to be a part of.

RR
Raghu Raghuram2:49

Yeah, it is. It is. I mean, they'll be writing history books about this and

Episode notes

a16z’s Raghu Raghuram sits down with AWS CEO Matt Garman to discuss how AI is reshaping the cloud, from the needs of AI-native startups to infrastructure increasingly designed for agents.

Matt explains how AWS is adapting as agents write code and manage infrastructure, why it’s reserving scarce GPU capacity for startups, and where custom chips like Trainium and Graviton fit into the AI stack.

They also discuss Amazon's $220 billion capital investment, the shifting bottlenecks in the infrastructure buildout, what enterprises need to trust autonomous agents, and how AWS's own teams are building with agents.

Resources:

Follow Matt Garman on X:  https://x.com/mattsgarman 

Follow Matt Garman on LinkedIn: https://www.linkedin.com/in/mattgarman

Follow Raghu Raghuram on X: https://x.com/RaghuRaghuram

Learn more about AWS: https://aws.amazon.com/

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Showing a preview — retrieve the full transcript via the Exa API.

Powered by the Exa API