After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
What I've Learned From 135 Companies
A few patterns in AI infrastructure come up again and again.
The founders who handle AI infrastructure well understand that the data tells a different story than your gut.
The Reality Nobody Talks About
A lot of the advice on AI infrastructure rests on assumptions that made sense five years ago. The world has moved on.
The first thing to understand is that most founders overthink this and underspend on execution. I've seen this play out across dozens of companies. The pattern is unmistakable.
Many teams spend months on the wrong path before realizing that customer feedback is the only metric that matters. Once they make the switch, everything changes.
Why Most Approaches Fail
Many common approaches to AI infrastructure are flawed at the root.
The root cause is usually one of three things:
Copying what big companies do without understanding why they do it. What works for Google doesn't work for a 10-person startup.
Over-engineering the solution when a simple approach would work better. I've seen teams spend six months building something that could have been done in two weeks.
Ignoring the human element. Technology is the easy part. Getting people to actually use it is where the real challenge lives.
Real Talk: What Actually Matters
Here is what actually matters in AI infrastructure.
First, execution speed beats perfection. Every time. Companies rarely fail because they moved too fast on AI infrastructure. Many fail because they moved too slowly.
Second, measure everything. If you can't measure it, you can't improve it. Set up tracking from day one, even if it's basic.
Third, talk to your users. It sounds obvious, but many founders make decisions about AI infrastructure in a vacuum. Get out of the building. Talk to real people.
This connects to broader themes around TPU, AI chips, quantum computing, GPU shortage, AI data centers that I've been thinking about a lot lately.
Wrapping Up
I've shared a lot here, and I know it can feel overwhelming. But you don't need to get AI infrastructure right on day one. You just need to get started and keep improving.
Founders who do well at AI infrastructure tend to share one trait: they're relentlessly practical. They don't chase perfection. They chase progress.
That's the mindset I'd encourage you to adopt. Start where you are. Use what you have. Do what you can. And keep pushing forward.
As always, I'm rooting for you.
Frequently Asked Questions
Q:What's the most common pushback you get on this?
People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.
Q:What experience informs this perspective?
This perspective comes from over a decade of building companies in Silicon Valley, two successful exits (RemoteTeam to Gusto, MovieLaLa to Gfycat), and investing in 234 startups including Anthropic, OpenAI, and Scale AI. I write about what I've lived.
Q:Do all experts agree with this view?
No, and that's fine. The best ideas in business are often contrarian. I share my perspective based on my experience and data, but I encourage you to seek out opposing viewpoints and form your own conclusions.