After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
What I've Learned From 22 Companies
Across 234 angel investments, including Anthropic, a few patterns in AI infrastructure come up again and again.
The founders who handle AI infrastructure well understand that most founders overthink this and underspend on execution.
The Reality Nobody Talks About
A lot of the advice on AI infrastructure rests on assumptions that made sense five years ago. The world has moved on.
The first thing to understand is that simplicity beats complexity every time. I've seen this play out across dozens of companies. The pattern is unmistakable.
Many teams spend months on the wrong path before realizing that timing is everything in this game. Once they make the switch, everything changes.
Lessons From the Trenches
I want to share a few specific lessons I've picked up over the years. These aren't theoretical. They come from real companies, real failures, and real successes.
Lesson 1: The best time to start thinking about AI infrastructure was yesterday. The second best time is now. Don't wait until you have the perfect plan.
Lesson 2: Hire for attitude, train for skill. The best people at AI infrastructure are rarely the most technically gifted. They are the most curious and persistent.
Lesson 3: Your competitors are probably getting this wrong too. That's your opportunity. While everyone else is following the same playbook, you can zig when they zag.
This connects to broader themes around TPU, quantum computing, edge AI that I've been thinking about a lot lately.
The Bottom Line
None of this is rocket science. But it does require intentionality, consistency, and a willingness to learn from mistakes.
If you take one thing from this article, let it be this: start now, start small, and iterate. The founders who win at AI infrastructure aren't the ones with the best strategy on paper. They're the ones who execute, learn, and adapt faster than everyone else.
Companies that take AI infrastructure seriously tend to pull ahead of the ones that don't.
If you're working on something interesting in this space, I'd love to hear about it. Drop me a line.
Frequently Asked Questions
Q:Are these recommendations still relevant in 2026?
Absolutely. While specific tools and tactics change, the underlying principles remain consistent. I update my thinking regularly based on what I'm seeing in the market and across my portfolio companies.
Q:Which item on this list has the highest impact?
It depends on your stage and context, but in my experience, the items near the top of the list tend to have the broadest applicability. That said, sometimes the less obvious items create the biggest breakthroughs for specific situations.
Q:How do I know which items apply to my situation?
Start by honestly assessing where your biggest bottleneck is right now. The items that address that specific constraint will give you the highest return on your time and energy.