After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
The Counterintuitive Truth
In AI infrastructure, the best practitioners often do less, not more.
The lesson: simplicity beats complexity every time. It sounds simple. It's incredibly hard to execute.
Why Most Approaches Fail
Many common approaches to AI infrastructure are flawed at the root.
The root cause is usually one of three things:
Copying what big companies do without understanding why they do it. What works for Google doesn't work for a 10-person startup.
Over-engineering the solution when a simple approach would work better. I've seen teams spend six months building something that could have been done in two weeks.
Ignoring the human element. Technology is the easy part. Getting people to actually use it is where the real challenge lives.
What I Tell Founders
Before deciding anything about AI infrastructure, start with three questions:
What's your timeline? Because the right approach for a company with 6 months of runway is very different from one with 3 years.
What have you already tried? Most founders have tried something. Understanding what didn't work is often more valuable than knowing what might.
Who on your team owns this? If the answer is "everyone" or "no one," that's your first problem to solve.
These questions seem simple but they reveal a lot about where a company actually stands.
This connects to broader themes around edge AI, AI data centers, GPU shortage, AI chips, NVIDIA that I've been thinking about a lot lately.
The Bottom Line
None of this is rocket science. But it does require intentionality, consistency, and a willingness to learn from mistakes.
If you take one thing from this article, let it be this: start now, start small, and iterate. The founders who win at AI infrastructure aren't the ones with the best strategy on paper. They're the ones who execute, learn, and adapt faster than everyone else.
Companies that take AI infrastructure seriously tend to pull ahead of the ones that don't.
If you're working on something interesting in this space, I'd love to hear about it. Drop me a line.
Frequently Asked Questions
Q:Are these recommendations still relevant in 2026?
Absolutely. While specific tools and tactics change, the underlying principles remain consistent. I update my thinking regularly based on what I'm seeing in the market and across my portfolio companies.
Q:Which item on this list has the highest impact?
It depends on your stage and context, but in my experience, the items near the top of the list tend to have the broadest applicability. That said, sometimes the less obvious items create the biggest breakthroughs for specific situations.
Q:How were these items selected?
Each item on this list comes from direct experience, either from building my own companies or from patterns I've observed across the 234 startups I've invested in. I prioritize practical, actionable items over theoretical concepts.
Q:Can I implement all of these at once?
I'd strongly recommend against it. Pick the 2-3 items that resonate most with your current situation and focus there. Trying to do everything simultaneously is a recipe for doing nothing well.