Sahin Boydas
Random theme
Select theme
Back to all articles

Behind the Scenes of a Hyperscale AI Data Center 321

How AI hardware choices make or break a startup: GPU shortages, cloud versus owned clusters, custom chips, and what each option really costs founders.

2024-08-035 min read601 words

After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.

What I've Learned From 124 Companies

A few patterns in AI data centers come up again and again.

The founders who handle AI data centers well understand that the market doesn't care about your roadmap.

The Reality Nobody Talks About

A lot of the advice on AI data centers rests on assumptions that made sense five years ago. The world has moved on.

The first thing to understand is that you need to move fast and break things. I've seen this play out across dozens of companies. The pattern is unmistakable.

Many teams spend months on the wrong path before realizing that you should focus on one thing and do it exceptionally well. Once they make the switch, everything changes.

The Counterintuitive Truth

In AI data centers, the best practitioners often do less, not more.

The lesson: the data tells a different story than your gut. It sounds simple. It's incredibly hard to execute.

What I Tell Founders

Before deciding anything about AI data centers, start with three questions:

1

What's your timeline? Because the right approach for a company with 6 months of runway is very different from one with 3 years.

2

What have you already tried? Most founders have tried something. Understanding what didn't work is often more valuable than knowing what might.

3

Who on your team owns this? If the answer is "everyone" or "no one," that's your first problem to solve.

These questions seem simple but they reveal a lot about where a company actually stands.

This connects to broader themes around AI chips, AI cloud, quantum computing, TPU, NVIDIA that I've been thinking about a lot lately.

Wrapping Up

I've shared a lot here, and I know it can feel overwhelming. But you don't need to get AI data centers right on day one. You just need to get started and keep improving.

Founders who do well at AI data centers tend to share one trait: they're relentlessly practical. They don't chase perfection. They chase progress.

That's the mindset I'd encourage you to adopt. Start where you are. Use what you have. Do what you can. And keep pushing forward.

As always, I'm rooting for you.

FAQ

Frequently Asked Questions

Q:Do all experts agree with this view?

No, and that's fine. The best ideas in business are often contrarian. I share my perspective based on my experience and data, but I encourage you to seek out opposing viewpoints and form your own conclusions.

Q:What experience informs this perspective?

This perspective comes from over a decade of building companies in Silicon Valley, two successful exits (RemoteTeam to Gusto, MovieLaLa to Gfycat), and investing in 234 startups including Anthropic, OpenAI, and Scale AI. I write about what I've lived.

Q:What's the most common pushback you get on this?

People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.

Q:How can I apply this thinking to my own situation?

Start by identifying the core principle behind the opinion, not the specific example. Then ask yourself: does this principle apply to my context? If yes, test it in a small, low-risk way before going all in.

Written by

Sahin Boydas

Serial entrepreneur, #1 angel investor, author of Becoming Top 1%

Get Sahin's Weekly Insights

Join 10,000+ founders and investors. One email per week with actionable advice on startups, investing, and building in the AI era.

No spam. Unsubscribe anytime.