Sahin Boydas
Random theme
Select theme
Back to all articles

What Building a Custom AI Chip Involves

How AI hardware choices make or break a startup: GPU shortages, cloud versus owned clusters, custom chips, and what each option really costs founders.

2024-03-265 min read611 words

After spending years working in Silicon Valley, I've learned how important the right AI hardware is for a company’s success. I’m sharing the lessons I wish I knew when I started—from dealing with GPU shortages to designing custom chips.

The Counterintuitive Truth

In AI chips, the best practitioners often do less, not more.

The lesson: simplicity beats complexity every time. It sounds simple. It's incredibly hard to execute.

Why Most Approaches Fail

Many common approaches to AI chips are flawed at the root.

The root cause is usually one of three things:

Copying what big companies do without understanding why they do it. What works for Google doesn't work for a 10-person startup.

Over-engineering the solution when a simple approach would work better. I've seen teams spend six months building something that could have been done in two weeks.

Ignoring the human element. Technology is the easy part. Getting people to actually use it is where the real challenge lives.

The Framework That Actually Works

Here is a simple framework for evaluating AI chips. It's not complicated, but it requires discipline.

Step 1: simplicity beats complexity every time

This is where most people go wrong. They skip this step entirely and jump straight to execution. Don't do that.

Step 2: you need to move fast and break things

Once you have the foundation right, this becomes much easier. I've watched founders struggle with this for months when the answer was staring them in the face.

Step 3: Iterate relentlessly

Nothing works perfectly the first time. The companies that get AI chips right treat it as an ongoing process, not a one-time project.

The AI Angle

Any discussion of AI chips in 2026 has to include AI. As someone who's invested in Anthropic, OpenAI, Scale AI, and Hugging Face, I have a front-row seat to how AI is transforming this space.

The short version: AI makes good practitioners better and bad practitioners worse. It's an amplifier, not a replacement.

Some teams use AI to get far more out of AI chips. Others spend heavily on AI that solves the wrong problem. The difference comes down to understanding what you're actually trying to achieve.

This connects to broader themes around NVIDIA, AI data centers, edge AI, AI cloud, GPU shortage that I've been thinking about a lot lately.

Wrapping Up

I've shared a lot here, and I know it can feel overwhelming. But you don't need to get AI chips right on day one. You just need to get started and keep improving.

Founders who do well at AI chips tend to share one trait: they're relentlessly practical. They don't chase perfection. They chase progress.

That's the mindset I'd encourage you to adopt. Start where you are. Use what you have. Do what you can. And keep pushing forward.

As always, I'm rooting for you.

FAQ

Frequently Asked Questions

Q:What would you do differently looking back?

I'd move faster on the things that were working and cut the things that weren't sooner. Most founders, myself included, hold onto failing strategies too long because of sunk cost. Speed of learning is everything.

Q:What was the biggest challenge in this case?

Almost always, the biggest challenge is people and alignment, not technology or strategy. Getting the right team focused on the right problem is harder than any technical challenge I've encountered.

Q:Can these results be replicated?

The specific numbers will vary, but the underlying patterns and principles are transferable. The key is understanding the context behind the results, not just copying the tactics. Every company has unique constraints that shape what works.

Written by

Sahin Boydas

Serial entrepreneur, #1 angel investor, author of Becoming Top 1%

Get Sahin's Weekly Insights

Join 10,000+ founders and investors. One email per week with actionable advice on startups, investing, and building in the AI era.

No spam. Unsubscribe anytime.