Sahin Boydas
Random theme
Select theme
Back to all articles

Inside an AI Red-Teaming Exercise

What happens in an AI red-teaming exercise: the process, the weaknesses hackers usually find, and the fixes that make an AI product safer to ship.

2025-01-265 min read645 words

We recently hired a team of elite hackers to break our own AI, and it was terrifying and enlightening. I'm taking you inside our first-ever AI red-teaming exercise-the process, the shocking vulnerabilities they found, and how we're fixing them. This is a raw look at what it takes to build responsible AI.

What I've Learned From 29 Companies

A few patterns in AI red-teaming come up again and again.

The founders who handle AI red-teaming well understand that your team matters more than your technology.

The Reality Nobody Talks About

A lot of the advice on AI red-teaming rests on assumptions that made sense five years ago. The world has moved on.

The first thing to understand is that you need to move fast and break things. I've seen this play out across dozens of companies. The pattern is unmistakable.

Many teams spend months on the wrong path before realizing that timing is everything in this game. Once they make the switch, everything changes.

Why Most Approaches Fail

Many common approaches to AI red-teaming are flawed at the root.

The root cause is usually one of three things:

Copying what big companies do without understanding why they do it. What works for Google doesn't work for a 10-person startup.

Over-engineering the solution when a simple approach would work better. I've seen teams spend six months building something that could have been done in two weeks.

Ignoring the human element. Technology is the easy part. Getting people to actually use it is where the real challenge lives.

The AI Angle

Any discussion of AI red-teaming in 2026 has to include AI. As someone who's invested in Anthropic, OpenAI, Scale AI, and Hugging Face, I have a front-row seat to how AI is transforming this space.

The short version: AI makes good practitioners better and bad practitioners worse. It's an amplifier, not a replacement.

Some teams use AI to get far more out of AI red-teaming. Others spend heavily on AI that solves the wrong problem. The difference comes down to understanding what you're actually trying to achieve.

This connects to broader themes around AI safety, responsible AI, deepfakes that I've been thinking about a lot lately.

Wrapping Up

I've shared a lot here, and I know it can feel overwhelming. But you don't need to get AI red-teaming right on day one. You just need to get started and keep improving.

Founders who do well at AI red-teaming tend to share one trait: they're relentlessly practical. They don't chase perfection. They chase progress.

That's the mindset I'd encourage you to adopt. Start where you are. Use what you have. Do what you can. And keep pushing forward.

As always, I'm rooting for you.

FAQ

Frequently Asked Questions

Q:How can I apply this thinking to my own situation?

Start by identifying the core principle behind the opinion, not the specific example. Then ask yourself: does this principle apply to my context? If yes, test it in a small, low-risk way before going all in.

Q:Do all experts agree with this view?

No, and that's fine. The best ideas in business are often contrarian. I share my perspective based on my experience and data, but I encourage you to seek out opposing viewpoints and form your own conclusions.

Q:What's the most common pushback you get on this?

People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.

Q:What experience informs this perspective?

This perspective comes from over a decade of building companies in Silicon Valley, two successful exits (RemoteTeam to Gusto, MovieLaLa to Gfycat), and investing in 234 startups including Anthropic, OpenAI, and Scale AI. I write about what I've lived.

Written by

Sahin Boydas

Serial entrepreneur, #1 angel investor, author of Becoming Top 1%

Get Sahin's Weekly Insights

Join 10,000+ founders and investors. One email per week with actionable advice on startups, investing, and building in the AI era.

No spam. Unsubscribe anytime.