Scaling a serverless AI application from a handful of users to millions is a unique engineering challenge. I'll take you inside our architecture and share the lessons we learned about managing state, optimizing performance, and controlling costs at scale.
The Reality Nobody Talks About
A lot of the advice on serverless AI rests on assumptions that made sense five years ago. The world has moved on.
The first thing to understand is that the best solutions are often the simplest ones. I've seen this play out across dozens of companies. The pattern is unmistakable.
Many teams spend months on the wrong path before realizing that the market doesn't care about your roadmap. Once they make the switch, everything changes.
What I've Learned From 117 Companies
A few patterns in serverless AI come up again and again.
The founders who handle serverless AI well understand that your team matters more than your technology.
What I Tell Founders
Before deciding anything about serverless AI, start with three questions:
What's your timeline? Because the right approach for a company with 6 months of runway is very different from one with 3 years.
What have you already tried? Most founders have tried something. Understanding what didn't work is often more valuable than knowing what might.
Who on your team owns this? If the answer is "everyone" or "no one," that's your first problem to solve.
These questions seem simple but they reveal a lot about where a company actually stands.
This connects to broader themes around usage-based pricing, AI infrastructure costs, vertical SaaS that I've been thinking about a lot lately.
Wrapping Up
I've shared a lot here, and I know it can feel overwhelming. But you don't need to get serverless AI right on day one. You just need to get started and keep improving.
Founders who do well at serverless AI tend to share one trait: they're relentlessly practical. They don't chase perfection. They chase progress.
That's the mindset I'd encourage you to adopt. Start where you are. Use what you have. Do what you can. And keep pushing forward.
As always, I'm rooting for you.
Frequently Asked Questions
Q:Do all experts agree with this view?
No, and that's fine. The best ideas in business are often contrarian. I share my perspective based on my experience and data, but I encourage you to seek out opposing viewpoints and form your own conclusions.
Q:What's the most common pushback you get on this?
People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.
Q:What experience informs this perspective?
This perspective comes from over a decade of building companies in Silicon Valley, two successful exits (RemoteTeam to Gusto, MovieLaLa to Gfycat), and investing in 234 startups including Anthropic, OpenAI, and Scale AI. I write about what I've lived.