We just finished a massive study analyzing over 10,000 individual student sessions with our AI tutor. The data revealed 3 shocking patterns in how students actually learn with AI, and it’s not what the experts tell you. The truth is in the numbers.
What I've Learned From 65 Companies
Across 234 angel investments, including Anthropic, a few patterns in AI tutoring come up again and again.
The founders who handle AI tutoring well understand that you should focus on one thing and do it exceptionally well.
The Framework That Actually Works
Here is a simple framework for evaluating AI tutoring. It's not complicated, but it requires discipline.
Step 1: customer feedback is the only metric that matters
This is where most people go wrong. They skip this step entirely and jump straight to execution. Don't do that.
Step 2: you need to move fast and break things
Once you have the foundation right, this becomes much easier. I've watched founders struggle with this for months when the answer was staring them in the face.
Step 3: Iterate relentlessly
Nothing works perfectly the first time. The companies that get AI tutoring right treat it as an ongoing process, not a one-time project.
Real Talk: What Actually Matters
Here is what actually matters in AI tutoring.
First, execution speed beats perfection. Every time. Companies rarely fail because they moved too fast on AI tutoring. Many fail because they moved too slowly.
Second, measure everything. If you can't measure it, you can't improve it. Set up tracking from day one, even if it's basic.
Third, talk to your users. It sounds obvious, but many founders make decisions about AI tutoring in a vacuum. Get out of the building. Talk to real people.
This connects to broader themes around student data, edtech research, ai tutor, learning analytics that I've been thinking about a lot lately.
What's Next
Best practice in AI tutoring is changing fast. What worked last year might not work next year. That's both the challenge and the opportunity.
My advice: stay curious, stay humble, and stay close to the people who are actually doing the work. Read less thought leadership and do more experiments. Talk to fewer consultants and more practitioners.
If you're building in this space, the best time to get AI tutoring right is before you need to. Don't wait for a crisis to force your hand.
I'll keep sharing what I learn. This stuff matters too much to keep to myself.
Frequently Asked Questions
Q:What's the most common pushback you get on this?
People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.
Q:How can I apply this thinking to my own situation?
Start by identifying the core principle behind the opinion, not the specific example. Then ask yourself: does this principle apply to my context? If yes, test it in a small, low-risk way before going all in.
Q:How has this view evolved over time?
My thinking on most topics has changed significantly over the years. Early in my career, I held many conventional views that experience proved wrong. I try to update my beliefs when the evidence changes.