Sahin Boydas
Random theme
Select theme
Back to all articles

What Student Data Says About AI Tutors

What 10,000 student sessions with an AI tutor reveal: three patterns in how students actually learn with AI, and what they mean for EdTech design.

2024-09-195 min read513 words

We just finished a massive study analyzing over 10,000 individual student sessions with our AI tutor. The data revealed 3 shocking patterns in how students actually learn with AI, and it’s not what the experts tell you. The truth is in the numbers.

The Reality Nobody Talks About

A lot of the advice on AI tutors rests on assumptions that made sense five years ago. The world has moved on.

The first thing to understand is that simplicity beats complexity every time. I've seen this play out across dozens of companies. The pattern is unmistakable.

Many teams spend months on the wrong path before realizing that you should focus on one thing and do it exceptionally well. Once they make the switch, everything changes.

What I've Learned From 101 Companies

A few patterns in AI tutors come up again and again.

The founders who handle AI tutors well understand that timing is everything in this game.

Real Talk: What Actually Matters

Here is what actually matters in AI tutors.

First, execution speed beats perfection. Every time. Companies rarely fail because they moved too fast on AI tutors. Many fail because they moved too slowly.

Second, measure everything. If you can't measure it, you can't improve it. Set up tracking from day one, even if it's basic.

Third, talk to your users. It sounds obvious, but many founders make decisions about AI tutors in a vacuum. Get out of the building. Talk to real people.

This connects to broader themes around ai tutor, edtech research, learning analytics, student data that I've been thinking about a lot lately.

What's Next

Best practice in AI tutors is changing fast. What worked last year might not work next year. That's both the challenge and the opportunity.

My advice: stay curious, stay humble, and stay close to the people who are actually doing the work. Read less thought leadership and do more experiments. Talk to fewer consultants and more practitioners.

If you're building in this space, the best time to get AI tutors right is before you need to. Don't wait for a crisis to force your hand.

I'll keep sharing what I learn. This stuff matters too much to keep to myself.

FAQ

Frequently Asked Questions

Q:What's the most common pushback you get on this?

People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.

Q:How can I apply this thinking to my own situation?

Start by identifying the core principle behind the opinion, not the specific example. Then ask yourself: does this principle apply to my context? If yes, test it in a small, low-risk way before going all in.

Q:What experience informs this perspective?

This perspective comes from over a decade of building companies in Silicon Valley, two successful exits (RemoteTeam to Gusto, MovieLaLa to Gfycat), and investing in 234 startups including Anthropic, OpenAI, and Scale AI. I write about what I've lived.

Written by

Sahin Boydas

Serial entrepreneur, #1 angel investor, author of Becoming Top 1%

Get Sahin's Weekly Insights

Join 10,000+ founders and investors. One email per week with actionable advice on startups, investing, and building in the AI era.

No spam. Unsubscribe anytime.