Beyond the Sean Ellis Test
The Sean Ellis test — “How disappointed would you be if this product no longer existed?” — provides a quantitative signal for product-market fit. If 40%+ of users say “very disappointed,” you likely have PMF. Below 40%, you likely do not.
But the Sean Ellis test tells you whether. It does not tell you why, for whom, or what to do next. A score of 25% “very disappointed” could mean the product is wrong, the audience is wrong, the positioning is wrong, or you have PMF for a segment you have not identified yet.
Qualitative interviews answer the questions behind the number.
The PMF Interview Framework
Who to Interview
Interview three groups:
-
Engaged users: People who use your product regularly and would be “very disappointed” without it. They reveal what PMF looks like — the problem, the solution fit, the value they perceive.
-
Casual users: People who signed up but use your product sporadically. They reveal the PMF gap — what is keeping them from full engagement.
-
Churned or abandoned users: People who tried and left. They reveal the PMF blockers — what the product got wrong for their segment.
Key Questions
Problem validation:
- “What were you trying to solve when you first tried our product?”
- “How were you handling this before?”
- “How much time or money does this problem cost you?”
Solution fit:
- “Does our product solve this problem? Partially? Completely?”
- “What does it not do that you still need?”
- “What workarounds do you use alongside our product?”
Value perception:
- “How would you describe what our product does to a colleague?”
- “If our product disappeared tomorrow, what would you do?”
- “How disappointed would you be on a scale of 1-10, and why?”
Segment identification:
- “What is your role and company size?”
- “What other tools do you use daily?”
- “What makes your use case different from others?”
Interpreting Results
Strong PMF Signals
- Users describe the same problem with similar language
- Users express high disappointment (8-10) at product removal with specific reasons
- Users have stopped using alternatives for the job your product does
- Users can explain your value clearly to others
- Users describe specific workflows that depend on your product
Weak PMF Signals
- Users describe different problems — the product means different things to different people
- Disappointment is moderate (4-6) with vague reasoning (“it’s useful but…”)
- Users still rely on alternatives alongside your product
- Users struggle to explain what the product does
- Usage is sporadic without consistent workflows
What to Do with Weak Signals
Weak PMF signals do not mean the product is wrong. They often mean:
-
Wrong segment: You have PMF for a sub-segment you have not identified. Look for the 3-5 interviews where responses are strongest and identify what those users have in common.
-
Wrong positioning: The product solves a real problem but users do not understand the connection. Messaging and onboarding need alignment.
-
Missing capability: The product is 80% of the solution and users need the last 20% to commit fully.
-
Wrong pricing: The value-to-price ratio does not clear the switching threshold from current workarounds.
Each of these has a different fix. Research distinguishes between them; guessing does not.
Running the Study
A PMF validation study with AI-moderated interviews takes 48-72 hours:
- Interview 10 engaged users, 10 casual users, and 10 churned users
- Use the SaaS research template for the discussion guide
- Analyze patterns by user group — where do experiences converge and diverge?
- Identify the segment where PMF signals are strongest
- Document the problem-solution-segment fit in the Intelligence Hub
Total cost: $600-$1,500 including incentives. That is less than a week of engineering time — and it prevents months of building in the wrong direction.
For seed-stage teams, PMF research is not a luxury. It is the cheapest insurance against the most expensive mistake in SaaS: building something nobody wants.