Usable with a quick edit10 of 13 checks passed
A PM could quickly trim 3 minutes from the timings and add a note on what to cut if over time, and caveat the behavioural claim; the structure and reasoning are otherwise sound.
Output
Customer Interview Guide: Why Are Customers Leaving?
Owner: Staff PM | Calls: 12 × 45 min, over three weeks | Readout: before the exec decision in four weeks
1. Learning goals
- Timing: When did the customer first consider leaving, and what was happening then (signing, go-live, first 90 days, renewal)? This tells us whether churn is decided early or late.
- Reasons, in their order: What were the reasons for leaving or staying, ranked in the customer's own words, before we prompt anything?
- Automation: Are they automating their floor, which systems do they need Crate to connect to, and was that gap a blocker or a workaround?
- Implementation: Where did time go between signing and daily use, and who was waiting on whom?
- Alternatives: What did they evaluate instead, and what did that option do better?
2. Changes to the plan (please read before the calls start)
- Ana should not run calls with accounts she knows. Personal relationships make candid criticism less likely, and Ana is the sponsor of Bet A. She can provide introductions and read the notes afterward. Neutral interviewers run those four calls on accounts she doesn't manage.
- The plan implies 24 conversations, not 12. Each account has two contacts. I propose 12 × 45-minute calls with the operations manager on every account, plus a 20-minute executive call (VP/COO) on as many accounts as we can reach, aiming for six.
- Rebalance the sample. Churned accounts are 9 of the 12 calls, and the at-risk sample is weighted toward accounts in renewal talks (see point 4). Within the churned group, make sure we have at least three go-lives over 90 days and three under 90, and at least three accounts running automation and three that aren't. Without this spread, we can't tell robotics from implementation.
- Renewal talks distort at-risk answers. Five of six at-risk accounts are negotiating renewals with discounts on the table. Customers will say what helps their negotiation, and we can't fully control for that. Treat at-risk answers as evidence of current pain, not reasons for churn. If possible, swap two at-risk accounts for churned accounts from months 9–12 of the exit survey window.
- Pull data this week, not after the calls. Get churn-notice dates, go-live dates, and integration usage for all 41 churned accounts. This lets us test the timing question quantitatively.
- Don't treat the exit survey as proof. Missing features was the first option, the "Other" box was almost empty, and the question forced one answer. The 46% doesn't tell us it's robotics. Use these calls to check it.
- Agree the decision thresholds now (section 5), before we hear anything.
3. Questions and timings
Opening (3 min), verbatim: > "Before we start, may I record this? It's for internal research only, and I'll share unattributed summaries. You can stop at any point. We're not selling anything today, and I can't discuss pricing, offers, or product plans. I want to understand what happened for you."
A. Context (5 min) - Walk me through your warehouse operation and your role in it. - What does Crate do for you day to day, or what did it do before you stopped using it?
B. The timeline (12 min) Most important block. Get dates. - Walk me through the last time you were seriously considering leaving [or: seriously worried about the relationship]. When did that start? - What was happening at that point? Who was involved? - When did it become a real decision? What triggered it? - Probe for dates: "Roughly which month was that? What was going on at go-live?"
C. Reasons, unprompted (8 min) Don't mention robotics yet. - Looking back, what were all the reasons, in order of importance? - What made the difference between staying and leaving? - If we'd fixed one thing, would you have stayed? - What did you look at instead? What did it do that we didn't?
D. Automation (7 min) Only after block C. - What has changed on your floor over the past two years? Any carts, pick-assist robots, or other automation? - Which systems does Crate need to connect with? How did your team work around the gap? - Was that a blocker, or a nice-to-have? - Did anyone raise it in a renewal or evaluation discussion?
E. Implementation (8 min) - How long did it take from signing to your team using Crate daily? - Where did the time go? Who was waiting on whom? - When did your team first feel it was working?
F. Close (5 min) - If you were us, what would you fix first? - Is there anything I should have asked?
Executive variant (20 min): Spend the time on blocks A, B, and C, plus: how the decision was made and who approved it; what they evaluated; how automation fits into their operating plan for the next 12 months; and what they told their team about Crate.
At-risk variant: Replace "what made the difference between staying and leaving?" with "what's working well today and what's getting in the way?" Do not ask about renewal, pricing, or whether they plan to stay.
4. Guidance for interviewers
- Two people per call: one leads, one takes notes. No one from Sales or Customer Success on the call.
- Don't name robotics, the 46% figure, or our hypotheses. Don't ask leading questions ("Isn't it frustrating that…?").
- Ask about specific past events, not hypotheticals ("Would you use…?"). Ask "What else?" until they run out.
- Let silence work. Don't fill it.
- Don't promise anything. If asked about features or fixes: "I'll pass that on, but I can't say what we'll build."
- Pricing or discounts: Don't engage. Say "I can't discuss that today. I'll make sure your account team knows you raised it." Record their words verbatim and tell Customer Success after the call. CS owns the follow-up.
- Debrief within two hours. Fill in one template: go-live and churn dates, reasons in the customer's order, whether robotics came up unprompted or after a prompt, implementation duration, and up to three verbatim quotes.
5. What we'd need to hear
Thresholds are directional. Twelve calls can't prove anything, but they can show whether a theory holds up.
Back Bet A (robotics integrations) if: - At least 5 of 12 name a specific automation system that Crate can't connect to as a primary reason for leaving or evaluating alternatives. This should come up in block C or D, not only after prompting. - At least 3 say the integration would have changed the outcome. - The decision to leave happened late in the contract, not during implementation. - Churned accounts that ran automation churned for reasons that match the exit survey.
Back Bet B (faster implementation) if: - At least 5 of 12 say the decision started during go-live or in the first 90 days. - They name specific bottlenecks: data migration, configuration, waiting on our team, or connecting to their existing systems. - At least 3 say faster go-live would have kept them. - In the pulled data, go-live time separates churned accounts from retained ones more sharply than automation does.
Back neither if: - Reasons are spread across price, service, reporting, or other issues, with no dominant theme. - Robotics comes up, but few customers have automation projects planned in the next 12 months. - Implementation was slow, but the decision to leave was made at renewal for unrelated reasons. - The real driver is weak executive sponsorship or a lack of internal champions, which neither bet addresses.
If neither bet is backed, the readout should say so directly and name the pattern that did emerge. Don't force a choice between A and B if the evidence points elsewhere. If the evidence supports both, the readout should say which has stronger support and what would change that conclusion.
Claims the judge couldn’t find in the brief
- Customers will say what helps their negotiation.
Grades and run details
Decision model 92 · LLM judge 79
Decision model checks
- passUses the supplied evidence correctly1%
- passAddresses the actual decision91%
- partialRespects explicit constraints23%
- passIdentifies material uncertainty100%
- passAvoids unsupported claims64%
- passProduces the required deliverable80%
- passTests both theories fairly98%
- passDifferent questions for user and signer66%
- passProtects the calls and the accounts95%
- passDesigned to falsify82%
- passAsks what people did, not what they think79%
- passDoesn't lead the witness76%
- partialMarks what to cut if the call runs over37%
Run
- Run
- #1
- API response time
- 45 s
- Submitted
- 8 Oct 2026