Customer research call guide

Churn Discovery Calls: Discussion Guide

For: exec team (read before calls start), interviewers, note-takers Timeline: week 0 for data pull and recruiting, weeks 1–3 for calls, week 4 for synthesis and recommendation

Why we're doing this

Both bets rest on a theory we haven't tested. The data we have can't settle it:

• The exit survey doesn't separate the theories. "Missing features or integrations" (46%) was listed first, it was a single choice, and it combines robotics with every other feature gap. The free-text box was almost always left blank.
• The robotics evidence is thin for churn. 3 churned customers moved to a competitor with robotics integrations. That is 3 of roughly 60 churned accounts. The 9 lost new-logo deals are about acquisition, not churn.
• The implementation evidence is a correlation. Customers who went live after 90 days churned at 2.4× the rate. But complex customers may both take longer to go live and churn more for other reasons.
• We don't know when or why the leave decision formed. That is the question the calls exist to answer.

Twelve calls can show us how customers decide to leave. They can't show us how many leave for each reason. The CRM pull below fills that gap, and the calls and the data should be read together.

1. Learning goals

1. When did the leave decision form, and what triggered it? In the first months or later? During implementation, after go-live, or around an automation project?
2. Does implementation delay cause churn, or just come with it? If delay mattered, was the cause on our side (fixable by Bet B) or on theirs (data readiness, their staffing)?
3. Is automation a real driver? Are customers actually automating? Did Crate's lack of robot integration block them, or did it come up afterwards as a reason?
4. Do signers and daily users tell the same story? Executives may cite strategy (automation). Operations managers may cite experience (implementation, usability).
5. Are the reasons something else entirely? For example: price, support, acquisition, consolidation, or a non-robotics feature gap.

2. Changes to the plan

1. Pull CRM data in week 0, before the first call. For every account that churned in the last 12 months, pull: - tenure at churn - days from signing to go-live - whether they run or were deploying automation (ask CS and account managers) - where they went

Also answer one question: did the rise from 11% to 18% churn come from first-year customers? If it did, that supports Bet B. If the increase is among long-tenured accounts, that points toward Bet A. This may be the most decisive single fact we get, and it costs a day.

2. Replace at-risk accounts that are in renewal talks. Five of the six are negotiating discounts. They have a reason to exaggerate complaints, and a call with them could easily drift into pricing. Use red-health accounts that are not in active renewal. If there aren't enough of those, add churned accounts instead.

3. Fix the call count. The plan says 12 calls, but two people on each of 12 accounts is 24 calls. Within the 12, I propose 8 accounts:

• Split the churned accounts so that 3 left in their first year and 3 left later.
• Include at least one account that moved to a competitor with robotics integrations.
• Signers get priority because they made the decision.
• The paired accounts let us compare what the signer says with what the daily user saw.
• If we can fund 24 calls, pair every account.

4. Ana should not interview her own contacts. Anyone will soften or reshape their story when the CEO asks, especially a CEO they know and whose view they may already have heard. Her contacts also aren't a random sample of the people who left.

My suggestion: - Her contacts can enter the pool if they fit the sampling groups, but a neutral interviewer runs those calls. - Ana and Marcus both listen to the recordings. - If Ana wants to speak with former customers personally, those calls are valuable for the relationship. We run them in addition to the 12 and don't count them as research.

The same rule applies to Marcus: neither exec interviews.

5. Offer a thank-you gift to former customers, such as a gift card. It must not be a credit or discount on Crate.

3. Discussion guide: VP Ops / COO (signer), 45 minutes

0–3 min · Opening - Ask permission to record. If they say no, don't record and take notes only. - Say: "This isn't a sales call. I can't discuss pricing or our product plans. I'm here to understand your experience, good and bad."

3–8 min · Context - "Tell me about your business and how it's changed over the last two years." - "What were your biggest operational priorities this past year?"

8–22 min · The decision story (the core of the call) - Churned: "Take me back to the first moment you started to wonder whether Crate was right for you. What was going on?" - At-risk: "Tell me about the last time you seriously questioned renewing." - Build a timeline with follow-ups: - "When was that, relative to signing?" - "What happened next?" - "Who else was involved?" - "What alternatives did you look at?" - "When was the decision final?" - "What finally tipped it?"

22–30 min · Expectations and early months - "When you signed, what did you expect Crate to do for you, and by when?" - "How did going live compare to what you expected?" - "When, if ever, did you first see the value you signed up for?"

30–37 min · Operational direction - "What investments in the warehouse have you made or planned: equipment, systems, staffing?" - "What did you need your WMS to do as part of those?" - If they mention automation: "How did Crate fit, or not? What did you do about it?"

37–42 min · Prompted check - Hand over a card of possible reasons: implementation time, robotics/automation integration, other missing features, ease of use, support, price, business change. - Rotate the order on every call. The survey showed the first option gets picked more. - Ask: "Pick the top three for you." Then: "Which one, if it had been different, would have changed the outcome?"

42–45 min · Close - "What should I have asked?" - "Who else should we talk to?" - Thank them.

4. Discussion guide: Warehouse operations manager, 45 minutes

0–3 min · Opening - Same as the signer call: recording permission and ground rules.

3–10 min · Daily work - "Walk me through a typical day using Crate." - "What other tools or spreadsheets did you use alongside it?"

10–22 min · Implementation story - "Tell me what happened from signing to go-live." - "What took longest?" - "What were you waiting on, and who was it waiting on?" - "When did it start working the way you needed?" - Get specific episodes, not a verdict. Always ask whether a delay came from us, from them, or from a third party.

22–32 min · Gaps and workarounds - "Tell me about the last time Crate got in your way." - "What equipment or automation runs on your floor? How does information move between it and Crate?" - "What manual steps did that create?"

32–37 min · The decision - "Were you part of the decision to leave or renew? What would you have told leadership?"

37–42 min · Prompted check - Same card as the signer call, with a new random order.

42–45 min · Close - Same as the signer call.

5. Guidance for interviewers

Stay neutral - Don't say "robotics," "automation," or "implementation" before the prompted check, unless the interviewee says it first. What people raise unprompted is our strongest evidence. - Ask about specific past events ("the last time…", "walk me through…"), not opinions or hypotheticals. Treat "we'd have stayed if you'd had X" as weak evidence. - Use their words, not ours. Don't correct them or defend Crate. - In paired accounts, use different interviewers where possible. Never tell the second person what the first one said.

Stay within the rules from Legal and CS - Pricing or discounts: "That's outside what I can cover today. I'll let your account team know you'd like to discuss it." Then tell CS. - Roadmap: "I can't speak to product plans, but I'll make sure what you've said reaches the people who make them." Never promise a feature. - If there's no recording consent, don't record. The note-taker writes verbatim quotes where possible.

Process - A note-taker joins every call. - Within 24 hours, fill in the debrief template: - primary reason, in their words - the decision timeline, with the month the doubt started - robotics raised unprompted? (Y/N) - implementation raised unprompted? (Y/N) - was the delay caused by us, them, or both? - top three from the card - the best quote - Hold a 30-minute team review of the debriefs every Friday.

6. What would back each bet

Each account gets classified by its primary cause, meaning the thing that started or tipped the decision. When signer and ops manager disagree, record both views; don't average them.

Back Bet A (robotics) if: - In at least 3 of the 6 churned accounts, automation was raised unprompted and came before the leave decision. - The customer had a live or funded automation project that Crate blocked or made harder. - Ops managers describe concrete workarounds between robots and Crate. - The CRM pull shows churn concentrated in longer-tenured accounts, with meaningfully more automating churners than the 3 we already know about. - Warning sign: robotics only comes up at the card, or appears in the timeline after the decision was already made. That suggests it's a justification, not a cause.

Back Bet B (implementation) if: - In at least 3 of the 6 churned accounts, doubt formed during or soon after a slow implementation, often phrased as "never saw the value" or "lost confidence." - Ops managers put the main delays on our side: our process, staffing, data migration, or configuration. Those are what a rebuild would fix. - The CRM pull shows the rise in churn comes mostly from first-year customers. - Warning sign: delays were mostly on the customer's side (their data wasn't ready, they didn't have staff). A faster process on our end would then help less than the 2.4× figure suggests.

Back neither if: - Primary causes are spread across several reasons with no clear lead, such as price, support, consolidation or acquisition, or a feature gap unrelated to robotics. - Or signers and ops managers consistently tell different stories that neither bet addresses.

In that case, I'd recommend a smaller fix aimed at whichever cause leads, plus a better-designed exit survey, rather than committing two squads on a weak signal.

If both show up: check whether automating customers are also the ones with the slowest implementations. If they are, those customers' problem is really integration work during setup, and the recommendation should address that directly instead of forcing a choice between A and B.

In week 4, I'll bring the exec team a one-page summary that combines the call findings with the CRM figures, a recommendation, and our confidence in it.

Crate churn research: decision guide

Decision: In four weeks, allocate two squads next half to robotics integrations (A), implementation redesign (B), or conclude that neither retention thesis is sufficiently supported.

Research window: Three weeks; twelve 45-minute interviews. These calls will test explanations and reconstruct decisions—not estimate how common each churn cause is across 340 customers.

1. Learning goals

1. Reconstruct the departure sequence: What happened between signing, implementation, first value, operational problems, searching for alternatives, and deciding to leave?
2. Identify the decisive mechanism: Was robotics incompatibility or implementation friction necessary to the departure, merely contributory, or a justification offered afterward?
3. Find actionable scope: Which integrations or implementation changes could plausibly have prevented the problem? Could two squads address them within a half?
4. Look for competing explanations and counterexamples: Other missing capabilities, service failures, customer-side constraints, or business changes may explain both delays and churn.
5. Separate operational pain from buying decisions: Did daily users and economic buyers experience the same problem and agree on why the relationship failed?

Starting evidence is suggestive, not conclusive. The survey’s broad, first-listed integration option does not establish robotics demand. The 2.4× churn association does not establish that delays caused churn. Competitor destinations do not establish purchase motives; nine lost prospects are acquisition evidence, not retention evidence.

2. Changes to the call plan

Resolve the interview arithmetic. Twelve accounts with two separate interviews each would require 24 calls. Within the limit, recruit six accounts, interviewing both roles separately: twelve calls total.

Use four churned accounts and two at-risk accounts. This prioritizes actual decisions and reduces exposure to active renewal negotiations while retaining prospective evidence.

Select accounts purposively from the eligible pool, not through executive relationships:

• Include late and on-time go-lives, plus a failed/never-live implementation if available.
• Include known robotics signals and accounts without them.
• Include first-year and longer-tenure departures.
• Seek counterexamples: late implementation without abandonment; robotics discussion without an actual deployment or switch.

Do not attempt a fully balanced matrix with six accounts. Document selection, refusals, substitutions, and gaps. Check whether the nine-month churn window excludes relevant cases from the annual churn rise; expand to twelve months if needed.

For at-risk accounts, prioritize the one outside renewal talks. CS must confirm that participation—or refusal—will not affect commercial treatment. If a renewal makes independent research impractical, substitute another eligible account.

Ana should not lead interviews with former customers she knows. Use a neutral researcher or PM who owns neither bet. Ana can help recruit through a standard invitation and review consented recordings afterward. Avoid executive attendance that could suppress criticism.

Before calls, prepare a factual account timeline from CRM, implementation logs, support records, and available usage data. Keep interpretations separate. Examine cohort definitions and potential confounders behind the 2.4× figure.

3. Interview guides

Both guides total 45 minutes. Ask open questions first; introduce the two hypotheses only after the participant’s unaided account.

Guide A: Warehouse operations manager

Guide B: VP Operations or COO

4. Interviewer operating rules

• Be curious, not persuasive. Do not quote Ana, Marcus, survey percentages, or the churn correlation.
• Probe concrete events: “When?” “Who?” “What happened next?” “How do you know?” Distinguish recollection, inference, and observed action.
• Do not discuss pricing, discounts, or roadmap commitments. If raised: “I can’t discuss commercial terms or future plans here; your account team can handle those separately.” Do not promise escalation outcomes.
• Interview roles separately; do not reveal the other person’s answers. Disagreement is evidence to investigate, not average away.
• Use a neutral note-taker. After each call, record chronology, spontaneous versus prompted reasons, supporting evidence, contradictions, and confidence.

5. Evidence required for the decision

Back A if multiple independent accounts—including actual departures—show committed robotics adoption, a specific blocking Crate incompatibility before the departure decision, failed workarounds, and credible evidence that resolving it would have preserved the relationship. Shared, feasible integration needs must emerge. Generic “missing features,” aspirational automation, or competitor capabilities alone do not qualify.

Back B if multiple accounts—including actual departures—show preventable implementation failures preceding loss of confidence, concrete operational consequences, and a credible path from faster successful activation to retention. Identify repeatable Crate-owned bottlenecks. Delays driven mainly by customer readiness, complexity, or already-failing relationships weaken this case.

Back neither if accounts remain contradictory, both theories depend on hypothetical claims, another mechanism dominates, or neither intervention fits the capacity and time available. If both qualify, compare affected retention exposure, intervention feasibility, and remaining uncertainty—not interview vote totals.

Run two pilot calls in week one, finish most interviews in week two, and reserve week three for remaining calls and synthesis. Produce one evidence sheet per account; paired interviews count as one account, not two confirmations. The final readout should combine those cases with cohort data, explicitly separate causality from correlation, and state what remains unproven before recommending either allocation.

Research Guide: Root Cause Analysis for H2 Squad Allocation

Prepared by: Staff Product Manager Target Audience: Executive Team (CEO, CPO, VP CS, Head of Product) Timeline: 3 weeks of interviews; executive decision in Week 4 Scope: 12 calls (45 minutes each)

---

1. Executive Summary & Recommended Changes to the Call Plan

Before executing this sprint, we must adjust three structural flaws in the proposed plan to protect data integrity:

1. Resolve the Account-to-Call Ratio: 12 calls cannot cover two separate stakeholders across 12 accounts. We will target 6 accounts total (3 churned, 3 at-risk) and conduct 2 distinct calls per account: one with the Warehouse Operations Manager (day-to-day user) and one with the VP of Operations/COO (economic buyer). Evaluating both perspectives within the same operational context is essential to determine whether operational failure or strategic misalignment triggered the exit.
2. Quarantine Active Renewals: 5 of the proposed 6 at-risk accounts are actively negotiating renewals and receiving discounts. Interviewing these buyers creates an immediate incentive for them to exaggerate product flaws to gain commercial leverage. We will swap 3 of these with at-risk accounts that are not currently negotiating pricing.
3. CEO Interview Protocol: Executive presence introduces severe confirmation and deference bias—especially with personal contacts who already know Ana's passion for robotics. Recommendation: Ana should join her 4 target calls as an executive sponsor for the first 3 minutes, then hand off lead facilitation to a Product Manager, remaining on mute as an observer. If Ana leads, she must strictly follow the non-leading script provided.

---

2. Core Learning Goals

1. Pinpoint the Churn Decision Window: Did the customer mentally churn during the onboarding/implementation phase (Bet B), or did they leave after reaching steady-state due to technological ceilings (Bet A)?
2. Assess Real Robotics Demand vs. Narrative: Are customers actively deploying autonomous mobile robots (AMRs) and pick-assist hardware, or is "missing robotics" a convenient, forward-looking justification for leaving an underperforming platform?
3. Quantify the Cost of Onboarding Drag: Does exceeding the 45-day SLA directly burn operational credibility and destroy ROI, or is delay merely a symptom of customer-side disorganization?
4. Identify False Dichotomies (Bet Neither): Determine whether churn is driven by factors neither bet solves—such as baseline software unreliability, missing core 3PL billing/EDI features, or macro 3PL volume contraction.

---

3. Interviewer Guidance & Rules of Engagement

• Recording Consent (Mandatory): State verbatim: "Before we begin, do you mind if I record this session purely for internal note-taking? None of this will be shared externally." If declined, proceed with manual notes.
• The "No Roadmap, No Pricing" Wall: Customers will attempt to trade feedback for commitments. If asked about features or discounting, respond: "I'm on the product research side and have no visibility into commercials or delivery timelines. My sole focus today is understanding how your operations actually run."
• Past Behavior Over Speculation: Never ask: "Would you use a robotics integration?" (Answer is always yes). Always ask: "What automation equipment do you have physically deployed on the floor today, and how does your team interact with it?"
• Root-Cause Probing (The "Five Whys"): When a customer says "missing integrations," do not accept the label. Ask: "What specific warehouse task were you trying to execute that stalled? What was the manual workaround?"

---

4. Interview Scripts & Timings (45 Minutes Each)

Track 1: VP of Operations / COO (Economic Buyer)

#### Part 1: Context & Operational Profile (7 mins) * How has your facility footprint and throughput profile shifted over the last 18 months? * When you initially signed with Crate, what core business metric were you held accountable for improving?

#### Part 2: Implementation & Time-to-Value (12 mins) * Walk me back to your onboarding. What was the internal sentiment between signing the contract and processing your first live pallet? * Our contract targets a 45-day go-live; our median across customers is closer to 90. Where did the process stall, and what internal operational cost did that delay create? * At what point did your leadership team feel Crate was fully operational? Did you ever reach that state?

#### Part 3: Strategic Priorities, Automation, & Feature Gaps (16 mins) * Over the past year, what capital investments have you made on your warehouse floor (e.g., conveyor belts, automated guided vehicles, pick-assist carts, manual racking)? * If automation is present: Who manufactures it, what software controls it today, and what specific data must pass between it and your WMS? * If automation is absent: What is on your signed capital expenditure plan for the next 12 months? * When you evaluated the market (or competitors), what specific capability made it clear Crate was no longer the right long-term partner? * Think back to the moment you realized this contract wouldn't renew. When did that conversation happen, and who initiated it?

#### Part 4: Decision Trace & Wrap-up (10 mins) * If Crate had delivered on every promise made during the sales cycle within 45 days, would you still be with us today? Why or why not? * What is the single biggest operational bottleneck your business faces this quarter?

---

Track 2: Warehouse Operations Manager (Daily User)

#### Part 1: Floor Reality & Daily Routine (8 mins) * Walk me through the first two hours of your shift on the floor. Where do supervisors and pickers spend the majority of their time inside Crate? * What daily tasks force your team to leave Crate and use spreadsheets, paper, or secondary systems?

#### Part 2: Go-Live Experience & Transition (12 mins) * How disruptive was the transition to Crate for your floor staff? How long did it take for pick/pack rates to recover to baseline? * During the first three months, how often did you have to escalate systemic issues to leadership? What were those issues? * Did you feel the system was configured correctly for your physical warehouse layout, or did you have to mold your workflows to fit the software?

#### Part 3: Floor Automation & Daily Bottlenecks (15 mins) * How do orders physically move through your facility today? * If pickers are assisted by any mechanical or automated equipment, where does software failure slow them down? * Have you piloted or evaluated autonomous carts or robotics on your floor? * If yes: What was the hardest operational part of that pilot? * If no: What prevents you from automating (e.g., client SKU variability, facility constraints, budget)? * If you could fix one workflow in Crate that causes your floor workers the most frustration, what would it be?

#### Part 4: The Tipping Point (10 mins) * When did your team start discussing alternative systems or workarounds? Was there a specific breaking point or system failure? * If you had a magic wand to improve your team’s pick/pack speed by 20%, what would you change about your physical setup or your software?

---

5. Decision Rubric: What We Need to Hear

At the end of Week 3, interview findings will be mapped against this falsification framework:

---

6. Next Steps

1. Day 1-2: Approve adjusted account roster (3 non-renewing at-risk, 3 churned). CS to send intro emails.
2. Day 3-17: Conduct 12 recorded interviews. Maintain a shared executive synthesis doc updated within 24 hours of each call.
3. Day 21: Final Decision Meeting. Present thematic evidence and allocation recommendation to Ana and Marcus.