Needs more than a quick edit9 of 12 checks passed
The output contains several arithmetic errors in ticket counts (e.g., 72 instead of 75, 36 instead of 33) that would force a PM to re-verify the data before using it.
Output
Product Discovery Synthesis: Q3 Interviews & Support Tickets
To: Chief Product Officer From: PM, Ordering Subject: Correcting the Q4 roadmap recommendation: Delivery & Invoice Reconciliation vs. Supplier Marketplace
Executive Summary
An initial look at last quarter’s data suggested we should build a supplier marketplace next quarter. However, a deeper analysis of our 200 support tickets and 10 customer interviews shows the marketplace signal is a mirage caused by a single vocal enterprise account.
For our core customer base of independent restaurants, the most urgent, expensive, and widespread problem is delivery tracking and invoice reconciliation—specifically handling short deliveries, substitutions, and credit notes. We should focus Q4 on fixing the post-order workflow, not building a marketplace.
---
Main Findings & Strength of Evidence
#### 1. The "Supplier Marketplace" demand is heavily skewed and misunderstood * Strength of Evidence: Weak * What the data actually shows: On the surface, "Add more suppliers" is our #1 ticket category, making up 72 of 200 tickets (36%). However, 56 of those 72 tickets (78%) came from a single 14-site customer: Calder Group. The remaining 16 tickets came from just 16 unique accounts (out of 1,140 total). * The Nuance: Even Calder Group’s tickets are not requests to discover new suppliers in a marketplace. They are repeatedly asking us to onboard their existing suppliers (their meat supplier, dairy supplier, wine merchant, and Brakes) so they can centralize ordering. * Interview Context: In interviews, only 1 of 10 customers (the single-site Pizzeria) genuinely wanted a marketplace for supplier discovery and price comparison. Calder Group used the word "marketplace" to mean having all their current vendors on the platform. Two others actively dismissed the idea: the Tapas Bar expressed lukewarm interest before pivoting to paperwork pain, and the 5-site Café Group explicitly stated: "Finding suppliers isn't the problem. Knowing what actually arrived is."
#### 2. Delivery mismatches and invoice reconciliation are our largest widespread pain points * Strength of Evidence: Strong * What the data actually shows: In our interviews, 8 out of 10 customers identified post-order tracking (short deliveries, substitutions, invoice matching, and chasing credit notes) as their primary operational headache. This directly causes financial loss (e.g., the Gastropub losing ~£600/month paying for undelivered goods) and severe time waste (owners spending Sunday nights matching paper notes to invoices, or re-typing clipboard notes into Larder). * Support Ticket Alignment: In the ticket data, "Delivery didn't match order" (36 tickets across 36 unique accounts) and "Invoice reconciliation" (31 tickets across 30 unique accounts) are two halves of the exact same problem. Combined, they account for 67 tickets across 64 unique accounts—four times the unique account volume of the supplier requests (excluding Calder Group). * Specific Product Gaps: Customers are explicitly telling us where the product breaks down: * At the back door: Short deliveries aren't showing in the app (9 tickets), users don't know how to log substitutions (8 tickets), and chefs check deliveries on paper clipboards—likely exacerbated by our tablet login bug (10 tickets). * In the back office: Invoices include undelivered items (9 tickets), invoice totals don't match orders (9 tickets), users can't match invoices to orders (10 tickets), credit notes are missing (8 tickets), and accountant exports fail to show credits (10 tickets).
#### 3. Core ordering and access friction creates unnecessary noise * Strength of Evidence: Moderate (Ticket data only) * What the data actually shows: We saw 31 tickets for basic "Ordering" issues (10 duplicate orders, 11 delivery day changes, 10 cut-off time questions) and 30 for "Login and access" (10 password resets, 10 adding users, 10 tablet login failures). While unmentioned in interviews, these represent 30% of support volume and hurt day-to-day usability.
---
What This Means for Q4: Recommendations
Building a two-sided supplier marketplace next quarter would be a costly misstep. It solves a problem (supplier discovery) that almost none of our customers have, based on un-deduplicated ticket data from one large account.
Instead, we should align our Q4 roadmap with our core value proposition—"track deliveries and invoices"—where our independent restaurants are bleeding time and money:
1. Build a "Goods-In" & Discrepancy Workflow (Primary Q4 Bet): * Allow kitchen staff to easily check off deliveries on mobile/tablet at the back door, logging short weights, missing items, and substitutions in real time. * Automatically flag discrepancies against the original order, adjust expected invoice totals, and track pending credit notes through to the accountant export. 2. Fix the Tablet Login Bug & Ordering UX (Quick Wins): * Fixing the tablet login issue (10 tickets) is a prerequisite for kitchen staff checking deliveries digitally instead of on clipboards. * Address duplicate order prevention and surface supplier cut-off times clearly in the UI to cut ordering support tickets. 3. Handle Calder Group Operationally, Not via a Marketplace: * Have Customer Success and Partnerships work directly with Calder Group to onboard their four requested suppliers (Brakes, meat, dairy, wine). For the broader base, improve our "request to onboard my existing supplier" intake flow so sites don't spam support.
Claims the judge couldn’t find in the brief
- "Add more suppliers" is the #1 ticket category, making up 72 of 200 tickets (36%).
- 56 of those 72 tickets (78%) came from Calder Group.
- The remaining 16 tickets came from 16 unique accounts.
- "Delivery didn't match order" has 36 tickets.
- "Invoice reconciliation" has 31 tickets.
Grades and run details
Decision model 71 · LLM judge 77
Decision model checks
- failUses the supplied evidence correctly37%
- failAddresses the actual decision31%
- passRespects explicit constraints67%
- failIdentifies material uncertainty77%
- partialAvoids unsupported claims51%
- passProduces the required deliverable95%
- passSees one account behind the top ticket97%
- passCorrects the draft's claim94%
- passWeights behaviour over opinion100%
- passSays how many sources support each finding43%
- passFrames findings for the decision97%
- passReports what cuts against the plan100%
Run
- Run
- #1
- API response time
- 15 s
- Submitted
- 13 Oct 2026