Usable with a quick edit13 of 14 checks passed
The memo is well-structured, uses evidence correctly, and covers all required elements. A PM could use it with minor wording edits, without re-checking data or reasoning.
Output
To: Executive team Subject: Choose successful completed shifts as Crewmate’s North Star
Recommendation
Adopt monthly successful completed shifts as Crewmate’s North Star: the number of unique posted shifts that are filled, actually worked, and have no unresolved dispute. Count a shift once, after its scheduled end; exclude cancellations, no-shows, and disputed shifts until resolved.
This measures the outcome venues hire us for and workers show up to deliver—not activity on either side of the marketplace. It also directs attention to the reliability that supports repeat use. Venues with fill rates of at least 90% are much more likely to still be posting six months later than venues below 70% (84% vs. 41%).
The latest figures show why the distinction matters. Monthly posts rose from 77,000 in Q2 to 92,000 in Q3, while fills rose from 63,700 to 71,000. But overall fill rate fell from 82.7% to 77.2%; independent-venue fill rate fell from 78.9% to 67.9%, and independent venues stopping posts rose from 5% to 9%. Meanwhile, GMV grew 15%, but chains’ share of GMV rose from 34% to 46% and they raised rates 11% for the holiday season. GMV is important, but this mix and price change make it a poor standalone signal of marketplace health.
Nor should we equate registrations with supply: only 2,370 of 7,900 Q3 registrants worked a shift, after the sign-up bonus began. Workers who complete three or more shifts in their first month are far more likely to remain active. We should reward dependable activity, not sign-ups.
Metric tree and accountability
The core identity is:
Successful completed shifts = valid posted shifts × fill rate × successful-completion rate
| Input | Definition | Accountable owner |
|---|---|---|
| Valid posted shifts | Unique, legitimate shifts with a real venue, role, time, and pay; split by enterprise/independent and lead time | Head of Demand |
| Fill rate | Filled shifts ÷ valid posted shifts | COO |
| Successful-completion rate | Shifts actually worked without a no-show or unresolved dispute ÷ filled shifts | COO; Product/Data owns reliable status capture |
| Qualified, available worker coverage | Repeat, activated workers available for the shifts and locations demanded; leading driver of fill and completion | Head of Supply |
| Repeat venue demand | Active venues returning to post, with retention and posting frequency by venue segment | Head of Demand |
The first three inputs calculate the North Star; worker coverage and repeat venue demand are leading drivers and diagnostic cuts, not extra terms to multiply into it. Review all results by enterprise vs. independent, and scheduled vs. same-day.
Paired business measure
Pair the North Star with monthly contribution margin dollars: Crewmate’s 18% take-rate revenue on completed-shift GMV, less variable fulfillment costs, including rescue bonuses and other worker incentives. This checks that completed shifts create sustainable value rather than being purchased at any cost. Continue reporting GMV to the board as a scale measure, but not as our North Star.
Measurement, gaming, and guardrails
Completion data is not yet strong enough for an unqualified claim: venues confirm only 64% of filled shifts, and the rest are assumed worked unless disputed. Among confirmed shifts, 6% were no-shows or disputed; rescue-filled shifts have a 13% no-show rate versus 4% for other fills. For the first board readout, label the metric provisional, disclose the confirmation rate, and show the calculation and coverage. Then instrument worker and venue check-in/out, reconcile mismatches, and audit a sample. Do not treat missing confirmation as proof of success indefinitely.
Key gaming risks and controls:
- Post inflated, duplicate, or low-quality shifts: count only valid shifts; monitor cancellations, disputes, and fill rate.
- Favor easy or high-priced chain shifts over independent or same-day demand: report North Star and fill/completion rates by segment; track independent-venue retention and same-day performance as guardrails.
- Buy apparent success with rescue bonuses: monitor rescue share, no-show rate, and contribution margin alongside completed shifts. Rescue fills are not successes unless the shift is actually worked.
- Misreport completion or suppress disputes: require auditable status capture and monitor confirmation coverage and dispute rates.
What current metrics become
- CEO — GMV: remains a board/business measure, paired with contribution margin; it is not the North Star.
- Demand — shifts posted: becomes a leading input, with valid posts and repeat independent-venue demand emphasized over raw volume.
- Supply — active workers: shifts to qualified, repeat workers and first-month activation (especially the three-shift threshold); registrations are a funnel diagnostic.
- COO — fill rate: remains a critical driver and guardrail, but success is completed shifts—not fills that fail to show up.
At the offsite, agree on the definition, owners, and guardrails. Before the board update, establish the provisional baseline and be explicit about its measurement limits.
Grades and run details
Decision model 100 · LLM judge 93
Decision model checks
- passUses the supplied evidence correctly60%
- passAddresses the actual decision75%
- passRespects explicit constraints56%
- passIdentifies material uncertainty85%
- passAvoids unsupported claims24%
- passProduces the required deliverable82%
- passSees the growth is narrow98%
- passChecks the North Star can be measured100%
- passSees the fill rate being bought98%
- passOne North Star for both sides99%
- passMeasures value created, not captured100%
- passGets the base of every number right45%
- passBreaks it into inputs teams can move100%
- passSays how it could be gamed100%
Run
- Run
- #1
- API response time
- 37 s
- Submitted
- 5 Oct 2026