Needs more than a quick edit4 of 11 checks passed
The output misstates the baseline activation rate (34% instead of 27%) and lacks a causation test, so a PM would need to re-check the numbers and add a test plan.
Output
To: Omar, Head of Product From: PM, Onboarding Date: September 2024 Subject: Onboarding Review & Activation Strategy
---
1. What Activation Should Mean for Us
Currently, our definition of activation—completing a checklist of cosmetic preferences (name, theme, savings goal, notifications)—is flawed. It measures vanity completion rather than value realization.
As a personal finance app, Tidepool delivers core value when users connect their financial reality and engage with it. Looking at our August cohort (4,000 sign-ups), the data tells a clear story about Day 60 retention:
- Checklist completers retain at 30.4% (742/2,438).
- Bank connectors retain at 48.2% (964/2,000).
- Users who categorise 10+ transactions retain at 64.5% (891/1,380).
- Users who do BOTH (Connect + Categorise) retain at 78.0% (842/1,080).
Recommendation: We must redefine "Activation" from “completed the setup checklist” to “Connected a bank AND categorised at least 10 transactions within their first week.” This anchors our success metric to actual product utility, shifting our focus from cosmetic setup to establishing long-term financial habits.
---
2. The Evidence: Where We Are Losing Users
Our current funnel drops off steeply: 1. Sign up: 4,000 (100%) 2. Setup checklist: 2,440 (61%) 3. Connect a bank: 2,000 (50%) 4. Categorise 10 transactions: 1,360 (34%)
The biggest leak is bank connection (dropping 11 percentage points right after the checklist) and transaction categorisation (dropping another 16 points).
Interestingly, the checklist itself acts as a barrier. Users are spending cognitive load on naming accounts and picking themes before experiencing the core product. Meanwhile, power features like "Created a budget" (33% retention) and opening the app 4+ days are strong secondary indicators, but bank linking and categorisation are the undisputed gateways to retention.
---
3. What to Change in Onboarding
To drive our new definition of activation, we need to restructure the first-time user experience (FTUX):
- Kill the upfront setup checklist: Strip out non-essential steps (naming accounts, picking themes, notifications) from the critical path. Move them to profile settings or prompt for them after value has been proven.
- Accelerate time-to-bank: Move bank connection immediately following sign-up. Users downloaded Tidepool to see their money; let them see it instantly via Plaid/Aggregator integration.
- Gamify the "aha" moment: Guide users smoothly from bank connection directly into categorising their first 10 transactions. Use smart auto-categorisation with a clear, frictionless bulk-approval or swipe UI to make reaching the 10-transaction milestone effortless.
---
4. Verdict on the Design Proposal and Next Quarter's Goal
The Design Team’s Proposal (Celebration screen + Progress bar): * Verdict: Reject in its current form. Adding a progress bar and celebration screen for the existing checklist optimizes the wrong metric. It puts lipstick on a superficial activation loop. * Pivot: If we redesign onboarding to focus on connecting a bank and categorising transactions, then we can use a celebration screen and progress bar—not to celebrate picking a theme, but to celebrate linking an account and hitting that crucial 10-transaction milestone.
Next Quarter's Goal (Raise checklist completion from 61% to 75%): * Verdict: Abandon this goal. Optimizing checklist completion is a local maximum that misaligns product and user success. Chasing 75% checklist completion will likely result in higher drop-offs further down the funnel and flat-to-declining Day 60 retention. * New Goal: We should replace this with a target to raise our true activation rate (Bank Connected + 10 Transactions Categorised) from the current baseline (~34%) to 50% next quarter. This directly correlates with our actual business health and user retention.
Claims the judge couldn’t find in the brief
- The checklist itself acts as a barrier.
- Users are spending cognitive load on naming accounts and picking themes before experiencing the core product.
- Bank linking and categorisation are the undisputed gateways to retention.
Grades and run details
Decision model 50 · LLM judge 33
Decision model checks
- failUses the supplied evidence correctly41%
- passAddresses the actual decision53%
- passRespects explicit constraints33%
- failIdentifies material uncertainty87%
- failAvoids unsupported claims33%
- passProduces the required deliverable48%
- partialComputes retention by behaviour25%
- failTests before trusting the correlation98%
- passActivation defined by what predicts retention99%
- failGets the base of every number right55%
- passGets people to value sooner93%
Run
- Run
- #1
- Time to output
- 5 s
- Submitted
- 5 Oct 2026