Diagnose a retention problem

To: Leo (Head of Growth) From: PM, Activation Subject: Hold on doubling paid spend — our flat WAU is an activation and win-back issue, not summer seasonality

Leo,

Before we double paid acquisition, we need to look closely at what is happening beneath our top-line WAU. While it looks like a summer slump, the data shows our flat WAU (~52,000) is actually caused by two product and lifecycle changes from August: the Week 5 onboarding change broke new-user habit formation, and the Week 6 win-back campaign is masking that core retention drop with temporary, low-intent resurrected users.

Doubling paid spend right now will pour expensive acquisition into a leaky bucket. Here is the diagnosis and what we should do before scaling spend.

---

1. Why it’s not summer seasonality

If summer weather and holidays were driving our flat WAU, we would see a broad dip across all users in July and August, followed by a recovery in September. Instead: * Pre-Week 5 cohorts are rock solid: Users who signed up in Weeks 1–4 retained at ~30% by Week 8 (hitting late August and September) with zero seasonal decay. * Retention is still worsening in late September: Our weekly churned users rose from ~7,100 in early July to 10,279 in Week 13 (Sept 28). Meanwhile, our core `retained_users` (active both this week and last week) have steadily eroded from ~45,000 in Weeks 1–4 down to 41,636 in Week 13.

2. Root Cause #1: The Week 5 shorter sign-up broke long-term activation

In Week 5 (Aug 3), we removed the goal-setting step ("What do you want to achieve, and how many days a week?") to cut sign-up time from 3 minutes to 1. Sign-up completion jumped from 61% to 74%, and Week 1 retention ticked up ~3 percentage points (from ~55% to ~58%).

However, long-term cohort retention collapsed immediately starting with the Week 5 cohort: * Week 4 Retention: Dropped from ~33.8% (Weeks 1–4 cohorts) to ~24.7% (Weeks 5–9 cohorts)—a ~9 percentage point drop. * Week 8 Retention: Dropped from ~30.0% (Weeks 1–4 cohorts) to 19.9% (Week 5 cohort)—a one-third relative loss in long-term retained users.

Why this happened: Stride’s core value is a weekly workout plan. By removing the step where users state their goals and target workout days, we likely broke the mechanism that personalizes their weekly plan and anchors their habit commitment. Furthermore, cutting friction let through lower-intent users who curious-click in Week 1, skewing Week 1 retention up while failing to build a multi-week habit.

The Math: Even with a 21% boost in sign-up completion (61% $\rightarrow$ 74%), a 33% relative drop in Week 8 retention (30% $\rightarrow$ 19.9%) means every 1,000 visitors to our sign-up flow now yields ~19% fewer long-term active users than before Week 5.

3. Root Cause #2: The Week 6 win-back campaign is inflating WAU and churn

Why hasn’t WAU fallen if core retention is down? Because in Week 6 (Aug 10), lifecycle launched the 21-day inactive win-back email offering a free week of Premium: * Resurrected users spiked: `returningusers` jumped from ~990/week (Weeks 1–5) to ~2,600/week (Weeks 6–13)—adding ~1,600 temporary users per week. * They immediately re-churn: Lifecycle data shows only 12% of win-back users remain active two weeks later (compared to 41% of organic returning users). Once their free week of Premium ends, nearly 90% (~1,400 users/week) churn right back out. * This explains why weekly `churnedusers` spiked from ~7,400 in Week 4 to >9,100 in Week 6 and >10,300 by Week 11. We are propping up headline WAU by cycling ~1,600 promo-chasers in and out of the app every week while our true core base (`retained_users`) shrinks by ~3,200 users.

(Note: When we increased paid social by 25% in Week 9, new users grew, W2–W4 cohort percentages held steady at the post-Week 5 levels, and `retained_users` still dropped by another ~500 users over the next four weeks.)

---

What we should do before scaling acquisition

1. Hold off on doubling paid acquisition (and revert the 25% Week 9 increase if CAC is inefficient): Right now, 80% of new sign-ups churn by Week 7. Doubling spend at current retention rates will burn budget for a fraction of the LTV we were getting in July. 2. Restore goal-setting to the activation flow (this week): We need to A/B test bringing back the goal and frequency questions immediately: * Variant A (Control): Current 1-minute sign-up. * Variant B (Revert): Original 3-minute sign-up with goal-setting. * Variant C (Deferred Onboarding): Keep account creation fast, but require the goal-setting & weekly schedule commitment immediately before the user starts their first workout or generates their first weekly plan. * Success metric: Net retained users at Week 4 per 1,000 top-of-funnel visitors (not sign-up completion or W1 retention). 3. Fix the win-back mechanic: Giving a free week of Premium to unactivated users doesn't build a habit. We should shift the win-back hook from a temporary paywall unlock to re-establishing a weekly plan (e.g., "Let's reset your weekly schedule—pick 2 days to work out this week"), and track `retainedusers` separately from win-back `returningusers` in our growth reporting.

Once we see Week 4 cohort retention recover back above 32%, we should turn the paid acquisition tap all the way up.

Leo — I wouldn’t double paid acquisition yet. The flat WAU is masking a retention problem, not showing that summer is the whole story.

• The active base is eroding while inflows hide it. From week 1 to week 13, new users rose from 6,034 to 7,847 (+30%), but retained users fell from 44,884 to 41,636 (−7%). Weekly churn rose from 7,116 to 10,279. WAU stayed near 52,000 because more new users—and, from week 6, more returning users—offset that loss.
• New-user retention deteriorates sharply after week 4. For the first four signup cohorts, week-4 retention was 33–34%, and week-8 retention about 30%. For cohorts in weeks 5–8, week-4 retention was 24–25%; week-5 retention was about 22%, versus about 32% for the earlier cohorts at the same age. Week-1 retention actually improved (roughly 54–55% to 58%), then users fell away faster. So sign-ups are easier to get, but fewer people build a lasting workout habit.
• The timing points to a product change worth investigating. In week 5, we removed the goal-setting step. Sign-up completion rose from 61% to 74%, while the cohort retention pattern worsened immediately. That’s strong evidence to investigate whether the change brought in less-committed users or removed useful personalization—not proof that it caused the decline. Seasonality may contribute, but it doesn’t explain away the sharp cohort break.
• Win-back lifts WAU more than durable retention. Returning users rose from about 1,000 to about 2,600 a week after the week-6 campaign. But only 12% of email-returners were active two weeks later, compared with 41% of people who returned on their own. The campaign may be adding short-lived activity, not repairing the underlying habit problem.

What I’d do before scaling spend:

1. Test the onboarding change now. A/B test restoring goal-setting (or a shorter version) against the current flow. Measure signup completion alongside week-1 activation, week-4/8 retention, and workouts completed—not just registrations.
2. Improve the first-week habit loop. Give users a clear, personalized weekly plan and a timely next-workout prompt. Track results by signup week, onboarding version, and acquisition channel.
3. Put win-back on a holdout. Measure incremental, sustained activity and Premium conversion against users who don’t receive the offer; don’t count the initial return as success.
4. Hold off on doubling acquisition. The week-9 paid increase came after the retention decline had already begun. Scale only when newer cohorts retain better and paid users show acceptable downstream value.

Fixing the leak first gives us a better chance of turning additional acquisition into durable actives rather than more short-lived sign-ups.