Diagnose a retention problem

Leo — I wouldn’t double paid acquisition yet. The flat WAU is masking a retention problem, not showing that summer is the whole story.

• The active base is eroding while inflows hide it. From week 1 to week 13, new users rose from 6,034 to 7,847 (+30%), but retained users fell from 44,884 to 41,636 (−7%). Weekly churn rose from 7,116 to 10,279. WAU stayed near 52,000 because more new users—and, from week 6, more returning users—offset that loss.
• New-user retention deteriorates sharply after week 4. For the first four signup cohorts, week-4 retention was 33–34%, and week-8 retention about 30%. For cohorts in weeks 5–8, week-4 retention was 24–25%; week-5 retention was about 22%, versus about 32% for the earlier cohorts at the same age. Week-1 retention actually improved (roughly 54–55% to 58%), then users fell away faster. So sign-ups are easier to get, but fewer people build a lasting workout habit.
• The timing points to a product change worth investigating. In week 5, we removed the goal-setting step. Sign-up completion rose from 61% to 74%, while the cohort retention pattern worsened immediately. That’s strong evidence to investigate whether the change brought in less-committed users or removed useful personalization—not proof that it caused the decline. Seasonality may contribute, but it doesn’t explain away the sharp cohort break.
• Win-back lifts WAU more than durable retention. Returning users rose from about 1,000 to about 2,600 a week after the week-6 campaign. But only 12% of email-returners were active two weeks later, compared with 41% of people who returned on their own. The campaign may be adding short-lived activity, not repairing the underlying habit problem.

What I’d do before scaling spend:

1. Test the onboarding change now. A/B test restoring goal-setting (or a shorter version) against the current flow. Measure signup completion alongside week-1 activation, week-4/8 retention, and workouts completed—not just registrations.
2. Improve the first-week habit loop. Give users a clear, personalized weekly plan and a timely next-workout prompt. Track results by signup week, onboarding version, and acquisition channel.
3. Put win-back on a holdout. Measure incremental, sustained activity and Premium conversion against users who don’t receive the offer; don’t count the initial return as success.
4. Hold off on doubling acquisition. The week-9 paid increase came after the retention decline had already begun. Scale only when newer cohorts retain better and paid users show acceptable downstream value.

Fixing the leak first gives us a better chance of turning additional acquisition into durable actives rather than more short-lived sign-ups.

Leo — I wouldn’t double paid acquisition yet. We have a retention leak, not just a summer growth slowdown. More new users and campaign-driven returns are masking deteriorating retention. The clearest break coincides with the week-5 onboarding change, though we need an experiment to establish causality.

What’s actually happening

Weekly actives remain around 52,000 because inflows are replacing increasingly large losses:

New users rose 30%, but weekly churn rose 44%. The share of the prior week’s actives retained fell from approximately 86.3% to 80.2%. In week 13, 10,482 new and returning users barely exceeded 10,279 churned users: net growth was just 203.

Flat actives are therefore concealing a less durable user base.

The evidence points to an activation problem

1. New cohorts look better initially, then retain substantially worse. For signup cohorts 1–4, first-following-week retention averaged 55.1%; for cohorts 5–12, it averaged 58.0%. But by the fourth following week, retention falls from 33.8% for cohorts 1–4 to 24.8% for cohorts 5–9. At eight weeks, the earlier cohorts retain roughly 30%, versus 19.9% for cohort 5.

That is not simply fewer people trying Stride. More are getting through the front door, but fewer form a lasting habit.

2. The break aligns with removing goal-setting in week 5. Shorter signup raised completion from 61% to 74%, but removed the step asking users what they wanted to achieve and how often they would exercise. For a habit app built around a weekly plan, that step may have helped users commit to a relevant routine.

The timing makes this our leading hypothesis—not proven causality. We should also check acquisition mix and other changes. However, the paid-budget increase occurred in week 9, after the cohort deterioration began. “Summer” alone does not explain this sharp onboarding-aligned break.

3. Win-back is propping up the headline metric, not repairing retention. Returning users jumped from about 1,000 to 2,600 a week when emails launched in week 6. Yet only 12% of email-driven returners remained active two weeks later, versus 41% of earlier organic returners. These are different populations, so this is not a causal campaign comparison, but it clearly warns against treating every return as durable recovery.

What we should do before spending more

1. Hold acquisition spend steady while testing onboarding. Randomize the current short signup against a lightweight goal-setting step that produces a personalized weekly plan. Preserve the speed improvement where possible.

1. Optimize for durable activation, not signup completion. Make four-week retention a primary outcome, alongside first workout, plan adoption and repeat workout behavior. Measure retained users per signup and per signup starter so a longer flow cannot “win” merely by filtering people out. Track Premium conversion as a guardrail.

1. Locate the failure point. Segment cohorts by acquisition channel, campaign and onboarding exposure. Compare where users stop: before their first workout, after one workout, or when beginning the next weekly plan. Reconcile the signup and new-active counts before calculating acquisition efficiency.

1. Judge win-back on incremental lasting activity. Use a randomized holdout and measure two- and four-week retention, not email-driven returns alone. Test messages that restore a realistic plan rather than relying only on free Premium.

Decision: scale acquisition once we demonstrate improved multiweek retention and acceptable acquisition economics. Doubling spend now risks buying more users into a leaking habit loop—and making flat actives look healthier without fixing the underlying problem.

To: Leo, Head of Growth From: PM for Activation Subject: Diagnosis: Why WAU is flat and why we shouldn’t double paid acquisition yet

*

Executive Summary

WAU is not flat because of summer seasonality. It is flat because of a structural collapse in early habit retention starting in Week 5, which is currently masked by two temporary factors: the Week 6 win-back email campaign and higher sign-up volume.

Our core retained user base has dropped by over 3,200 users, and weekly churn has surged by 44% (from ~7,100 to over 10,200). Doubling paid acquisition today would pour money into an onboarding funnel that currently retains a third fewer users long-term than it did two months ago.

Here is what the data shows and what we should do instead.

---

1. The Evidence: The Week 5 Onboarding Change Broke Habit Retention

If summer outdoor seasonality were the culprit, we would expect a gradual, platform-wide decay across all cohorts. Instead, the cohort data reveals an immediate step-change break between Cohort 4 and Cohort 5:

• Cohorts 1–4 (Before Week 5): Week 4 retention was steady at 33.4%–34.2%, flattening to a healthy 30% at Week 8.
• Cohorts 5+ (After Week 5): Week 4 retention plummeted to 24.5%–25.0%, and Week 8 dropped to 19.9%.

This represents a ~33% relative drop in long-term cohort retention.

Why did this happen? In Week 5, we removed the goal-setting step ("What do you want to achieve, and how many days a week?") to cut sign-up time from 3 minutes to 1 minute. While sign-up completion jumped from 61% to 74% and bumped Week 1 retention slightly (55% to 58%), we stripped away the user’s commitment and personal investment.

Stride is a habit product. Without clear goals and a tailored weekly schedule, users drop off rapidly after Week 1 because they lack direction and accountability.

---

2. The Illusion: Why Topline WAU Looks Flat

If retention collapsed by a third, why hasn't WAU cratered? Two factors created an artificial floor:

1. Top-of-Funnel Inflow: Sign-ups grew ~30% (boosted by higher sign-up completion and the Week 9 paid budget increase), adding ~1,800 gross new sign-ups per week.
2. The Week 6 Win-Back "Sugar Rush": The win-back campaign added ~1,600 returning users per week (jumping from ~1,000 to ~2,600 in growth accounting).

However, this resurrected volume is extremely low-quality: * Historically, 41% of organic returning users were still active two weeks later. * For win-back users, only 12% remain active after two weeks.

We are cycling low-intent, discount-incentivized users who churn almost immediately. Meanwhile, underlying retained users dropped from 45,074 (Week 3) to 41,636 (Week 13), while churn surged from 7,116 to 10,279 per week.

---

3. What Happens If We Double Paid Acquisition Now?

Doubling paid acquisition right now will accelerate cash burn without growing the business:

• Impaired Unit Economics: With Week 8 retention down from 30% to 20%, LTV has dropped sharply. Premium conversion will suffer because fewer users build the 3-week habit required to see the value of paid features.
• Higher CAC for Diminishing Returns: Scaling paid spend when the conversion engine is degraded will cause CAC to rise while payback periods stretch unsustainably.
• A Leaky Bucket: In Week 13, we added 7,847 new users and churned 10,279. Adding more sign-ups does not fix a machine that is churning users faster than it can onboard them.

---

4. Recommended Action Plan

Before increasing ad spend, we need to plug the leak and fix activation.

1. Reinstate and Optimize Goal-Setting (Immediate): * Re-introduce the goal-setting and schedule-commitment step in onboarding, framed as building the user's "Personalized Weekly Plan." * Test progressive onboarding: let users quickly select goals without friction, but ensure their first workout calendar is anchored before Day 1. * Target: Return Week 4 retention to ≥33%. 2. Re-evaluate Win-Back & Lifecycle Spend: * Stop relying on the 21-day "free Premium week" email to prop up WAU. Shift CRM focus to Days 1–7 activation, reinforcing the weekly plan set during onboarding. 3. Hold Paid Social at Current Levels: * Keep paid spend flat (or pull back the Week 9 25% increase) until Cohort Week 3/4 retention recovers. 4. Scale Acquisition Once Activation Is Fixed: * Once Cohort Week 4 retention crosses 32% for two consecutive cohorts, we double paid acquisition. At that point, every dollar spent will generate 50% more long-term active users than it would today.