Needs more than a quick edit9 of 11 checks passed
The memo contains an unsupported equilibrium number (10,700) and an unsupported claim about rising cost per sign-up, so a PM would need to re-check those parts before using it.
Output
To: Sam Okoro, Head of Growth From: [PM], Growth Re: Our growth loop, and where the two engineers should go next quarter
Summary: Our primary loop is the badge. Today it does not compound, and the active creator base is shrinking. The "Make a form like this" pilot is the only one of the four ideas that could make it compound. Both engineers should ship it properly, with a holdout. We should not double paid search.
1. The loop
Creators publish forms → respondents see the badge → some respondents become creators → they publish forms.
Last month the loop worked like this: - 40,000 forms × 120 respondents = 4.8M respondents - 0.9% clicked the badge = 43,200 clicks - 11% of clicks signed up = 4,752 sign-ups - 38% of sign-ups published = 1,806 new publishing creators
The badge is our largest source of creators. Templates produced 840 publishers and paid search 441. Badge creators also retain best: 85% are active the next month, against 71% for templates and 64% for paid.
2. Is it compounding? Not yet.
Each active creator produces about 267 respondents a month, which yields 0.10 new publishers per creator per month. With 78% monthly retention, a creator stays about 4.5 months. Over that lifetime, each creator brings in about 0.46 new creators.
A loop compounds only when this number exceeds 1. At 0.46, the badge amplifies our other channels by about 1.8×, but it cannot sustain itself.
The overall picture is worse: - We keep 14,040 of last month's 18,000 active creators. - We add about 3,100 new publishers. - That gives about 17,100 active creators, a 5% monthly decline. - At current rates the base settles at roughly 10,700 creators.
This assumes the 78% retention figure covers the whole base, which is how I read the data.
3. The four ideas
Double paid search: no. - Each sign-up costs $38. Only 21% publish, so each publishing creator costs about $181. - Each publisher is worth about $25 in revenue (9% upgrade × $20 × 14 months). - Adding the loop's downstream creators raises that to only about $46. - Doubling spend would add about 440 publishers a month for an extra $80k a month, and cost per sign-up usually rises with spend. - This idea doesn't need engineers. I'd ask Finance to hold the budget rather than spend it because it's approved.
200 more template pages: not now. - This is not a loop, because new creators don't create more pages. Our team writes them, so output grows only as fast as we write. - We don't know how many pages produce today's 6,000 sign-ups, so we can't estimate the yield. - Templates publish at only 14%. - This is mainly content work, not engineering work.
Referral credit: no. - It rewards sign-ups, not publishing, which invites low-quality and fake sign-ups. - $10 of Pro credit means nothing to the 91% of creators who never upgrade.
"Make a form like this": yes. The pilot changed every stage of the loop:
| Current badge | Pilot | |
|---|---|---|
| Click rate | 0.9% | 1.6% |
| Sign-up rate | 11% | 11% |
| Publish rate | 38% | 52% |
| New publishers per 1,000 respondents | 0.38 | 0.92 |
At network scale, that would mean about 4,400 badge publishers a month instead of 1,800. Each creator's lifetime yield would rise from 0.46 to about 1.1, so the loop would start to compound. Next month's active base would be about 19,700 instead of 17,100.
The margin is thin. The loop reaches the break-even of 1.0 at 0.83 publishers per 1,000 respondents. The pilot beat that by only about 10%. We also need to treat the pilot result with caution: - It covered 500 forms, which may not be representative. - It ran for two weeks, so check whether the 30-day publish window had fully elapsed. - We have no next-month retention data for these creators. People who copy a form may be less committed than people who build one.
4. What the engineers build
1. Staged rollout with a 20% holdout of forms on the old badge, randomised by form and run for at least 8 weeks so we see 30-day publishing and next-month retention. 2. Creator controls and safety: - Copies take the form structure only, never responses. - Creators can turn off copying for sensitive forms. 3. Instrumentation for each stage: click, sign-up, publish, next-month activity, and Pro upgrade. Results should be split by form type so we learn which forms spread best.
5. How we'll know it worked
Primary metric: new publishing creators per 1,000 respondents, treatment vs holdout. - Ship to 100% if it stays at or above 0.83, the level needed for the loop to compound. - Below about 0.6, the change is still positive but the loop won't compound. We would keep it and look for other levers.
Quality checks: - Next-month retention of copy sign-ups should be at least 70%. If it falls much lower, the extra volume won't last. - The upgrade rate of these creators to Pro should be close to 9%.
Guardrails: - Form completion rate is unchanged. - Creator complaints and copy opt-outs are low. - Pro upgrade rate across the base is unchanged.
Business outcome: the active creator base grows month on month by the end of the quarter, instead of falling about 5%.
Bottom line: paid search and templates rent growth one sign-up at a time. The copy-this-form change is our one realistic chance to make growth compound, and a proper rollout will tell us within a quarter whether it does.
Claims the judge couldn’t find in the brief
- At current rates the base settles at roughly 10,700 creators.
- Cost per sign-up usually rises with spend.
Grades and run details
Decision model 91 · LLM judge 9 of 12 checks
Decision model checks
- passUses the supplied evidence correctly27%
- passAddresses the actual decision100%
- passRespects explicit constraints33%
- passIdentifies material uncertainty100%
- partialAvoids unsupported claims44%
- passProduces the required deliverable88%
- passCalls out the paid maths99%
- passPicks the lever with the most yield98%
- passA closed loop, not a channel100%
- passThe loop maths holds11%
- partialProposes tests that could fail52%
Run
- Run
- #1
- Time to output
- 55 s
- Submitted
- 2 Oct 2026