Needs more than a quick edit10 of 11 checks passed
The memo omits a numeric success threshold for the experiment, so a PM would need to define one before acting; otherwise the reasoning is sound and the evidence is correct.
Output
To: Sam Okoro, Head of Growth From: Product Subject: Put both engineers on the respondent-to-creator loop
Recommendation
Use both engineers to ship and validate “Make a form like this.” It strengthens our existing growth loop, has encouraging experimental evidence, and attracts creators who historically activate and retain better than creators from other channels. Don’t double paid search or build a referral programme next quarter. Keep existing SEO acquisition running, but don’t call 200 team-written pages a growth loop.
Our primary loop—and whether it compounds
Our loop is:
Creator publishes → respondents encounter Pollen → some become creators → those creators publish → more respondents encounter Pollen.
The badge connects product usage to new acquisition. SEO and paid search feed creators into that loop; they are not themselves loops. Team-written template pages don’t automatically generate more template pages.
At last month’s volume, 40,000 forms × 120 respondents implies 4.8 million respondent encounters. Applying the badge funnel gives:
| Monthly output | Current badge | Proposed badge* |
|---|---|---|
| --- | ---: | ---: |
| Clicks | 43,200 | 76,800 |
| Sign-ups | 4,752 | 8,448 |
| New publishing creators | 1,806 | 4,393 |
| Active again the following month | 1,535 | 3,734 |
Assumes pilot conversion rates hold at scale and new creators retain at the historical badge cohort’s 85% rate. These are illustrative ceilings if some of the 4.8 million encounters are on Pro forms without badges; actual forecasts must use badge-visible encounters.
The loop recurs, but we have not demonstrated self-sustaining compounding. Each existing active creator generates approximately 0.10 new publishing creators per cycle under the current funnel, or 0.085 who remain active the following month. Meanwhile, 22% of existing active creators lapse—about 3,960 of an 18,000-creator base.
The proposed experience raises those figures to approximately 0.244 new publishers and 0.207 subsequently retained creators per existing creator. That approaches churn replacement, but does not establish durable compounding. Activation and retention occur over different windows, so this is a replacement diagnostic, not an exact monthly growth forecast. Pro upgrades also remove badges, reducing future distribution.
Why this beats the alternatives
- Paid search is economically unattractive on the supplied numbers. Its $38 sign-up cost becomes approximately $181 per publishing creator. Expected lifetime revenue per publishing creator is only $25.20: 9% upgrade × $20 × 14 months, before costs. Finance approval doesn’t fix that gap.
- SEO produces useful acquisition, but the marginal return is unknown. Existing pages generated 840 publishers, versus roughly 1,806 from the badge. We don’t know what 200 additional pages would deliver, and their production remains dependent on our team.
- Referral credit rewards the wrong milestone. Paying for sign-ups invites low-intent referrals and abuse. We have no evidence of referral demand or incremental retained creators.
- The badge pilot improves two stages: clicks rise from 0.9% to 1.6%, and publishing from 38% to 52%. Together, that is 2.43× more publishers per respondent, not merely better click-through.
Engineering allocation and success criteria
Assign one engineer to the copy-to-editor experience and one to experimentation, instrumentation, and rollout safeguards, working as a single team. Copy only reusable form structure—not responses or sensitive data—and provide appropriate creator controls.
Run a persistent randomized experiment, assigned by creator to avoid mixing experiences across their forms. Measure actual badge-visible encounters, not total respondents.
Primary metric: incremental next-month-active creators per 100,000 badge-visible encounters. The baseline is approximately 32; the pilot implies 78, if retention holds. Track clicks, sign-ups, and 30-day publishing as diagnostic metrics, not the final win.
Wait for the activation and subsequent retention windows to mature. Check respondent completion, creator complaints, copied-form publishing quality, Pro conversion, and badge exposure lost through upgrades. Attribute downstream acquisition consistently and test for cannibalization of other channels.
Success means a statistically credible increase in retained creators without material guardrail deterioration. At full illustrative exposure, the opportunity is roughly 2,200 additional retained creators per monthly cohort. Separately, claim compounding only when observed cohort reproduction—including repeat publishing, churn, and badge removal—demonstrably exceeds replacement.
Grades and run details
Decision model 91 · LLM judge 10 of 12 checks
Decision model checks
- passUses the supplied evidence correctly35%
- passAddresses the actual decision99%
- passRespects explicit constraints38%
- passIdentifies material uncertainty90%
- passAvoids unsupported claims39%
- passProduces the required deliverable76%
- passCalls out the paid maths100%
- passPicks the lever with the most yield95%
- passA closed loop, not a channel100%
- partialThe loop maths holds15%
- partialProposes tests that could fail78%
Run
- Run
- #1
- API response time
- 54 s
- Submitted
- 2 Oct 2026