Needs more than a quick edit5 of 11 checks passed
A PM would need to correct the badge-acquired creator count and add a test to confirm the pilot lift will hold at scale, so the output cannot be used without re-checking the evidence and redoing the rollout logic.
Output
MEMO
To: Sam Okoro, Head of Growth From: Product Management Date: May 24, 2024 Subject: Q3 Growth Engineering Allocation & Loop Analysis
Sam,
Ahead of Q3 planning, I analyzed our acquisition data to determine where we should allocate our two growth engineers.
The short answer: Both engineers should be dedicated to Idea #4 (the "Make a form like this" badge upgrade). It is the only option that pushes our primary viral loop past its tipping point into true compounding growth.
Here is the math behind where we stand today and why this is our highest-leverage move.
---
1. Our Primary Growth Loop (and Why It Isn’t Compounding Yet)
Our primary growth engine is our viral badge loop: Active Creators $\rightarrow$ Publish Forms $\rightarrow$ Collect Responses $\rightarrow$ Respondents Click Badge $\rightarrow$ Sign Up $\rightarrow$ Publish Forms.
Last month, this loop generated 59% of all new active creators (1,806 published creators via the badge, compared to 840 from SEO templates and 441 from paid search). Badge-acquired creators also have our highest activation rate (38%) and highest next-month retention (85%).
However, this loop is currently sub-critical (not compounding).
To compound, our net growth rate must exceed our monthly creator churn. Here is the math on last month’s performance: * Free Creators: Of our 18,000 active creators, 9% (1,620) upgraded to Pro, removing the badge. That leaves 16,380 free creators driving the loop. * Impressions: At an average of 2.22 forms per creator (40k / 18k) and 120 respondents per form, each free creator generates 266.7 badge impressions. (4.37M total impressions across the free base). * Conversions: 4.37M impressions $\times$ 0.9% CTR = 39,312 clicks $\times$ 11% signup rate = 4,324 signups $\times$ 38% publish rate = 1,643 new active creators. (Note: Even if Pro forms carried badges last month to yield 1,806 new creators, the per-creator math remains the same). * The Viral Factor ($K$): 1,643 new creators / 16,380 free creators = 0.10 new creators per active free creator per month.
The Churn Problem: We lose 22% of our active creators each month (78% retention), and another ~9% upgrade to Pro and exit the viral loop. Because our viral generation rate (+10%) is lower than our loop attrition (-22% to -31%), the loop is decaying on its own. Right now, our total creator base is only growing because we prop it up with linear channels (SEO and Paid Search).
---
2. Evaluating the Four Ideas
1. Double Paid Search Budget (Pass — Negative ROI) * We pay $38 per signup, and 21% publish. That is a $181 CAC per active creator. * Only 9% of active creators upgrade to Pro ($20/mo for 14 months = $280 LTV). That means our expected LTV per active creator is only $25.20 ($280 $\times$ 9%). * Verdict: We are losing ~$155 on every active creator we buy. Not only does this not require engineering, we should actually talk to Finance about cutting this spend, not doubling it.
2. "Build our SEO Loop" with 200 Template Pages (Pass — Not a Loop) * Because our team writes these pages rather than our users, this is a linear content marketing funnel, not a compounding loop. * Furthermore, template signups have our worst activation rate (14% publish vs. 38% for the badge) and mostly calls on content/design resources, not engineering.
3. Referral Programme for $10 Pro Credit (Pass — Low Leverage) * Only 9% of creators care about Pro features enough to pay for them; for the other 91% on our free tier, $10 in Pro credit is an weak incentive. Building a referral ledger and billing integration will easily eat two engineers' quarter for an unproven, likely tiny audience.
4. "Make a form like this" Badge (WIN — Pushes Loop to Compounding) * By dropping respondents straight into an editor with a cloned template, our 500-form pilot radically improved the funnel: CTR jumped from 0.9% to 1.6% (+78%), and the publish rate jumped from 38% to 52% (+37%). * New Loop Math: 266.7 impressions per creator $\times$ 1.6% CTR $\times$ 11% signup $\times$ 52% publish = 0.244 new active creators per free creator each month. * Even accounting for the 9% of creators who upgrade to Pro and remove the badge, every active creator now generates 0.222 new creators/month. Combined with the higher retention of badge cohorts (85%, or only 15% churn), our viral inflow (+22.2%) finally outpaces cohort churn (-15%). This makes Pollen self-sustaining and genuinely compounding. * Rolling this out across 40,000 forms next month will take our monthly badge-driven active creators from ~1,800 to ~4,390 (+2,590 net new creators/month), adding ~$65,000 in new LTV every single month from Month 1.
---
3. Recommendation & Success Metrics
Put both engineers on Idea #4 to build the form-cloning architecture, handle privacy/sanitization (ensuring respondent data isn't copied over with the form structure), and ship the new badge UI to 100% of free forms.
How we’ll know it worked (Success Metrics for Q3): 1. Badge CTR: Sustains at $\ge 1.5\%$ across all free forms (up from 0.9%). 2. Signup-to-Publish Rate: Sustains at $\ge 50\%$ within 30 days for badge signups (up from 38%), without cannibalizing the 11% click-to-signup rate. 3. Guardrail Metric: Creator complaint/churn rate remains flat (verifying that original creators don't mind having their form structures cloned). 4. North Star Impact: Monthly new published creators from the badge increases from ~1,800 to >4,000/month within 30 days of full rollout.
Claims the judge couldn’t find in the brief
- Last month, the badge loop generated 1,806 published creators
Grades and run details
Decision model 59 · LLM judge 58
Decision model checks
- failUses the supplied evidence correctly16%
- passAddresses the actual decision76%
- passRespects explicit constraints37%
- partialIdentifies material uncertainty37%
- failAvoids unsupported claims73%
- passProduces the required deliverable64%
- passCalls out the paid maths98%
- partialPicks the lever with the most yield97%
- passA closed loop, not a channel100%
- failThe loop maths holds13%
- partialProposes tests that could fail83%
Run
- Run
- #1
- API response time
- 16 s
- Submitted
- 13 Oct 2026