Tasks / Growth

Write a GTM plan

Can the model pick the customers who value the difference most, position against what they do today, and build a go-to-market that lasts beyond launch day?

Task type v1.1 · 2 tasksLast changed 6 Oct 2026 · ChangelogDifficulty

What AI gets right here, and what you’ll still have to catch

From 16 graded outputs by 8 models. 50% were usable with at most a quick edit.

Reliably right

  1. Positioned against the real alternative100% pass
    It names the real alternatives (accountant-run payroll with mistakes, owner spreadsheet with risk) and ties the message to confidence and accuracy that those alternatives lack.
    GPT-6 Astra · ChatGPT · Payroll, for the people who fear it
  2. Protects the self-serve engine100% pass
    Uses the 70% free-to-paid stat and product-qualified deal data to argue against capping the free plan, and keeps self-serve open.
    GPT-6 Astra · ChatGPT · Enterprise, without killing the engine
  3. Does the capacity sums100% pass
    Works out deals needed (69-80), qualified opportunities (134), and AE-years (8) with checkable arithmetic.
    GPT-6 Astra · ChatGPT · Enterprise, without killing the engine

Where it slips

  1. Avoids unsupported claims47% pass
    Presents the incorrect 'five of six no decision' figure as established fact, which is an unsupported claim about the current situation.
    Opus 5.5 · Claude · Enterprise, without killing the engine
  2. Uses the supplied evidence correctly52% pass
    The claim 'Five of our six losses on existing-user deals ended in no decision' is not supported by the data (4 no-decision, 2 Miro), so a statement about the current situation is invented.
    Opus 5.5 · Claude · Enterprise, without killing the engine
  3. Identifies material uncertainty73% pass
    The plan does not name specific unknowns that could change the decision, nor does it say how they would be resolved or what would trigger a pivot.
    Gemini 3.8 Flash · API · Payroll, for the people who fear it

How it’s graded

Each check is built on how world-class product and growth leaders do this work, as they’ve described it on Lenny’s Podcast, and names the leader it comes from.

  1. Positioned against the real alternative

    Does the plan name what the target customer does today without this product (including the status quo or doing nothing), and tie the message to the value that alternative lacks?

    Passes when Names the real alternative and the differentiated value against it, and picks the segment that cares most about that value.

  2. Sells against a pain the buyer feels

    Is the core message built on a pain or risk the target buyer already feels, with evidence from the material, rather than on generic upside like saving time?

    Passes when Leads with the pain the evidence shows buyers care about, and uses that evidence to choose the message.

  3. Diagnoses message or channel first

    Does the plan work out whether the problem is the message (people reach it but don't convert) or the channels (the right people never see it), and spend accordingly?

    Passes when Uses conversion and reach data to say which it is, and puts the effort there.

  4. Plans beyond launch week

    Does the plan say how demand keeps coming after launch, with the ongoing engine and what's measured over months, rather than treating launch day as the whole plan?

    Passes when Gives the ongoing motion after launch and the measures that show whether it's working over time.

Plus our standard checks

Uses the supplied evidence correctly · Addresses the actual decision · Respects explicit constraints · Identifies material uncertainty · Avoids unsupported claims · Produces the required deliverable · and 3 written for each task, which you’ll see in the tasks below.

The tasks

Read the brief, then compare up to three outputs, each with the LLM judge’s verdict on every check. Highlights mark what a PM had to fix.

The brief

You're the VP Product at Flowboard. The board wants $5M of new enterprise ARR next year, and our CRO, Jordan Hale, has drafted the enterprise go-to-market below. The CEO has asked for your version before the board meeting: who we sell to, how the self-serve product and the sales team work together, what we say against the alternatives, the capacity it takes, and what you'd change in Jordan's plan and why. No more than 1,300 words. The files are attached.

What the model was given6 items: About Flowboard, today.md, cro_enterprise_plan.md, enterprise_deals_last_12_months.csv, large_companies_using_flowboard.csv (companies over 1,000 employees with active self-serve or free teams), enterprise_win_loss_interviews.md
About FlowboardOnline whiteboards and diagramming for teams. Free plan, self-serve paid plans, and an enterprise plan sold by a small sales team.
today.md5 lines · Download
# Today

- Self-serve: 31,000 paying teams; free plan feeds 70% of new paying teams.
- Enterprise: 46 customers, average contract $64,000.
- Sales team: 3 account executives, closing about 10 enterprise deals a year each.
cro_enterprise_plan.md8 lines · Download
# Enterprise plan (CRO, draft for the board)

Target: $5M new enterprise ARR next year.
1. Cap the free plan at 3 users (today: unlimited users, 3 boards each), so teams have to talk to us.
2. Route every team over 10 seats to sales; remove self-serve checkout above 10 seats.
3. Hire 8 account executives and 6 SDRs; SDRs work outbound lists of Fortune 2000 companies.
4. Enterprise features: SSO, SCIM, audit logs, data residency.
…
enterprise_deals_last_12_months.csv65 rows · Download
deal,source,outcome,sales_cycle_days,acv_usd,lost_to
E-200,Outbound,won,201,32700,
E-201,Product-qualified (teams already using Flowboard),won,62,97000,
E-202,Product-qualified (teams already using Flowboard),won,61,108000,
E-203,Outbound,lost,192,,Miro (company standard)
E-204,Outbound,lost,204,,Miro (company standard)
E-205,Product-qualified (teams already using Flowboard),won,77,54200,
…
large_companies_using_flowboard.csv (companies over 1,000 employees with active self-serve or free teams)company,employees,teams_using_flowboard,active_users_30d,paying_seats,viewed_security_page_30d,asked_for_sso Aldergate Bank,15000,2,18,10,yes,yes Brightfield Bank,2400,6,54,36,yes,yes Corvel Logistics,15000,5,45,22,yes,yes Dunmore Holdings,4800,3,12,4,yes,yes Eastlake Health,1200,3,30,14,yes,yes Fennick Holdings,4800,8,48,30,yes,yes Galloway Retail,9000,9,36,20,yes,no Hartwell Group,1200,4,48,21,yes,no Iverson Retail,1200,3,18,9,yes,no Juniper Retail,1200,3,24,10,yes,no Kestrel Logistics,4800,1,12,6,yes,no Linton Group,1200,2,10,4,no,no Marlowe Group,2400,2,10,7,no,no Northcote Retail,9000,2,10,6,yes,no Oakhurst Group,9000,3,36,18,yes,no Pemberton Health,1200,1,6,2,yes,no Quayside Bank,4800,2,12,4,no,no Redfern Group,15000,3,18,10,no,no Stanway Health,9000,3,30,12,no,no Thornbury Bank,15000,3,24,12,no,no Upton Bank,9000,3,33,23,yes,no Varden Bank,2400,3,12,5,no,no Whitmore Bank,4800,2,8,5,no,no Yardley Logistics,15000,2,8,4,yes,no
enterprise_win_loss_interviews.md5 lines · Download
# Enterprise win/loss interviews (12 buyers, this year)

- Won (7): every win had teams already using Flowboard. "Our designers refused to give it up." "IT approved it because 300 people were already on it."
- Lost (5): four had standardised on Miro company-wide; switching meant migrating thousands of boards. One stayed on whiteboard photos and slides.
- What buyers said Flowboard does that Miro doesn't: real-time diagramming that stays tidy, and a free plan teams can start on without IT.
What a strong answer doesThe answer key the graders mark against

Builds enterprise sales on top of the self-serve engine instead of throttling it. The deals file shows product-qualified deals (teams already using Flowboard) won 19 of 25 at an average of about $72,600 and about 63 days, against outbound winning 4 of 25 at about $36,800 and about 190 days; product-qualified wins were about $1.38M of the $1.86M won. The free plan feeds 70% of new paying teams. So capping the free plan at three users and removing self-serve checkout above ten seats would choke the pipeline the enterprise business depends on, and the interviews say IT approved Flowboard because teams were already on it. Proposes product-led sales: AEs work the large-company list (multiple teams, SSO requests, security-page visits) with SSO and admin controls as the bridge, while keeping self-serve open. Positions against Miro and the status quo, not 'visual collaboration for the enterprise': where a company has standardised on Miro, don't lead with a migration; win where teams already use Flowboard, on tidy real-time diagramming and starting without IT. Reads outbound's poor results as a message problem as well as a channel one. Works out capacity: $5M at about $72,000 is about 70 deals, far more than three AEs close (about 30 a year), so it needs AE hiring focused on product-qualified accounts rather than SDR outbound lists. Plans the ongoing motion and the measures (product-qualified accounts, conversion, cycle time) beyond the first quarter.

Critical failures (cap the score at 40)
  • Endorses capping the free plan at three users or removing self-serve checkout above ten seats
Task

Staff-level · v1.0

The outputs

8 setups answered this brief.

Needs more than a quick edit10 of 13 checks passed

The output contains multiple factual errors in the deal data (product-qualified ACV, sales cycle, total won) that would require re-checking the CSV and correcting the numbers before a product manager could rely on it.

Output

Flowboard enterprise plan: turn team adoption into governed company adoption

Recommendation: Keep the $5M target, but build a product-led enterprise motion—not a cold-outbound motion powered by restrictions on self-serve. Sell first to companies where teams already depend on Flowboard, then help an internal champion bring IT and procurement along.

The target is achievable only if we generate substantially more qualified opportunities and ramp sales capacity early. Neither is proven today; the board should approve a milestone-based investment, not treat $5M as an assured forecast.

1. What the evidence says

The last 12 months of deals show markedly different economics:

SourceWon / opportunitiesWin rateAverage won ACVAverage won sales cycle
------:---:---:---:
Existing product users19 / 2576%$72.6K63 days
Inbound demo requests6 / 1540%$55.1K86 days
Outbound4 / 2516%$36.8K190 days

These are small, non-random samples—not guarantees—but the direction is compelling. Product-qualified wins are nearly twice the size of outbound wins and close in one-third the time. The interviews reinforce the pattern: all seven interviewed winners already had teams using Flowboard; four of five losses had standardized on Miro.

Our advantage is existing user commitment plus differentiated diagramming, not a generic enterprise feature list.

2. Who we sell to

Primary ICP: Large companies with multiple active Flowboard teams, recurring diagramming or visual collaboration work, and a reason to consolidate purchasing or introduce governance.

Employee count helps establish potential, but adoption and buying intent should determine priority. We should not infer a winning industry segment from this small dataset.

Prioritize accounts using three signals:

  • Adoption: active users, multiple teams, usage growth and repeat collaboration.
  • Intent: SSO requests, security-page visits and explicit procurement questions.
  • Commercial potential: a credible departmental rollout, sponsor and budget—not simply total employees.

Start with Brightfield Bank, Fennick Holdings, Corvel Logistics and Eastlake Health: each has multiple teams, meaningful activity, security interest and an SSO request. Aldergate Bank and Dunmore Holdings also merit immediate discovery, but their smaller active footprints make rollout potential less certain. Security-interested accounts such as Hartwell, Galloway and Upton form a second wave.

Map the buying group: a user champion, a departmental budget owner, and IT/security/procurement. Sell an initial governed deployment around demonstrated demand, with an expansion path.

The 24 listed companies are a starting queue, not sufficient pipeline. Even if all became qualified opportunities, applying the historical 76% win rate and $70K incremental ARR assumption yields only about $1.3M. We must discover many more qualified accounts across the installed base.

3. How self-serve and sales work together

Keep free adoption and self-serve checkout open. Free supplies 70% of new paying teams, and buyers explicitly value starting without IT. Capping free at three users would damage the mechanism that creates our strongest enterprise opportunities.

Likewise, crossing ten seats should trigger an optional sales-assist offer, not a purchasing barrier. Seat count alone does not establish enterprise need.

Build an account-level product-qualified motion:

  1. Aggregate teams by company domain, with appropriate access and privacy controls.
  2. Score sustained usage, multi-team adoption, growth and governance intent.
  3. Offer relevant help in-product: “Bring your teams together with centralized administration and security.”
  4. Route high-intent accounts to sales promptly; nurture lower-intent accounts while preserving checkout.
  5. Equip AEs with an account adoption summary and a champion toolkit: rollout proposal, security documentation and an economic justification.

Sales should close the governance and purchasing gap, not force users through one. Customer success then drives onboarding, broader adoption and expansion.

Keep Jordan’s SSO, SCIM, audit logs and data-residency direction, but sequence delivery against buyer requirements. Establish a minimum enterprise-readiness package first; validate residency demand and delivery cost before committing to regions. These capabilities enable procurement; they are not our differentiation.

4. What we say against alternatives

Replace “The visual collaboration platform for the enterprise” with:

> Real-time diagramming that stays tidy—now governed for the teams already relying on it.

  • Against Miro: Lead with diagramming and demonstrated user preference. Where Miro is entrenched, propose an approved specialist deployment rather than company-wide replacement. Do not assume customers will migrate thousands of boards.
  • Against slides and whiteboard photos: Demonstrate a live, editable shared diagram for one recurring workflow. Prove improved collaboration through a bounded pilot rather than unsupported productivity claims.
  • Against no decision: Establish the sponsor, purchase trigger and rollout outcome early. Enterprise governance must solve a current problem, not merely add features to a pitch.

5. Revenue, pipeline and capacity

Define the board target as incremental enterprise ARR added next year, excluding self-serve ARR already paid by teams that convert. Report new logos, conversion uplift and existing-enterprise expansion separately; do not count the same revenue twice.

Historical product-qualified ACV is $72.6K, but we do not know the existing self-serve revenue attached to those wins. For planning, use $70K incremental ARR per win as an assumption to validate.

  • $5M requires 72 wins at $70K.
  • At the historical 76% product-qualified win rate, that requires approximately 95 qualified opportunities.
  • Target 105–110 qualified opportunities, allowing some execution cushion.
  • At today’s ten annual wins per fully productive AE, 72 wins require 7.2 fully productive AE-years.

Three current AEs provide approximately 30 wins. Eight new AEs averaging six wins each during their first year would add 48: 78 wins and $5.46M at the assumed incremental deal size.

Thus, Jordan’s eight AE hires can be justified—but only with early hiring, sufficient pipeline and a credible ramp. At five wins per new AE, we reach only 70 wins, or $4.9M. Smaller incremental contracts or slower qualification would widen the shortfall.

Hire in Q1 against explicit pipeline and ramp gates. Start with two SDRs focused on installed-base account development, not six running broad Fortune 2000 lists. Provide named solutions/security support and customer-success capacity for enterprise onboarding. Product, engineering and data capacity must also fund account identification, routing and enterprise readiness.

6. What changes in Jordan’s plan—and how we govern it

I would:

  • Reject the free-user cap: it weakens our strongest acquisition advantage.
  • Reject mandatory sales above ten seats: it introduces friction without proving enterprise demand.
  • Redirect outbound toward adopted accounts: historical cold outbound is slower, smaller and less successful.
  • Retain AE investment conditionally: capacity is necessary, but cannot substitute for qualified demand.
  • Keep governance features; sharpen positioning: security gets us approved; tidy real-time diagramming gets us chosen.

In the first 90 days, instrument account-level adoption, validate incremental contract economics, engage the six SSO-requesting accounts and establish the qualified-pipeline trajectory. Track incremental ARR, source-level conversion, sales cycle, AE ramp, rollout adoption and self-serve conversion/retention.

If those indicators do not support the hiring and revenue assumptions, reforecast openly. We should not manufacture enterprise “leads” by breaking the product-led engine.

Claims the judge couldn’t find in the brief

  • Existing product users average won ACV $72.6K
  • Existing product users average won sales cycle 63 days
  • Product-qualified wins were about $1.38M of the $1.86M won

Grades and run details

Decision model 100 · LLM judge 71
Decision model checks
  • passUses the supplied evidence correctly31%
  • passAddresses the actual decision91%
  • passRespects explicit constraints29%
  • passIdentifies material uncertainty97%
  • passAvoids unsupported claims52%
  • passProduces the required deliverable82%
  • passFollows the deals data100%
  • passProtects the self-serve engine100%
  • passDoes the capacity sums98%
  • passPositioned against the real alternative100%
  • passSells against a pain the buyer feels60%
  • passDiagnoses message or channel first82%
  • passPlans beyond launch week100%
Run
Run
#1
API response time
73 s
Submitted
5 Oct 2026

Check by check

Open a check to read the judge’s reasons. “Mixed” means the two graders disagreed.

Mixed 3

Uses the supplied evidence correctlyMixed

The output misstates product-qualified average ACV ($72.6K vs actual $68.7K), sales cycle (63 days vs 70 days), and total won amounts ($1.38M/$1.86M vs $1.30M/$1.78M), so it does not use the supplied evidence correctly.

Avoids unsupported claimsMixed

It presents incorrect deal averages and total won figures as established facts from the data, when the evidence does not support those exact numbers.

Follows the deals dataMixed

Although it compares by source, the computed product-qualified ACV and sales cycle are wrong, so it does not correctly follow the deals data.

Got right 10

Addresses the actual decisionRight

The output commits early to a product-led enterprise motion, says what to change in Jordan's plan, and states that if pipeline and ramp indicators don't support assumptions, reforecast openly.

Respects explicit constraintsRight

The output stays within ~1,200 words, addresses all requested topics, and explicitly rejects capping the free plan or removing self-serve checkout, respecting the implicit constraint from the test.

Identifies material uncertaintyRight

It names pipeline, AE ramp, and incremental contract economics as unproven, bounds them with milestone-based investment, and says what would change the call.

Produces the required deliverableRight

The output is a complete plan under 1,300 words, addressed to the CEO, covering all required elements and usable with light edits.

Protects the self-serve engineRight

It uses the 70% free-plan contribution and product-qualified deal data to argue against capping free or forcing sales above 10 seats, and keeps self-serve open.

Does the capacity sumsRight

It works out 72 wins needed at $70K, 95 qualified opportunities, and AE capacity (3 current + 8 new with ramp) to reach ~$5.46M, with checkable sums.

Positioned against the real alternativeRight

It names Miro, slides/whiteboard photos, and no decision as alternatives, and ties the message to tidy real-time diagramming and governed adoption for teams already using it.

Sells against a pain the buyer feelsRight

The core message leads with governance for teams already relying on Flowboard, directly addressing the pain of ungoverned adoption and IT approval risk shown in interviews.

Diagnoses message or channel firstRight

It diagnoses that cold outbound to Fortune 2000 is the wrong channel (low win rate, long cycle) and shifts effort to product-qualified accounts and a message around diagramming, not generic enterprise features.

Plans beyond launch weekRight

It describes an ongoing product-qualified motion with account scoring, sales assist, customer success expansion, and lists metrics (incremental ARR, conversion, cycle, ramp, adoption) to track over time.

Results

Every setup we’ve tested on this task type, across all its tasks and repeats, graded on the current checklist. Calibrated.

#Model · HarnessTask scoreDecision modelLLM judgeRunsCritical failures
1GPT-6 AstrawithChatGPT100.0100.02None
2Opus 5.5withClaude96.085.22None
3GPT-6 LunawithAPI94.289.32None
4GPT-6.1 SolwithAPI93.878.02None
5Sonnet 5.5withAPI98.177.72None
6Haiku 5.5withAPI94.277.72None
7Gemini 3.8 FlashwithAPI73.981.92None
8Gemini 3.5 Flash-LitewithGemini74.263.52None

What you get for the cost

No setup scores within 5 points of the leader at half its cost or less here, so the leader is also the best value.

Task score against relative cost for each setup. The table below has the same figures.607080901001×3×10×30×100×Cost per output, relative to the cheapest setup (log scale) →↑ Task scoreGPT-6 Astra · ChatGPT: task score 100, 81× the cheapestOpus 5.5 · Claude: task score 91, 75× the cheapestGPT-6 Luna · API: task score 90, the cheapestGPT-6.1 Sol · API: task score 84, 16× the cheapestSonnet 5.5 · API: task score 84, 46× the cheapestHaiku 5.5 · API: task score 82, 3.3× the cheapestGemini 3.8 Flash · API: task score 77, 11× the cheapestGemini 3.5 Flash-Lite · Gemini: task score 68, 3.5× the cheapestGPT-6 Astra · ChatGPTOpus 5.5 · ClaudeGPT-6 Luna · APIGPT-6.1 Sol · APISonnet 5.5 · APIHaiku 5.5 · APIGemini 3.8 Flash · APIGemini 3.5 Flash-Lite · Gemini
Nobody beats these on both score and cost
Task score and relative cost by setup
SetupTask scoreRelative cost (cheapest = 1)
GPT-6 Luna · API901.0×
Haiku 5.5 · API823.3×
Gemini 3.5 Flash-Lite · Gemini683.5×
Gemini 3.8 Flash · API7711×
GPT-6.1 Sol · API8416×
Sonnet 5.5 · API8446×
Opus 5.5 · Claude9175×
GPT-6 Astra · ChatGPT10081×

Cost is each output’s tokens at the model’s list price, shown relative to the cheapest setup. Runs done in an app have no usage meter, so theirs are estimated from the same setup’s measured runs. How we compare cost

About the task

The PM job

Taking a product or add-on to market with marketing and sales.

Why it matters

Launch plans fail by trying to reach everyone, by selling upside nobody feels, and by treating launch day as the whole plan.

What good looks like

  • One primary segment: those who value the difference most
  • Positions against what customers do today
  • Sells against a pain the buyer feels, with evidence
  • Diagnoses whether the problem is the message or the channel
  • Plans beyond launch week

Deliberately not measured

  • Creative copywriting quality
Capability tested

Go-to-market judgement

The failure we’re looking for

Every channel, every segment, and nothing after launch day

Grading

Decision model and LLM judge, calibrated against a blind PM review