Tasks / Strategy

Price and package a product

Can the model price on the value each kind of customer gets, using real usage and willingness-to-pay data, and get existing customers there?

Task type v1.1 · 2 tasksLast changed 6 Oct 2026 · ChangelogDifficulty

What AI gets right here, and what you’ll still have to catch

From 16 graded outputs by 8 models. 56% were usable with at most a quick edit.

Reliably right

  1. Doesn't trust the price test100% pass
    Names the 59/41 split mismatch, holiday timing, and small sample; does not rest the decision on the test.
    Opus 5.5 · Claude · Unlimited pages, falling margins
  2. Plans the renewals100% pass
    Addresses each enterprise renewal with its date and note, including Copperfield in January, Northwind's tripled volume, and Arcadia's competitor evaluation.
    Opus 5.5 · Claude · Unlimited pages, falling margins
  3. Each tier for a different buyer94% pass
    Each tier names its buyer (startups, mid-market, enterprise) and is priced on distinct value: startups protected, mid-market overage on heavy users, enterprise per-page with unlimited seats.
    Opus 5.5 · Claude · Unlimited pages, falling margins

Where it slips

  1. Uses the supplied evidence correctly34% pass
    Total MRR is stated as $11,670 (actual $11,820), and median 'getting expensive' for small agencies is given as about $37 (actual $33) and for agencies as about $55 (actual $51).
    Haiku 5.5 · API · Fifteen dollars for everyone
  2. Gets the base of every number right41% pass
    MRR total and two segment‑level median getting‑expensive figures are incorrectly computed from the supplied data.
    Haiku 5.5 · API · Fifteen dollars for everyone
  3. Avoids unsupported claims52% pass
    Median getting‑expensive values and total MRR are presented as fact but are not supported by the data; these are facts about the current situation, not labelled as assumptions.
    Haiku 5.5 · API · Fifteen dollars for everyone

How it’s graded

Each check is built on how world-class product and growth leaders do this work, as they’ve described it on Lenny’s Podcast, and names the leader it comes from.

  1. Each tier for a different buyer

    Is each plan built for a distinct kind of buyer, with what that buyer values, rather than more-of-the-same at a higher price?

    Passes when Every tier names its buyer and the value it's priced on, and includes what that buyer needs and the lower tier's buyer doesn't.

  2. Priced on willingness to pay

    Are the proposed prices grounded in evidence of what each kind of customer would pay and the value they get, rather than in cost-plus, competitors alone or a round-number rise?

    Passes when Uses the willingness-to-pay and value evidence in the material to set each price, and says where the evidence is thin.

  3. Moves existing customers fairly

    Does the proposal say how existing customers move to the new pricing (who changes first, with what notice, and the value that justifies it)?

    Passes when A transition plan: new customers first or a set notice period for existing ones, tied to value delivered, with how churn will be watched.

Plus our standard checks

Uses the supplied evidence correctly · Addresses the actual decision · Respects explicit constraints · Identifies material uncertainty · Avoids unsupported claims · Produces the required deliverable · Gets the base of every number right · and 3 written for each task, which you’ll see in the tasks below.

The tasks

Read the brief, then compare up to three outputs, each with the LLM judge’s verdict on every check. Highlights mark what a PM had to fix.

The brief

You're the Head of Product at Parsewell. Our CFO, Tom Reyes, wants every price up 30% in January, seats and enterprise contracts alike, citing the price test below. Our CEO has asked you for the alternative: a new pricing model, what it does to each kind of customer and to gross margin, how we get there (including the enterprise renewals), and what you make of the price test. No more than 1,300 words, with a table of the model and its effect by segment. All of our accounts are in the usage export. The files are attached.

What the model was given7 items: About Parsewell, current_pricing.md, usage_last_30_days.csv (every account), price_test_readout.md, enterprise_contracts.md, competitor_pricing.md, cfo_note.md
About ParsewellAn API that extracts structured data from documents (invoices, claims, bills of lading). Developers integrate it; customers are charged as described in the pricing file.
current_pricing.md5 lines · Download
# Current pricing

- Self-serve: $99 per seat per month. A seat is a developer or admin with access to the dashboard. Unlimited pages.
- Enterprise: annual contracts, priced per seat at a negotiated discount. Unlimited pages.
- Cost to serve: about $0.0012 per page (model inference and storage), and falling about 10% a quarter.
usage_last_30_days.csv (every account)account,segment,seats,pages_last_30d,revenue_last_30d_usd,cost_to_serve_last_30d_usd,gross_margin_usd Northwind Logistics,Enterprise (contract),12,4820000,3200,5784,-2584 Halden Insurance,Enterprise (contract),9,3960000,2600,4752,-2152 Arcadia Health,Enterprise (contract),15,3310000,4500,3972,528 Brightwater Bank,Enterprise (contract),10,2740000,3000,3288,-288 Copperfield Freight,Enterprise (contract),8,2380000,2400,2856,-456 Meridian Claims,Enterprise (contract),11,2150000,3300,2580,720 Mid-market A,Mid-market (self-serve),5,166000,495,199,296 Mid-market B,Mid-market (self-serve),8,291000,792,349,443 Mid-market C,Mid-market (self-serve),7,301000,693,361,332 Mid-market D,Mid-market (self-serve),6,288000,594,346,248 Mid-market E,Mid-market (self-serve),5,254000,495,305,190 Mid-market F,Mid-market (self-serve),4,235000,396,282,114 Mid-market G,Mid-market (self-serve),4,159000,396,191,205 Mid-market H,Mid-market (self-serve),8,330000,792,396,396 Mid-market I,Mid-market (self-serve),5,366000,495,439,56 Mid-market J,Mid-market (self-serve),5,234000,495,281,214 Mid-market K,Mid-market (self-serve),7,433000,693,520,173 Mid-market L,Mid-market (self-serve),7,134000,693,161,532 Mid-market M,Mid-market (self-serve),6,222000,594,266,328 Mid-market N,Mid-market (self-serve),6,196000,594,235,359 Mid-market O,Mid-market (self-serve),8,428000,792,514,278 Mid-market P,Mid-market (self-serve),3,251000,297,301,-4 Mid-market Q,Mid-market (self-serve),6,544000,594,653,-59 Mid-market R,Mid-market (self-serve),6,392000,594,470,124 Mid-market S,Mid-market (self-serve),8,350000,792,420,372 Mid-market T,Mid-market (self-serve),8,553000,792,664,128 Mid-market U,Mid-market (self-serve),8,192000,792,230,562 Mid-market V,Mid-market (self-serve),3,346000,297,415,-118 Mid-market W,Mid-market (self-serve),4,157000,396,188,208 Mid-market X,Mid-market (self-serve),5,145000,495,174,321 Startup 1,Startup (self-serve),3,33000,297,40,257 Startup 2,Startup (self-serve),3,40000,297,48,249 Startup 3,Startup (self-serve),1,2000,99,2,97 Startup 4,Startup (self-serve),3,21000,297,25,272 Startup 5,Startup (self-serve),2,25000,198,30,168 Startup 6,Startup (self-serve),2,10000,198,12,186 Startup 7,Startup (self-serve),1,19000,99,23,76 Startup 8,Startup (self-serve),2,29000,198,35,163 Startup 9,Startup (self-serve),1,11000,99,13,86 Startup 10,Startup (self-serve),2,14000,198,17,181 Startup 11,Startup (self-serve),1,9000,99,11,88 Startup 12,Startup (self-serve),2,16000,198,19,179 Startup 13,Startup (self-serve),3,32000,297,38,259 Startup 14,Startup (self-serve),3,15000,297,18,279 Startup 15,Startup (self-serve),1,35000,99,42,57 Startup 16,Startup (self-serve),1,35000,99,42,57 Startup 17,Startup (self-serve),3,27000,297,32,265 Startup 18,Startup (self-serve),1,26000,99,31,68 Startup 19,Startup (self-serve),3,26000,297,31,266 Startup 20,Startup (self-serve),2,14000,198,17,181 Startup 21,Startup (self-serve),3,20000,297,24,273 Startup 22,Startup (self-serve),3,16000,297,19,278 Startup 23,Startup (self-serve),3,39000,297,47,250 Startup 24,Startup (self-serve),1,9000,99,11,88 Startup 25,Startup (self-serve),1,16000,99,19,80 Startup 26,Startup (self-serve),1,10000,99,12,87 Startup 27,Startup (self-serve),3,27000,297,32,265 Startup 28,Startup (self-serve),2,39000,198,47,151 Startup 29,Startup (self-serve),2,18000,198,22,176 Startup 30,Startup (self-serve),1,15000,99,18,81 Startup 31,Startup (self-serve),3,11000,297,13,284 Startup 32,Startup (self-serve),1,40000,99,48,51 Startup 33,Startup (self-serve),2,32000,198,38,160 Startup 34,Startup (self-serve),2,39000,198,47,151 Startup 35,Startup (self-serve),1,15000,99,18,81 Startup 36,Startup (self-serve),3,12000,297,14,283 Startup 37,Startup (self-serve),1,21000,99,25,74 Startup 38,Startup (self-serve),3,19000,297,23,274 Startup 39,Startup (self-serve),2,38000,198,46,152 Startup 40,Startup (self-serve),2,32000,198,38,160 Startup 41,Startup (self-serve),2,5000,198,6,192 Startup 42,Startup (self-serve),2,18000,198,22,176 Startup 43,Startup (self-serve),2,35000,198,42,156 Startup 44,Startup (self-serve),2,31000,198,37,161 Startup 45,Startup (self-serve),3,21000,297,25,272 Startup 46,Startup (self-serve),2,7000,198,8,190 Startup 47,Startup (self-serve),2,30000,198,36,162 Startup 48,Startup (self-serve),3,3000,297,4,293 Startup 49,Startup (self-serve),2,28000,198,34,164 Startup 50,Startup (self-serve),1,8000,99,10,89
price_test_readout.md10 lines · Download
# Price test readout (Growth team, January)

Test: new self-serve sign-ups saw $129 per seat (B) or $99 (A), 8 to 21 December. Intended split 50/50.

| Arm | Pricing page visitors | Started paying | Conversion |
|---|---|---|---|
| A ($99) | 1,240 | 62 | 5.0% |
…
enterprise_contracts.md10 lines · Download
# Enterprise contracts

| Account | Annual value | Renews | Note |
|---|---|---|---|
| Northwind Logistics | $38,400 | Feb 2027 | Pages up 3x in a year; wants a 2-year renewal "at the same rate" |
| Halden Insurance | $31,200 | Jun 2027 | |
| Arcadia Health | $54,000 | Mar 2027 | Evaluating a competitor |
…
competitor_pricing.md5 lines · Download
# Competitor pricing (public pricing pages, September)

- DocuLens: $0.012 per page up to 1M pages a month, $0.008 above that; $500 a month platform fee.
- ExtractIQ: $0.015 per page, volume discounts from 500k pages; no seat charges.
- Formwise: per seat ($79), page limits per seat (50k), overage $0.01 per page.
cfo_note.md1 lines · Download
From Tom (CFO): "Gross margin was 41% a year ago and it's 24% now. Let's put every price up 30% in January, seats and contracts, and use the price test as cover. Customers expect increases."
What a strong answer doesThe answer key the graders mark against

Shows that the problem is the value metric, not the price level. Six enterprise accounts process about 71% of all pages (19.4M of 27.4M) on seat-based contracts worth $19,000 a month, costing about $23,200 to serve: they lose about $4,200 a month, while startups pay for seats they barely use (margin about 87%). Overall gross margin is about 24% ($43,100 revenue against $32,900 cost). A 30% rise on seats barely touches the loss-making volume (enterprise contracts would rise only at renewal) and lands hardest on small self-serve accounts. Proposes a hybrid: a platform fee plus a per-page price with volume tiers, priced against competitors (about $0.008 to $0.015 a page) and well above cost ($0.0012), and works out its effect by segment. Handles the enterprise renewals one by one (Copperfield in January, Northwind in February asking for the same rate on tripled volume, Arcadia in March evaluating a competitor) with usage-based terms or committed volume. Rejects the price test as evidence: the split is 1,240 to 870 when it should be 50/50 (a sample ratio mismatch), it ran over two holiday weeks, and with about 1,000 visitors an arm it couldn't detect the drop it claims isn't there. Plans a transition for existing self-serve customers and a way to measure it.

Critical failures (cap the score at 40)
  • Recommends the flat 30% rise on seats and contracts
  • Agrees to renew Northwind for two years at the same rate
Task

Staff-level · v1.1

The outputs

8 setups answered this brief.

Needs more than a quick edit6 of 13 checks passed

The output contains a factual error (test duration) and omits key elements like uncertainty, churn monitoring, and WTP evidence gaps, requiring rework before use.

Output

MEMORANDUM

TO: Chief Executive Officer FROM: Head of Product DATE: January 5, 2027 SUBJECT: Comprehensive Pricing Strategy: Transitioning from Seat-Based to Hybrid Usage-Based Model

---

1. Executive Summary: The Root Cause of Our Margin Compression

Tom is right that our gross margin collapse—from 41% a year ago to 23.6% today—is unsustainable. However, his proposed solution—a flat 30% across-the-board hike on seats and enterprise contracts—is the wrong remedy for a structural disease.

Parsewell is an API document infrastructure business selling variable compute (model inference and storage at $0.0012/page) under a flat, unmetered developer-seat model. This misaligns cost with value: * Enterprise is underwater: 4 of our 6 enterprise accounts generate negative gross margins. Northwind Logistics costs us $5,784/month to serve while paying only $3,200/month (-$2,584 GM). * Enterprise drives 70.6% of page volume (19.36M pages) and 70.6% of COGS, but yields -22.3% gross margin. * Startups are overpaying relative to cost: Startups generate an 87.3% gross margin. Tom’s 30% seat hike taxes the low-volume developer funnel that feeds our pipeline while leaving our heaviest enterprise consumers deeply unprofitable (even at +30%, Northwind would still lose $1,624 every month). * Enterprise contracts cannot simply be hiked in January: Enterprise customers are on annual agreements that renew throughout 2027.

We must shift immediately to a Hybrid Base + Metered Usage Model. This protects developer adoption, eliminates negative-margin accounts, positions us at a 50–70% discount to competitors, and restores company-wide gross margins from 23.6% to 60.3% ($10.2k to $50.0k monthly gross profit).

---

2. Critique of the Growth Team’s Price Test

The recommendation to raise self-serve seats from $99 to $129 based on the December test is flawed and should not be used as executive cover:

  1. Fatal Sample Ratio Mismatch (SRM): The test intended a 50/50 traffic split, but logged 1,240 visitors in Arm A ($99) and only 870 in Arm B ($129)—a 58.8% to 41.2% skew. A chi-square goodness-of-fit test yields $\chi^2 = 64.9$ ($p < 10^{-14}$). This severe deviation indicates a critical bug in traffic routing, ad tracking, or bot filtering. The data is compromised and scientifically invalid.
  2. Cohort & Volume Blindness: The test ran for just 13 days during the mid-December holiday slowdown and evaluated only top-of-funnel self-serve sign-ups. It provides zero data on willingness to pay for mid-market teams or enterprise renewals, which represent 76% of our revenue and 96% of compute costs.
  3. Optimizing the Wrong Value Metric: The test treated Parsewell as a collaboration tool (charging for humans viewing dashboards) rather than an API processing workloads. A developer seat price hike penalizes low-volume accounts while letting high-volume API users exploit unlimited processing for $99.

---

3. The Proposed Pricing Model

Document extraction value scales with document volume, not dashboard seats. Competitors recognize this: DocuLens charges $0.008–$0.012/page plus platform fees, and ExtractIQ charges $0.015/page. We can price at a substantial discount to both while capturing healthy margins.

``` ┌──────────────────────────────────────────────────────────────────────────────┐ │ PROPOSED PRICING MODEL │ ├───────────────────┬──────────────────────────────────────────────────────────┤ │ Plan │ Structure & Inclusions │ ├───────────────────┼──────────────────────────────────────────────────────────┤ │ Self-Serve │ • $99 / seat / month │ │ (Startup & │ • Includes 25,000 pages per seat / month │ │ Mid-Market) │ • Overage: $0.0040 / page ($4.00 per 1,000 pages) │ ├───────────────────┼──────────────────────────────────────────────────────────┤ │ Enterprise │ • $1,000 / month ($12,000 / yr) Platform Fee │ │ (Custom Contract) │ (includes 10 seats, custom models, 99.9% SLA, SOC 2) │ │ │ • Committed Volume: $0.0020 / page ($2.00 / 1,000 pages) │ │ │ • Uncommitted Overage: $0.0035 / page │ └───────────────────┴──────────────────────────────────────────────────────────┘ ```

#### Why this structure works: * Startups (<50k pages/mo): 46 of our 50 startups fit entirely within their 25,000 pages/seat allowance. Their pricing remains unchanged at $99–$297/month, maintaining top-of-funnel conversion. * Mid-Market (100k–550k pages/mo): Accounts with heavy API integration contribute overage revenue reflecting their compute load. Mid-market Q (544k pages, 6 seats) will pay $2,170/month instead of $594/month. Under DocuLens, Q would pay $7,028/month. We remain 69% cheaper than the market while turning a -$59 margin into +$1,517. * Enterprise (>2M pages/mo): Shifting to $0.0020/page gives enterprise clients predictable, volume-discounted rates that are 75% lower than DocuLens ($0.0080), while guaranteeing Parsewell a 40%+ gross margin against our $0.0012 cost to serve (widening as inference costs drop 10% QoQ).

---

4. Segment-by-Segment Financial & Gross Margin Impact

The table below contrasts the 30-day baseline against Tom’s 30% flat increase and the proposed model:

SegmentMetricCurrent BaselineTom's +30% Hike (Hypothetical)*Proposed Model (Fully Transitioned)
:---:---:---:---:---
Startup<br>(50 accounts, 101 seats, 1.06M pages)Revenue<br>Cost to Serve<br>Gross Margin ($)<br>Gross Margin (%)$9,999<br>$1,273<br>$8,726<br>87.3%$12,999<br>$1,273<br>$11,726<br>90.2%$10,143<br>$1,273<br>$8,870<br>87.4%
Mid-Market<br>(24 accounts, 142 seats, 6.99M pages)Revenue<br>Cost to Serve<br>Gross Margin ($)<br>Gross Margin (%)$14,058<br>$8,380<br>$5,678<br>40.4%$18,275<br>$8,380<br>$9,895<br>54.1%$28,002<br>$8,380<br>$19,622<br>70.1%
Enterprise<br>(6 accounts, 65 seats, 19.36M pages)Revenue<br>Cost to Serve<br>Gross Margin ($)<br>Gross Margin (%)$19,000<br>$23,232<br>-$4,232<br>-22.3%$24,700<br>$23,232<br>$1,468<br>5.9%$44,720<br>$23,232<br>$21,488<br>48.0%
Total Company<br>(80 accounts, 27.41M pages)Total Revenue<br>Total COGS<br>Gross Margin ($)<br>Gross Margin (%)$43,057<br>$32,885<br>$10,172<br>23.6%$55,974<br>$32,885<br>$23,089<br>41.2%$82,865<br>$32,885<br>$49,980<br>60.3%

\Note: Tom’s enterprise numbers assume annual contracts could be unilaterally raised mid-term without churn, which is legally impossible.*

---

5. Implementation Roadmap & Enterprise Renewal Strategy

#### Phase 1: Self-Serve Rollout (January–February 2027) * Grandfathering Window: Announce the hybrid model on January 15, taking effect March 1. Give existing self-serve accounts a 45-day grace period. * In-App Usage Analytics: Ship a real-time usage dashboard by February 1 showing page counts, projected monthly spend, and threshold alerts. Transparency prevents billing shock. * Top-of-Funnel Conversion: Keep new customer acquisition frictionless at $99/seat with 25k pages included.

#### Phase 2: Enterprise Renewal Playbook Enterprise accounts renew on contract dates throughout 2027. We must address each strategically:

1. Copperfield Freight (Renews Jan 2027 — Immediate Action): * Status: 2.38M pages, currently paying $2,400/mo ($28.8k/yr) against $2,856 cost. * Play: Propose a renewed contract at $5,760/mo ($69.1k ARR) ($1k base + 2.38M pages @ $0.0020). Highlight that Formwise would charge over $23k/mo for this volume. 2. Northwind Logistics (Renews Feb 2027 — High Risk/Priority): * Status: 4.82M pages (up 3x in 12 months); paying $3,200/mo ($38.4k/yr) against $5,784 cost. Requested a 2-year lock-in at the current rate. * Play: Flatly decline the 2-year rate freeze. Present their 3x volume growth and offer an enterprise tier at $10,640/mo ($127.7k ARR) ($1k base + 4.82M pages @ $0.0020). Demonstrate that DocuLens would charge them $43,060/mo ($516k ARR). Our proposal saves them $388k annually versus competitors. 3. Arcadia Health (Renews Mar 2027 — Retention Risk): * Status: 3.31M pages, paying $4,500/mo ($54k ARR); currently evaluating competitors. * Play: Competitive intelligence shows Arcadia cannot leave for a lower price: ExtractIQ would charge them $49,650/mo and DocuLens $30,980/mo. Offer Arcadia a multi-year deal with a grandfathered volume tier at $7,620/mo ($91.4k ARR) ($1k base + 3.31M pages @ $0.0020). They get price predictability; we move gross margin from 11.7% to 47.9%. 4. Halden Insurance (Jun), Meridian Claims (Sep), Brightwater Bank (Nov): * Play: Conduct mid-term Quarterly Business Reviews (QBRs) 90 days before renewal. Share data on their volume growth, introduce the new enterprise volume-tier framework, and negotiate smooth transitions without surprising client procurement teams.

Summary Recommendation

Tom's flat 30% increase damages our acquisition funnel, fails to make heavy users profitable, and risks enterprise litigation or churn. By shifting to a consumption-aligned hybrid model, Parsewell protects its developer brand, doubles monthly revenue to $82.9k, and achieves a sustainable 60.3% gross margin that expands as underlying inference costs drop.

Claims the judge couldn’t find in the brief

  • The test ran for 13 days during the mid-December holiday slowdown.

Grades and run details

Decision model 62 · LLM judge 50
Decision model checks
  • failUses the supplied evidence correctly25%
  • passAddresses the actual decision47%
  • partialRespects explicit constraints39%
  • failIdentifies material uncertainty32%
  • failAvoids unsupported claims42%
  • passProduces the required deliverable64%
  • passFixes the value metric100%
  • passDoesn't trust the price test100%
  • passPlans the renewals100%
  • passEach tier for a different buyer90%
  • failGets the base of every number right52%
  • partialPriced on willingness to pay30%
  • passMoves existing customers fairly79%
Run
Run
#1
API response time
1.6 min
Submitted
6 Oct 2026

Needs more than a quick edit6 of 13 checks passed

Factual errors in key numbers require re-checking evidence, and the transition plan lacks churn monitoring.

Output

MEMORANDUM

TO: Chief Executive Officer FROM: Head of Product, Parsewell DATE: October 24, 2024 SUBJECT: Alternative Pricing Model vs. Tom’s 30% Across-the-Board Increase

---

1. Assessment of the Growth Team’s Price Test

Tom’s reliance on the December price test to justify a blanket 30% price hike is dangerously flawed. The test suffered from two fatal errors: 1. Sample Selection & Volume Discrepancy: Arm A ($99) attracted 1,240 visitors, while Arm B ($129) attracted only 870 visitors—a 30% drop in top-of-funnel capture. This points to a broken traffic allocation or immediate audience suppression at the higher price point. 2. Confounding Variables: Running a pricing test during December (8th–21st) captures holiday-shortened enterprise/developer activity, creating noise that masks true price elasticity.

While a 30% seat price increase showed a statistically insignificant conversion dip over a two-week window, applying that logic to usage or enterprise contracts ignores reality. Parsewell is an infrastructure API. Developers do not buy seats for fun; they buy seats to build systems that process millions of pages. Tying our revenue strictly to developer seats while our core cost driver—and customer value metric—is document volume is a structural mismatch.

---

2. The Current State: Margin Erosion & Value Leakage

An analysis of our usage export reveals why Tom is panicking about gross margins (currently sitting at roughly 24% overall): * The Enterprise Subsidy: Our 6 Enterprise accounts processed 19.16 million pages last month (79% of total company volume) but generated only $18,600 in revenue. Because they enjoy "unlimited pages" tied to discounted seat licenses, their heavy usage swamps our inference costs ($0.0012/page). Consequently, 4 out of 6 Enterprise accounts have negative gross margins, costing us thousands monthly (e.g., Northwind Logistics loses $2,584/month). * The Self-Serve Engine: Mid-market and Startup tiers are healthy, generating positive gross margins because their volume scales predictably with seat counts.

A flat 30% seat hike fixes nothing for Enterprise: adding 30% to Northwind’s $3,200/month bill reduces their negative margin, but they still bleed cash because they process 4.8 million pages for a flat fee.

---

3. The Alternative Pricing Model: Value-Based Usage Tiers

To fix gross margins structurally, we must decouple our monetization from developer seats and align it with the metric that drives our costs and customer value: processed pages.

We propose launching Parsewell V2 on January 1: 1. Self-Serve (Startups & Mid-market): Retain the base seat fee ($99/seat/month) to cover dashboard access, but introduce a generous included page allowance (50,000 pages/seat/month) with a clear, predictable overage rate of $0.005 per page. 2. Enterprise Contracts: Move away from flat seat-license bundles. Transition to a Platform Fee + Usage Model modeled after industry standards (competing with DocuLens/ExtractIQ): * Base Platform Fee: $1,500/month (includes dashboard, SSO, priority support, and 250k pages). * Overage / Metered Rate: $0.008 per page for all volume exceeding the base allowance.

#### Financial Impact Summary (Based on Last 30 Days Data) * Current Monthly Revenue: ~$41,000 | Current Cost to Serve: ~$31,000 | Current Gross Margin: ~24% * New Model Monthly Revenue: ~$81,500 | New Cost to Serve: ~$31,000 | New Gross Margin: ~62%

---

4. Segment-by-Segment Impact & Table

SegmentCurrent ModelNew Proposed ModelImpact on CustomerImpact on Gross Margin
:---:---:---:---:---
Startups (50 accounts)$99/seat/mo, unlimited pages. (Rev: ~$11,000)$99/seat/mo + 50k pages included; $0.005/pg overage.Most stay at base price; high-volume startups see minor increases ($20–$50).Stable / High (~85%): Low usage keeps inference costs minimal.
Mid-market (24 accounts)$99/seat/mo, unlimited pages. (Rev: ~$13,400)$99/seat/mo + 50k pages/seat included; $0.005/pg overage.Accounts processing >350k pages/seat see bills increase by 20–40%.Optimized (~68%): Eliminates unprofitable outliers (e.g., Mid-market Q & V).
Enterprise (6 accounts)Annual contracts, flat seat-discount bundles, unlimited pages. (Rev: ~$18,600)$1,500/mo platform fee + $0.008/page metered usage.Significant bill increases for hyper-scale users (Northwind, Halden), shifting them to fair-value pricing.Turned Positive (~55%): Transforms massive margin drains into profitable growth drivers.

---

5. Execution Strategy & Enterprise Renewals

Transitioning self-serve is straightforward via a Stripe billing update with a 30-day grandfathering notice. Enterprise renewals require a tactical playbook to prevent churn, especially with accounts like Arcadia Health evaluating competitors.

  • Copperfield Freight (Renews Jan 2027): Their contract is up immediately in January. We will introduce the new usage-based framework during December QBR. Position the $0.008/page rate against competitor DocuLens ($0.012/page) to show they are still getting a volume discount.
  • Northwind Logistics (Renews Feb 2027): They want a 2-year renewal at the same rate despite a 3x volume surge. Do not accept. Counter-offer: Honor the flat seat rate for 12 months only if they agree to a volume cap of 2M pages/month, with overages billed at $0.008/page thereafter. Otherwise, transition them directly to the new platform + usage model.
  • Arcadia Health (Renews Mar 2027 - Evaluating Competitor): Because they are price-sensitive and shopping around, offer a transitional "Volume Partnership Discount": a lower platform fee ($1,000) for Q1 while locking them into a 2-year tiered page commitment.

Conclusion

Tom wants a blunt instrument (30% across the board) to solve a surgical problem. A flat 30% price hike leaves money on the table for high-volume users while alienating self-serve customers. Our value-based usage model repairs our gross margins to over 60%, prices our heavy enterprise users fairly based on the compute power they consume, and keeps us competitively positioned against ExtractIQ and DocuLens.

Claims the judge couldn’t find in the brief

  • Our 6 Enterprise accounts processed 19.16 million pages last month (79% of total company volume)
  • generated only $18,600 in revenue
  • Current Monthly Revenue: ~$41,000
  • Current Cost to Serve: ~$31,000

Grades and run details

Decision model 50 · LLM judge 43
Decision model checks
  • failUses the supplied evidence correctly64%
  • partialAddresses the actual decision26%
  • partialRespects explicit constraints23%
  • failIdentifies material uncertainty39%
  • failAvoids unsupported claims54%
  • partialProduces the required deliverable21%
  • passFixes the value metric91%
  • passDoesn't trust the price test83%
  • passPlans the renewals98%
  • passEach tier for a different buyer62%
  • failGets the base of every number right91%
  • partialPriced on willingness to pay37%
  • partialMoves existing customers fairly67%
Run
Run
#1
Time to output
8 s
Submitted
5 Oct 2026

Usable with a quick edit11 of 13 checks passed

The memo is complete, evidence-backed, and directly actionable by the CEO with only minor wording tweaks possible.

Output

Parsewell pricing: an alternative to a flat 30% increase

To: CEO | From: Head of Product

Recommendation

Tom has correctly identified the margin problem but proposes the wrong fix. We don't charge for pages, and pages are the only thing that costs us money. I recommend we keep seats for self-serve, add a page allowance with overage, and price enterprise per page. At today's volumes this takes gross margin from 24% to 42%. Startups pay nothing extra, and margin keeps rising as cost per page falls. A 30% increase reaches 41% on paper, but only if nobody churns and we could reprice contracts in January. We can't. And it leaves the cause in place.

Where the margin went

All figures come from the 30-day export (80 accounts, 27.4M pages, $43,057 revenue, $32,903 cost to serve).

  • Enterprise is underwater. It earns $0.00098 per page against a cost of $0.0012, a gross margin of −22%. Northwind and Halden alone lose $4,736 a month.
  • Mid-market makes 41%. Three accounts (P, Q, V) lose money because a few seats push heavy volume.
  • Startups make 87%. They are not the problem.

Seats don't track cost. Northwind's pages tripled in a year on the same contract. Cost per page falls about 34% a year (10% a quarter), but volume growth of that size outruns it. That is how margin fell from 41% to 24%.

The model

SegmentAcctsNew pricingRevenue/mo now → newGM now → new
Startup (self-serve)50$99/seat, 50k pages per seat included, $0.003/page above$9,999 → $9,999 (no account changes)87% → 87%
Mid-market (self-serve)24Same plan$14,058 → $17,214 (+22%); 14 accounts unchanged, 10 pay overage41% → 51%
Enterprise (annual)6$0.0015/page on a committed annual volume, overage at the same rate, unlimited seats, minimum = current contract value$19,000 → $29,115 (+53%)−22% → 20%
Total80$43,057 → $56,328 (+31%)24% → 42%

Why this shape:

  • Startups: no startup exceeds 50k pages per seat, so the change is invisible to them. That protects the funnel against Formwise at $79.
  • Mid-market: overage lands only on the accounts that cost us.
  • Enterprise: a single per-page rate with no volume discount, because our cost is linear in pages.

Margin over time: at $0.0015, enterprise margin is 20% at today's cost and about 48% by late 2027 if the cost trend holds. Unlike today, revenue grows with volume.

Competitive position: $0.0015 is deliberately conservative. DocuLens's public price for Northwind's volume would be about $43,000 a month, against $7,230 under this model. We stay the cheapest option for every mid-market account too. Account V (3 seats, 346k pages) would pay $885 with us, $2,197 at Formwise and about $4,650 at DocuLens.

Enterprise renewals

Contracts can't be repriced mid-term. A January increase on "contracts" would reach only Copperfield. We move each account at renewal.

AccountRenewsNow/moNew/moChangeApproach
CopperfieldJan 2027$2,400$3,570+49%First renewal; prove the motion and refine the talk track
NorthwindFeb 2027$3,200$7,230+126%Decline "same rate"; offer 2 years at $0.0015 then $0.0013
ArcadiaMar 2027$4,500$4,965+10%Retention case: hold $54k, cover up to 3.6M pages/mo
HaldenJun 2027$2,600$5,940+128%Same as Northwind
MeridianSep 2027$3,300$3,3000%Minimum applies; framing benefit only
BrightwaterNov 2027$3,000$4,110+37%Standard

Northwind. "Same rate for two years" means unlimited pages for $38,400 a year. If their growth continues, they reach roughly 14M pages a month. Even after two more years of cost decline, that would lose us about $100k a year.

  • Offer: two years at $0.0015, stepping down to $0.0013 in year two. This gives them the price certainty they want while we keep a margin on growth.
  • Walk-away point: we should be willing to lose them. Northwind and Halden leaving would cut $5,800 a month of revenue but raise gross profit by $4,736 a month. That fact sets our walk-away point; it isn't a threat to put in front of them.

Arcadia already pays $0.00136 per page and is looking at a competitor.

  • Offer: hold them at $54k for 12 months covering up to 3.6M pages a month, with $0.0015 above that.
  • Discovery: competitors' public prices are far above ours, so we should find out what is really driving the evaluation before assuming it's price.

Phasing. Full enterprise effect arrives with the November renewal. Margin climbs through 2027 rather than jumping in January.

Self-serve rollout

  1. January: new sign-ups get the new plan. Existing accounts get an in-dashboard usage meter showing their allowance.
  2. Notice: existing accounts get 60 days' notice, with overage billing from April.
  3. Personal outreach to five accounts: I, P, Q, T and V see increases of 58% to 198%. We contact each one and offer a committed annual page pack at $0.002.
  4. Worst case: if all five churned, we lose $2,433 a month of new gross profit. Blended margin would still be about 41%.

The price test

The test doesn't support a 30% increase, for the following reasons.

  1. The split is broken. It was meant to be 50/50 but came out 1,240 vs 870 visitors (59/41). The chance of that happening randomly is effectively zero (χ² ≈ 65). Something in assignment or tracking failed, possibly losing B-arm visitors who bounced. Until that is explained, neither arm's numbers can be trusted.
  2. "Not significant" doesn't mean "no effect." With 104 conversions, the 95% confidence interval on the difference runs from −2.0 to +1.7 points. The data are consistent with a 40% drop in conversion.
  3. The timing and measure are weak. It ran for two holiday weeks and measured first payment only, not retention or seat growth.
  4. It covered the wrong customers for this decision. It tested new self-serve sign-ups at $129. It says nothing about existing customers or enterprise contracts. Enterprise buyers will ask for the evidence, and citing this test for their increase would hurt our credibility at exactly the renewals that matter.

At face value, B shows higher revenue per visitor ($6.23 vs $4.95). That makes the test worth rerunning, not acting on. A valid rerun needs:

  • a fixed split;
  • four or more weeks;
  • 60-day paid retention as the success measure;
  • the new allowance plan as one of the arms.

Compared with a flat 30%

Flat +30% (as proposed)Flat +30% (what January allows)This model
Gross margin today41%36%42%
Northwind / HaldenStill lose $1,624 / $1,372 a monthUnchanged losses20% margin
As pages growMargin erodes againMargin erodes againMargin holds and rises as costs fall
Startups (87% margin, most price-sensitive)+30%+30%Unchanged
Churn assumedNoneNoneDownside quantified above

Decisions needed

  1. Approve the model and the $0.0015 enterprise rate.
  2. Authorize the walk-away position on Northwind and Halden.
  3. Ask Growth to diagnose the split failure before any test result is cited.

I'd like Tom in the room for the first two. His margin target is right, and this model reaches it faster and keeps it.

Grades and run details

Decision model 77 · LLM judge 100
Decision model checks
  • failUses the supplied evidence correctly26%
  • passAddresses the actual decision98%
  • passRespects explicit constraints28%
  • passIdentifies material uncertainty87%
  • partialAvoids unsupported claims30%
  • passProduces the required deliverable76%
  • passFixes the value metric90%
  • passDoesn't trust the price test100%
  • passPlans the renewals100%
  • passEach tier for a different buyer90%
  • failGets the base of every number right71%
  • partialPriced on willingness to pay28%
  • passMoves existing customers fairly100%
Run
Run
#1
Time to output
2.9 min
Submitted
5 Oct 2026

Check by check

Where the outputs differ comes first. Open a check to read the judge’s reasons. “Mixed” means the two graders disagreed.

Where they differ 7

Uses the supplied evidence correctlyWrongWrongMixed
Gemini 3.8 Flash · API

The claim that the price test ran for 13 days is not supported; the source says 8 to 21 December, which is 14 days.

Gemini 3.5 Flash-Lite · Gemini

Multiple factual errors: enterprise pages 19.16M vs 19.36M, share 79% vs 70.6%, revenue $18,600 vs $19,000, total revenue ~$41k vs $43,156, total cost ~$31k vs $32,903.

Opus 5.5 · Claude

All factual claims about the current situation are directly supported by the supplied context or arithmetic from it.

Addresses the actual decisionMixedWrongRight
Gemini 3.8 Flash · API

The output does not state what result or condition would change the recommendation.

Gemini 3.5 Flash-Lite · Gemini

Does not state what result or condition would change the recommendation.

Opus 5.5 · Claude

Commits early to a new hybrid pricing model, addresses the CEO's request, and states what would change the call (Tom's margin target, walk-away authorization).

Identifies material uncertaintyWrongWrongRight
Gemini 3.8 Flash · API

The output does not name specific unknowns that could change the decision or how they would be resolved.

Gemini 3.5 Flash-Lite · Gemini

Does not name unknowns that could change the decision or how they would be resolved.

Opus 5.5 · Claude

Identifies the broken test split, churn risk from five mid-market accounts, Arcadia's true evaluation driver, and bounds the downside.

Avoids unsupported claimsWrongWrongRight
Gemini 3.8 Flash · API

Forecasts like 'doubles monthly revenue to $82.9k, and achieves a sustainable 60.3% gross margin' are presented as confident claims without being labelled as projections.

Gemini 3.5 Flash-Lite · Gemini

Presents interpretations like 'broken traffic allocation' as fact without labelling them as hypotheses.

Opus 5.5 · Claude

Causal claims are grounded in data; forecasts are clearly projections; the test split failure is labelled as 'possibly' a tracking issue.

Gets the base of every number rightMixedWrongMixed
Gemini 3.8 Flash · API

All derived percentages and margins check out against the supplied data; the 13-day error is a factual claim, not a computation error.

Gemini 3.5 Flash-Lite · Gemini

Derived figures for enterprise pages, percentage, revenue, and cost are incorrect.

Opus 5.5 · Claude

All derived figures (margins, per-page rates, competitor comparisons) check out against the supplied data, and bases are stated where ambiguous.

Priced on willingness to payWrongWrongRight
Gemini 3.8 Flash · API

The output relies on competitor pricing as a proxy for willingness to pay but does not state where the evidence is thin or use direct WTP signals from the material.

Gemini 3.5 Flash-Lite · Gemini

Prices are based on competitors and cost, not on evidence of customer willingness to pay from the supplied data.

Opus 5.5 · Claude

Prices are grounded in competitor comparisons showing significant headroom, and acknowledges thin evidence for Arcadia by recommending discovery.

Moves existing customers fairlyMixedWrongRight
Gemini 3.8 Flash · API

The transition plan lacks a mechanism for watching churn, which is required for moving existing customers fairly.

Gemini 3.5 Flash-Lite · Gemini

Transition plan lacks a new-customer-first approach and does not mention how churn will be monitored.

Opus 5.5 · Claude

Transition plan: new sign-ups in January, 60-day notice for existing, personal outreach to five heavy users, and churn downside quantified.

All got right 6

Respects explicit constraintsRightRightRight
Gemini 3.8 Flash · API

The output is a memo to the CEO, includes the required table, and appears to be within 1,300 words.

Gemini 3.5 Flash-Lite · Gemini

Respects word limit, includes required table, and does not recommend a flat 30% rise.

Opus 5.5 · Claude

Memo to CEO, under 1,300 words, includes the required table of model and effect by segment, and respects all explicit constraints.

Produces the required deliverableRightRightRight
Gemini 3.8 Flash · API

The memo with table is complete, addressed to the CEO, and provides an actionable plan.

Gemini 3.5 Flash-Lite · Gemini

Memo to CEO with table, within length, and actionable with light edits.

Opus 5.5 · Claude

Complete memo with model, segment effects, gross margin impact, renewal plan, and price test assessment; usable as-is.

Fixes the value metricRightRightRight
Gemini 3.8 Flash · API

The output computes enterprise share of pages and negative margin, and proposes a hybrid usage-based model with per-page tiers.

Gemini 3.5 Flash-Lite · Gemini

Identifies enterprise page volume and negative margin, and proposes usage-based pricing with per-page tiers.

Opus 5.5 · Claude

Computes enterprise share of pages and negative margin, then proposes usage-based pricing with per-page tiers for enterprise and page allowance for self-serve.

Doesn't trust the price testRightRightRight
Gemini 3.8 Flash · API

The output names the sample ratio mismatch and the holiday timing, and does not rest the decision on the test.

Gemini 3.5 Flash-Lite · Gemini

Names the sample ratio mismatch and holiday timing, and does not rest the decision on the test.

Opus 5.5 · Claude

Names the 59/41 split mismatch, holiday timing, and small sample; does not rest the decision on the test.

Plans the renewalsRightRightRight
Gemini 3.8 Flash · API

The output gives specific renewal approaches for Copperfield (Jan), Northwind (Feb), and Arcadia (Mar), using their dates and notes.

Gemini 3.5 Flash-Lite · Gemini

Addresses Copperfield (Jan), Northwind (Feb), and Arcadia (Mar) with their dates and circumstances.

Opus 5.5 · Claude

Addresses each enterprise renewal with its date and note, including Copperfield in January, Northwind's tripled volume, and Arcadia's competitor evaluation.

Each tier for a different buyerRightRightRight
Gemini 3.8 Flash · API

The two tiers (Self-Serve and Enterprise) name distinct buyers and include features each values (e.g., SLA, custom models for enterprise).

Gemini 3.5 Flash-Lite · Gemini

Each tier targets a distinct buyer with different value metrics (seat+overage for self-serve, platform+usage for enterprise).

Opus 5.5 · Claude

Each tier names its buyer (startups, mid-market, enterprise) and is priced on distinct value: startups protected, mid-market overage on heavy users, enterprise per-page with unlimited seats.

Results

Every setup we’ve tested on this task type, across all its tasks and repeats, graded on the current checklist. Calibrated. Where our PM checked the graders by hand, they agreed on 81% of 68 checks.

#Model · HarnessTask scoreDecision modelLLM judgeRunsCritical failures
1Opus 5.5withClaude76.0100.02None
2GPT-6 AstrawithChatGPT74.096.42None
3Sonnet 5.5withAPI76.089.32None
4GPT-6.1 SolwithAPI76.088.72None
5Haiku 5.5withAPI78.076.92None
6GPT-6 LunawithAPI74.064.02None
7Gemini 3.8 FlashwithAPI62.044.22None
8Gemini 3.5 Flash-LitewithGemini45.840.72None

What you get for the cost

Sonnet 5.5 · API scores within 5 points of Opus 5.5 · Claude at half the cost.

Task score against relative cost for each setup. The table below has the same figures.304050607080901001×3×10×30×100×Cost per output, relative to the cheapest setup (log scale) →↑ Task scoreOpus 5.5 · Claude: task score 89, 122× the cheapestGPT-6 Astra · ChatGPT: task score 86, 108× the cheapestSonnet 5.5 · API: task score 84, 61× the cheapestGPT-6.1 Sol · API: task score 81, 20× the cheapestHaiku 5.5 · API: task score 76, 2.9× the cheapestGPT-6 Luna · API: task score 68, the cheapestGemini 3.8 Flash · API: task score 51, 9.1× the cheapestGemini 3.5 Flash-Lite · Gemini: task score 42, 2.3× the cheapestOpus 5.5 · ClaudeGPT-6 Astra · ChatGPTSonnet 5.5 · APIGPT-6.1 Sol · APIHaiku 5.5 · APIGPT-6 Luna · APIGemini 3.8 Flash · APIGemini 3.5 Flash-Lite · Gemini
Best valueNobody beats these on both score and cost
Task score and relative cost by setup
SetupTask scoreRelative cost (cheapest = 1)
GPT-6 Luna · API681.0×
Gemini 3.5 Flash-Lite · Gemini422.3×
Haiku 5.5 · API762.9×
Gemini 3.8 Flash · API519.1×
GPT-6.1 Sol · API8120×
Sonnet 5.5 · API8461×
GPT-6 Astra · ChatGPT86108×
Opus 5.5 · Claude89122×

Cost is each output’s tokens at the model’s list price, shown relative to the cheapest setup. Runs done in an app have no usage meter, so theirs are estimated from the same setup’s measured runs. How we compare cost

About the task

The PM job

Setting what you charge, for what, and to whom.

Why it matters

Most products are priced once and never revisited, on a metric that doesn't track value. The fix is rarely a flat rise.

What good looks like

  • Tiers built for distinct buyers
  • A value metric that tracks what customers get
  • Grounded in willingness to pay and cost to serve
  • A plan for existing customers

Deliberately not measured

  • Billing implementation
  • Legal terms
Capability tested

Pricing judgement

The failure we’re looking for

A flat price rise on the wrong value metric

Grading

Decision model and LLM judge, calibrated against a blind PM review