A Tool a Professional Chooses Should Be Tested Against the Spreadsheet

Worked example: professional software

Companion to The Product Manager’s New Job Is Acceptance · Updated 2026-09-30

This is an illustrative composite that shows the method.

The situation

A tool for independent accountants and firms of up to five preparers who file for small businesses. The accountant chooses and pays. There is no procurement department. The current alternative is spreadsheets and email.

ICP Acceptance Specification (short form)

  • Include: independent accountants and firms of up to five preparers, filing for small businesses.
  • Exclude: firms with dedicated IT staff, because their tool choices go through a process that does not apply to solo choosers.
  • Trigger: busy season, when the spreadsheet system starts to miss errors.
  • Desired outcome: a completed file with fewer review comments.
  • Unproven assumption: accountants will move client files into a new tool in the weeks before a filing deadline.

Where this sits on the choice continuum

Near the choice-rich end. Repeated use and payment are real evidence, and the funnel and the product are close to one system. Marketing sets the expectation, the trial reveals whether it was true, and the renewal after the busy season is the delayed vote.

Acceptance Hypothesis

For an independent accountant in the four weeks before a filing deadline, if the tool imports last year’s files without manual re-entry, then starting from a search result and using their own client files, we expect them to complete one return in the tool in the first session, without support.

Adversarial conditions to choose

  • Real client files with messy history.
  • A deadline within days.
  • No onboarding call.
  • An accountant with strong spreadsheet habits.
  • A start from the actual search result and pricing page.

What to measure

MeasureWhy
Time to first completed return, unaidedThe first useful action
Rescue countWhether the trial needed people
Second return within the seasonRepeated voluntary use
Renewal after the seasonDelayed acceptance evidence
Where they went back to the spreadsheetThe point of abandonment

Watch for

  • Novelty. The first week may look strong. Look at use after the deadline.
  • Survivor bias. Study the trials that ended, not only the ones that converted.
  • Version drift. The import feature changes every quarter. Put the version on every record.