01Why a side-by-side pilot
Sales demos show a provider at its best on its own examples. A side-by-side pilot shows how it performs on your clients, your checklists and your standards, and you already know the right answer because you completed the work yourself. It is the closest thing to a real engagement without the risk.
02Step 1: Choose the sample
Pick work that is representative but manageable:
- Bookkeeping: three to five clients, one or two closed months each, including at least one client with a few complications.
- Tax: five to ten of last year's filed returns across your common types.
- Software: a closed month or a set of last year's documents run through the tool.
Avoid only choosing your simplest clients, or only your hardest. You want a fair picture.
03Step 2: Do security and consent first
Before sharing any data:
- Review the provider's security materials. Use our security questions for outsourcing vendors.
- Sign a confidentiality agreement.
- Set up individual, minimum-access accounts.
- Get any taxpayer consents required, especially if people outside the US will see tax return information. See Section 7216 consent.
04Step 3: Agree the scope and the rules
Write a one-page pilot brief:
- Which clients, periods or returns.
- What "complete" means: reconciliations, statements, variance notes, workpapers, judgement lists.
- How questions are handled: raised to you, never guessed.
- The turnaround you expect.
- How results will be scored.
05Step 4: Run the pilot
Give the provider the same inputs your team had: documents, access, checklists and client notes. Do not share your finished work until they are done. Keep a log of every question they ask and every clarification you give.
06Step 5: Compare and score
Use a simple scorecard:
| Criterion | What to look at | Score 1–5 |
|---|---|---|
| Accuracy | Differences from your final work, and whether they were errors or judgement calls | |
| Traceability | Can every figure be traced to its source quickly? | |
| Questions | Were the right things raised as questions, and nothing forced? | |
| Judgement handling | Were judgement items listed for you rather than decided? | |
| Turnaround | Was work returned on time? | |
| Communication | Were questions clear and timely? | |
| Review effort | How long did your reviewer spend compared with reviewing your own team's work? | |
| Security and process | Were access and data handled as agreed? |
Review effort is the most important line. A partner that is slightly cheaper but doubles your review time is not a saving.
07Step 6: Talk through the differences
Meet with the provider to go through every difference. Some will be genuine errors, some will be judgement calls you can align on, and some will reveal gaps in your own checklist. How the provider responds to feedback tells you a lot about the relationship ahead.
08Step 7: Decide
- Expand if accuracy and review effort are good: move to live work in waves.
- Adjust if the gaps are fixable: update checklists, run a second short pilot.
- Stop if the review burden is high or security answers are unsatisfactory.
09Mistakes to avoid
- Running the pilot on live work with deadlines, before you trust the provider.
- Sharing your finished answers before they finish.
- Measuring only cost and turnaround, not your review effort.
- Skipping security and consent because "it's only a pilot".
For the wider picture, read how to outsource bookkeeping without losing quality and how to grow a small CPA firm without lowering review standards.
10A sample pilot brief
Pilot: monthly close for five clients
Clients and periods: Cedar Ridge Dental, Bluebird Bakery, Harbor Point LP, Summit Dental and Redwood Cafe; September close for each.
Inputs provided: ledger access (read and write, individual accounts), bank and card statements, payroll reports, client notes, the firm's close checklist.
Deliverables: reconciliations for every account, draft profit and loss and balance sheet, variance notes over 10% and $1,000, a close memo, and a list of questions.
Rules: questions are raised to the firm, never guessed; no client contact; no changes to the chart of accounts.
Timeline: all five closes returned within ten working days of access.
Scoring: accuracy, traceability, questions, judgement handling, turnaround, communication, review effort, and security.
A brief like this makes the pilot fair and comparable if you test more than one provider.
11A worked example of scoring
After an illustrative pilot, the firm's reviewer records:
| Criterion | Score | Notes |
|---|---|---|
| Accuracy | 4 | Two differences, both judgement calls not in the client notes |
| Traceability | 5 | Every figure traced to the statement or bank line |
| Questions | 5 | The unclear bank payment raised, not guessed |
| Judgement handling | 4 | One accrual estimate made without asking; agreed to list next time |
| Turnaround | 5 | Returned in eight working days |
| Communication | 4 | Clear questions; one slow reply |
| Review effort | 4 | Less than the firm's in-house average after the first client |
| Security and process | 5 | Individual accounts, access removed after the pilot |
The firm decides to expand, after adding the two judgement calls to its client notes.
12Comparing more than one provider
If you pilot two providers, give them the same clients, periods, inputs and brief. Score both before you compare, and weigh review effort and security above price. The best provider is the one whose work your reviewers trust fastest.
13After the pilot: moving to live work
- Agree the full scope and service levels in writing.
- Complete consents and confidentiality agreements for all clients in scope.
- Move clients in waves, starting with those from the pilot.
- Keep detailed review for the first live month, then move to exception-based review.
- Review the scorecard again after three months.
14How Marksford runs pilots
Marksford offers a side-by-side pilot on work you have already closed, so you can compare the output, traceability and review effort against your own work before committing. Pilots can cover our bookkeeping and close service, tax preparation or the products, and client data is handled through secure onboarding after the engagement terms and any required consents are in place.
FAQFrequently asked questions
How long should a pilot take?
Usually two to four weeks from access being granted, depending on the number of clients or returns. Long enough to see consistent work, short enough to decide quickly.
Should I pay for a pilot?
Practice varies. Some providers offer pilots at no charge or at a reduced rate. What matters more is that the scope, rules and scoring are agreed in writing before work starts.
Can I pilot software the same way?
Yes. Run the software on a month or a set of documents you have already completed, then compare its output, traceability and the review time it needs against your own work.
What if the pilot results are mixed?
Look at the cause. Differences from missing client notes are fixable on your side; errors in basic process or weak security answers are reasons to stop.
What is a side-by-side pilot?
An evaluation where a provider redoes work your firm has already completed, so you can compare their output, traceability and review effort against your own.
How big should a pilot be?
Small but representative: three to five bookkeeping clients for one or two months, or five to ten of last year's returns.
What is the most important pilot metric?
Your review effort. It shows the real cost of working with the provider, beyond their fee.
Do I need client consent for a pilot?
The same rules apply as for live work. Get any required taxpayer consents and confidentiality agreements before sharing client data.
→Tools for this topic
→Related guides
This guide is general information for accounting professionals. It is not legal, tax or accounting advice. Marksford is not a CPA firm.