Referee or player

Fractional CMO vs Marketing Agency: Who Grades Whom, and Why That Decides It

In the long history of agency reports, very few have recommended firing the agency. That is not corruption. It is incentives, and it marks the whole difference between the company doing the marketing and the person deciding whether the marketing is worth doing.

November 5, 2026 · 8 min read

acmeroofing.com · agency report review
Who is grading the agency
Twelve pages of green arrows, one missing number
  • PassImpressions and clicks reported12 pages
  • WarnCalls tracked to a campaignsearch only
  • FailBooked jobs tied to spendnot reported
  • FailRevenue by channelnot reported
  • PassClient owns the ad account
Illustrative: a sample report review for a fictional company

The short answer

An agency is paid to do marketing work; a fractional CMO is paid to decide what work gets done and grade the results. Most small companies need the agency first. Add a fractional CMO when you pay several vendors, cannot compare them, or suspect the reports flatter the people writing them.

On this page
  1. Follow the invoice: what each one is actually paid to do
  2. Why a dashboard with no dollar in it is not a lie, and is still a problem
  3. When an agency alone is plenty
  4. How a lead and an agency share a table without a fight
  5. When the lead and the agency want opposite things
  6. Five questions that show which one is missing

Follow the invoice: what each one is actually paid to do

Strip away the proposals and the two jobs are easy to tell apart. An agency sells output: campaigns managed, pages written, ads launched. A fractional chief marketing officer sells decisions: how much to spend, on what, with whom, and when to stop. Plenty of agencies offer strategy, and many are good at it. But they offer it as a way of deciding how to use the agency.

An agency and a fractional CMO, by what the money buys
Marketing agencyFractional CMO
Paid forDoing the workDeciding the work and grading it
Natural recommendationMore of what the agency sellsWhatever the numbers support, including less
ScopeIts own servicesEvery channel, vendor and marketing dollar
Works forMany clients, through an account managerYou, for a set number of hours
Report coversIts own resultsAll vendors on one page
Good atProduction, specialists, volumePriorities, budget, accountability
Weak atTelling you to spend elsewhereProducing the work inside the hours

Vendor pricing guides put the two in overlapping ranges. MarketerHire's April 15, 2026 guide lists agencies at $5,000 to $25,000 or more a month and fractional CMOs at $3,000 to $15,000, and it sells fractional talent, so take the comparison with salt. The price overlap is exactly why owners treat them as substitutes. Mostly they are not. For budgeting, see the fractional CMO cost guide.

Why a dashboard with no dollar in it is not a lie, and is still a problem

Picture the report. Impressions up. Clicks up. Sessions up. A ranking chart with a green arrow. An account manager, cheerful on the monthly call, walks through it. Nothing on it is false. It simply stops at the point where the agency's visibility ends. The agency cannot see which leads closed, because the sales data lives in your CRM, or in a binder, or in the owner's head.

Warm shallow-focus photo of a hand with a red pen marking a printed report beside a tablet on a meeting table, no faces
The report crosses the table. Someone on your side of it should hold the red pen.

An agency cannot audit itself for three plain reasons. It chose the metrics. It has no view of the sales data it would need to be judged by, unless someone insists. And its best-informed person has a mortgage that depends on the account. That applies to honest agencies too, and honest ones are common. Ask the same of anyone who grades their own homework: you may get a fair grade, but you cannot tell from the grade. Casey Kinnison, DataCram's fractional CMO, worked as a trader at Wells Fargo and Charles Schwab (past employers, unconnected to our services), and the principle will sound familiar to anyone from that trade: a position should be marked to a real price, not to its holder's opinion of it.

The fix is seldom a new agency. Often it is conversion tracking that reaches the sale and someone on your side who reads it. Our guide to Google Ads problems and the most common sources of ad waste show what that person looks for first.

When an agency alone is plenty

Many companies do not need this seat, and buying it would be a tidy way to waste money. An agency on its own is usually enough when the following describes you.

  • One channel does most of the work. You run local SEO, or you run Google Ads, and a report on that one channel covers nearly all your marketing money.
  • Someone in-house can read the numbers. You or a strong marketing manager can ask the hard question and understand the answer.
  • The spend is modest. A lead's fee would claim too much of the budget, and the first dollars belong in the work.
  • The agency already reports through to revenue. It sees your sales data and shows cost per sale without being asked. Rare, and worth keeping.
  • You have a strong senior marketer. That person is the CMO in everything but title. What they need is more hands.

If that sounds like you, spend your energy on choosing well. Our guide to choosing a marketing agency covers the questions and the contract, and the SEO retainer guide explains what a monthly program should buy. We would rather you buy well from someone than buy this seat from us without needing it.

How a lead and an agency share a table without a fight

The lead sets the target

A budget and a number that counts, such as cost per sale. The agency proposes how to reach it, and it should know its craft better than the lead does.

Tracking lives on your side

Accounts and data sit in your company's name. Everyone reads the same figures, so the monthly call stops being a debate about whose spreadsheet is right.

The agency gets a clear brief

One decision-maker, one contact, fewer surprise requests on a Friday. A good account team has been asking for this for years.

Grades happen monthly, in writing

Keep, fix or stop. A vendor who gets a warning gets a specific reason, and time to answer before anyone cancels anything.

Will your agency resent it? Some will, at first. Its contact has lost easy access to the owner and gained a reader who knows what a click costs. Watch how it responds in the first two meetings. A good agency tends to treat the lead as an ally who can get budget approved. An agency that fights over access to the numbers has told you something useful for free.

When the lead and the agency want opposite things

They will. The agency wants more money for search because search is working. The lead reads the booked revenue and sees that half of those leads never reach the calendar, which points at the phone and not the ad. Both can be right about their own piece. So settle it with a number and leave rank out of it. Agree before the first month which figure decides an argument, usually revenue from booked jobs or closed sales, and write down where that figure comes from. Conversion tracking that follows a lead past the form to the sale does most of the refereeing.

Then give the disputed idea a small test with an end date and a dollar limit. Four weeks and a fixed budget will tell you more than four meetings. If the test wins, the agency gets its budget and the credit. If it loses, the money moves and nobody has to apologize. This is the trader's habit again: size the position, set the exit and read the real number when the date arrives.

Five questions that show which one is missing

A quick diagnosis. This is our judgment, not research.
If yes, you needWhy
Is the work simply not getting done?An agency or more handsDirection is not the bottleneck
Do you pay three or more vendors with no common report?A leadNobody can compare them
Does your report stop before revenue?Tracking first, possibly a leadNo dollar means no decision
Has nobody cut a marketing line in a year?A leadStopping things is nobody's job
Do you know your numbers and only need capacity?An agencyYou are already doing the CMO's work

Keep the accounts yours under every answer. The ad accounts, analytics, Google Business Profile, domain and call tracking should sit in your company's name, with vendors added as users. It costs nothing, it makes every change of vendor less painful, and it is the first thing a lead would ask for anyway. The marketing tracking problems page lists what commonly breaks when they do not.

If the free options come first, use them: the site audit and local visibility check give an outside read at no cost. The fractional CMO overview explains the service, and if developers are the vendors you cannot grade, the fractional CTO section covers that side. To talk it over, send us your vendor list.

Questions owners ask about a fractional CMO

If the work is not getting done, you need an agency or more hands. If work is getting done and nobody can say whether it pays, you need someone who decides and grades. Many companies under $25 million in revenue need the agency first and add part-time leadership once several vendors are in play and the reports stop agreeing.

It can give useful advice, and many agencies offer it. What it cannot do well is judge its own work or tell you plainly to spend the money elsewhere. If you go that way, keep the accounts in your name, ask for sales numbers on the report and get an occasional outside review.

A decent one starts by reading the numbers and giving the agency a clear target. If the work holds up, the agency stays, and often gets a better brief. Replacing a vendor costs time and data, so it should not be a reflex. Be cautious if a new lead proposes replacing your agency with their own firm in the first month.

The numbers go first, then the owner decides. A lead should bring the disagreement to you with the evidence and a recommendation, and should agree on a test where that makes sense: same budget, set period, one number to judge it by. Disagreement is healthy. A lead and an agency that never disagree may just be avoiding the work of checking.

Ask for access to your ad accounts and analytics, then ask one question each month: what did we spend, how many sales came from it, and what did each one cost? Match that against your own books. Free tools such as our site audit and map pack audit add an outside view. Our guide to SEO numbers explains what to request.

Keep reading

Free · No obligation

Find out whether your agency needs a referee

Tell us who you pay and what the reports show. A person at DataCram reads it and replies with an honest view, which may well be that your agency is enough.

Which of these sounds like you? (pick any)

Rather talk now? Call (210) 346-0848.

CallGet a quote