Auditing the auditors

SEO Audit Tools: Crawlers, Browser Extensions and Cloud Auditors, and the Findings None of Them Can Judge

Run an audit tool on a perfectly healthy forty-page website and it can still report a few hundred issues, color dozens of them red and award the site a grade that sounds like a failed exam. Some of those findings are worth an afternoon. Some are worth nothing. The skill is telling them apart, and no tool sold today does that part for you.

October 25, 2026 · 12 min read

The short answer

The best SEO audit tools for most sites are a desktop crawler such as Screaming Frog (free to 500 URLs, $279 a year as of October 2026) or Sitebulb, a page checker such as Lighthouse or SEOquake, and Google Search Console for indexing. Cloud auditors such as Lumar or JetOctopus suit very large sites. None can judge content quality.

On this page
  1. Every audit tool is a crawler with a rulebook stapled to it
  2. Screaming Frog and Sitebulb: a full crawl from your own desk
  3. SEOquake, Lighthouse and the one-page checkup
  4. Cloud auditors and suite audits, priced as of October 2026
  5. What Google and Bing will tell you about your own crawl, free
  6. The findings a crawler cannot weigh
  7. Sorting a 4,000-issue report in one afternoon
  8. Which audit tool fits the site you actually have

Every audit tool is a crawler with a rulebook stapled to it

Strip away the dashboards and an SEO audit tool does two things. First it fetches pages the way a search engine bot does, following links from one URL to the next and recording what comes back: status codes, titles, headings, canonical tags, redirects, image sizes, load times. Then it runs that record against a list of rules a vendor wrote, and turns every broken rule into an issue with a color.

The first half is close to objective. The second half is opinion, which is why two tools can audit one site on one morning and disagree about how sick it is. The tools come in four shapes; most sites need two.

Desktop crawlers

Software on your computer that crawls a whole site on demand: Screaming Frog, Sitebulb. Cheap, thorough, limited by your machine's memory.

Page checkers

Extensions and built-in tools that inspect one page at a time: SEOquake, Lighthouse. Quick answers, no view of the whole site.

Cloud auditors

Crawlers on the vendor's servers, run on a schedule, built for very large sites: Lumar, JetOctopus, the suites' audit modules.

The search engines' own reports

Search Console and Bing Webmaster Tools report what Google and Bing actually found. Every other tool is guessing at that.

If you are new to the vocabulary these tools throw at you, read our guide to technical SEO first. The SEO tools hub shows where an audit tool sits in a full stack at each budget.

Screaming Frog and Sitebulb: a full crawl from your own desk

Screaming Frog's SEO Spider is the desktop crawler we reach for first. Its product page lists what it catches: broken links and server errors, redirect chains and loops, missing or duplicate titles and descriptions, exact duplicate pages found with an md5 check, URLs blocked by robots.txt, and images that are too large or lack alt text. The free version crawls up to 500 URLs. Screaming Frog says crawl configuration, saving crawls and advanced features such as JavaScript rendering are also restricted without a license.

As of October 2026 a license costs $279 a year per user on Screaming Frog's pricing page, dropping to $265 each for 5 to 9 licenses, $249 for 10 to 19 and $235 for 20 or more. The paid version's ceiling depends on your memory and storage. A 120-page local site fits in the free version; for a store with 8,000 product URLs, the license is the cheapest serious audit there is.

Sitebulb is the gentler alternative: also on the desktop, but it explains each finding in plain prose where Screaming Frog shows a spreadsheet. Its pricing page lists Lite at 10,000 URLs per audit and Pro at 500,000, with a 14-day Pro trial and no card required. Dollar prices load by script and did not show to our check, so check current pricing; the FAQ puts Sitebulb Cloud from £95 a month.

SEOquake, Lighthouse and the one-page checkup

SEOquake is a free browser extension from Semrush. Its Chrome Web Store listing, updated October 15, 2026, shows about a million users and a 3.5 rating from about 2,600 ratings. It audits the page you are on for issues such as robots directives, hreflang, alt text and structured data, and its SERP overlay prints Semrush metrics under each Google result. One oddity: seoquake.com now redirects to a page checker on Backlinko, a Semrush property, with three free checks a day.

Lighthouse is Google's open-source page auditor, with checks for performance, accessibility, SEO and more. It runs in Chrome DevTools, from the command line or through PageSpeed Insights. Its SEO checks are basic and honest about it: a missing meta description, a page blocked from indexing, an invalid robots.txt, a bad canonical or hreflang, link text that says nothing, tap targets too small for a thumb.

  • Use a page checker to confirm a fix on one URL or study a competitor's page, never to judge a whole site.
  • Read keyword density as description, not a target. SEOquake reports which words a page repeats most. Google does not ask for a ratio, and its spam policies treat stuffing as a problem; see keyword stuffing.
  • Treat Lighthouse's SEO score as a checklist count. Google's documentation says each SEO audit carries equal weight in the score, apart from a manual structured data check, and that Lighthouse does not evaluate the quality of your description.

Many extensions ask permission to read the pages you visit, so install few and remove the ones you stopped using. Our guide to SEO Chrome extensions covers the others worth having and the privacy questions to ask before you click Add to Chrome.

Cloud auditors and suite audits, priced as of October 2026

Past a few hundred thousand URLs, a laptop crawl becomes an overnight job that crashes at 3 a.m. Cloud auditors crawl on a schedule and keep the history. Most businesses never need one. Every figure below comes from the vendor's own pricing or help pages in October 2026, and DataCram is not a partner, affiliate or reseller of any of them.

SEO audit tools compared, as of October 2026 (vendor pricing and help pages)
ToolTypePriceAudit limitSuits
Screaming Frog SEO SpiderDesktop crawlerFree; license $279 a year per user500 URLs free; paid limited by memory and storageAlmost everyone, from a 50-page site to a large store
SitebulbDesktop crawler, cloud optionCheck current pricing; Cloud from £95 a monthLite 10,000 URLs per audit, Pro 500,000Owners and marketers who want findings explained in prose
SEOquakeBrowser extensionFreeOne page at a timeQuick checks on your pages and rivals' pages
LighthouseBuilt into Chrome, open sourceFreeOne page at a timeConfirming a fix; speed and accessibility in the same run
Ahrefs FreeCloud audit of your verified sitesFree5,000 crawl credits per verified project a month; 170+ issues checkedSmall sites that want a scheduled audit at no cost
Semrush Site AuditSuite moduleIncluded in paid plans100 pages a month without a paid SEO plan; 140+ checksTeams already paying for Semrush
SE Ranking Website AuditSuite moduleCore $129 a month, or $103.20 billed annually; 14-day trial250,000 pages on CoreSmall agencies and multi-location businesses
JetOctopusCloud crawler with log analysisGrowth listed at $349 to $459 a month, depending on billing500,000 pages crawled a month; 7-day trial up to 10,000 URLsLarge stores and publishers that need server logs
Lumar (formerly Deepcrawl)Enterprise cloud crawlerCustom pricing after a demoSet per contractEnterprises with development teams and release schedules

Two notes on the free rows. Ahrefs Free only audits sites you verify, so it is no help for studying a competitor. And Semrush's free allowance covers a hundred pages, which is a full audit for many local sites and a sample for everyone else. Plan by plan, our Semrush pricing breakdown and Ahrefs review cover what the suites add on top.

What Google and Bing will tell you about your own crawl, free

A crawler shows what it found. Search Console shows what Google found. Its Page indexing report lists the pages Google left out and why, and URL Inspection shows how Google last saw one page. Search Console's help center adds a line every audit report should print at the top: "Don't expect every URL on your site to be indexed." Google expects to index the canonical pages, not every filtered, paginated or duplicate address.

Bing Webmaster Tools has its own on-demand crawler, Site Scan, which Bing introduced in 2020 as an audit tool that checks a site for common technical SEO issues. It is part of the free account. Our guide to free SEO tools covers both consoles in more depth, and the Search Console guide walks through the indexing reports.

Our own free checks sit beside these. The website audit reviews speed signals, search basics, mobile, security and content and sends the findings as a PDF with fixes. The website health check runs 25 checks on one URL in about ten seconds.

The findings a crawler cannot weigh

An audit tool counts well and judges badly. It knows a title is 71 characters long. It does not know whether the title makes a homeowner in Schertz want to click.

A crawler can tell you

  • Which links return 404 or 5xx errors
  • Where redirects chain three or four hops deep
  • Which pages carry noindex or are blocked by robots.txt
  • Which titles and descriptions are missing or duplicated
  • Which pages are slow, heavy or missing alt text

Only a person can tell you

  • Whether a page answers the search better than the pages above it
  • Whether that noindex was a mistake or a decision
  • Whether a 404 is a lost page with links or an old page that should be gone
  • Whether prices, hours and service areas on the page are still true
  • Which fix would bring a customer, and which only moves a score

Google's own documentation undercuts several common audit warnings. Tools flag thin word counts; Google's guidance on helpful content asks whether you are writing to a particular word count and answers its own question: "No, we don't." Tools flag long meta descriptions; Google says there is no limit on their length and that it truncates snippets to fit the screen. Tools flag pages missing from the index; Google says not to expect every URL there. None of that makes the warnings useless. It makes them questions, not orders.

An audit tool can count every heading on the page and still miss that the page is about the wrong thing.

The same goes for the questions Google's guidance asks writers to put to themselves: does the page offer original information, reporting or analysis, and does it show real experience? Our page on E-E-A-T explains why no crawler can score those, and why Google says E-E-A-T itself is not a specific ranking factor.

Sorting a 4,000-issue report in one afternoon

The report arrives sorted by the tool's severity, which is the tool's opinion. Sort it again by damage to the business. This is the order we work in on client sites; it is our practice, not a rule anyone publishes.

  1. 1

    First, anything that hides pages from Google

    Noindex on pages that should rank, robots.txt rules blocking folders, server errors on key templates. Confirm each in Search Console first.

  2. 2

    Second, broken paths to the pages that make money

    Internal links that 404, and redirect chains on service, product and contact pages. Point each link straight at the final URL. Our guides to redirects and fixing broken links cover the details.

  3. 3

    Third, duplicates and canonicals

    Two URLs serving one page, or a canonical tag pointing somewhere odd. The canonical tags guide shows how to read them.

  4. 4

    Fourth, titles and descriptions on the top 20 pages

    Fix the pages that earn impressions first. A duplicate title on a 2019 tag archive can wait. The meta tags guide covers what to write.

  5. 5

    Fifth, speed on the templates customers use

    One fix to a page template repairs every page built on it. Start with the template your service or product pages share.

  6. 6

    Last, decide what to ignore

    Alt text on decorative images, pages you meant to keep out of the index, character counts a few over a vendor's limit. Note why, so the next audit does not reopen the argument.

Crawl again after the fixes, then put the audit on a calendar. A quarterly crawl is part of the routine in our guide to SEO maintenance.

Which audit tool fits the site you actually have

  • A local business site under 500 pages: Screaming Frog's free version once a quarter, Lighthouse for single pages, and Search Console every month. Total cost: nothing.
  • A growing site of 500 to 50,000 pages: a Screaming Frog license at $279 a year, or Sitebulb if you want the findings explained. Schedule the crawl monthly.
  • Anyone already paying for a suite: use the audit inside it before buying another tool. Our Ahrefs vs Semrush comparison lists each suite's audit allowance.
  • A store or publisher with hundreds of thousands of URLs: a cloud crawler that keeps history and reads server logs, so you see what Googlebot visits, not only what links exist.
  • A site about to be rebuilt or moved: a full crawl before launch, saved, so every old URL can be mapped to a new one. Our website migration work starts there.

The tool is the cheap part. The report it produces can take twenty hours to act on, and an audit nobody works through is a receipt, not a repair.

That is what DataCram's SEO programs do: we run the crawlers we already pay for, sort the findings by what costs you customers, fix them and report the result. Programs run month to month on a defined scope from $625 a month, and the SEO pricing page shows where most local businesses land. If you want to see your own findings first, the free website audit is the place to start.

Questions owners ask about SEO tools

For a whole site, Screaming Frog's SEO Spider, which crawls up to 500 URLs free and finds broken links, redirects, duplicate titles and blocked pages. Pair it with Google Search Console, which shows what Google itself indexed and excluded. For one page at a time, Lighthouse in Chrome DevTools and the SEOquake extension are free. Ahrefs Free also audits sites you verify.

Yes. SEOquake is a free browser extension from Semrush. As of October 2026 its Chrome Web Store listing shows about a million users. It audits the page you are on, overlays Semrush metrics on Google results, reports keyword density and compares URLs, with PDF and CSV exports. The old seoquake.com address now redirects to a Semrush-owned Backlinko page.

As of October 2026, Screaming Frog's pricing page lists the SEO Spider at $279 a year per user, with lower per-license prices from five licenses up. The free version crawls up to 500 URLs but restricts crawl configuration, saving crawls and JavaScript rendering. A license removes the 500 URL cap; the practical limit becomes your computer's memory and storage.

A full crawl every quarter suits most small business sites, plus a crawl after any redesign, migration, plugin overhaul or batch of new pages. Large stores and publishers benefit from monthly or scheduled cloud crawls. Check Search Console's indexing reports monthly between crawls, since they show problems Google actually hit.

Because the scores are each vendor's own invention. The crawl data is mostly objective, but every tool decides which issues count, how severe each one is and how to weight them. Lighthouse, for example, weights its SEO audits equally. Compare a site with itself inside one tool over time, never one tool's score with another's.

Only part of the answer. A crawler can find a stray noindex, a robots.txt block or lost redirects, which are common causes. It cannot see Google updates, competitors improving, or results pages that changed. Compare the date of the drop with Search Console's data first. Our technical SEO guide covers the faults a crawl can find.

Keep reading

Free · No obligation

Get your audit findings sorted by what they cost you

Send us your site, or the audit report you already have. We will crawl it with the tools we pay for and reply with the handful of fixes that matter and what they would take.

Which of these sounds like you? (pick any)

Rather talk now? Call (210) 346-0848.

CallGet a quote