Auditing the auditors
SEO Audit Tools: Crawlers, Browser Extensions and Cloud Auditors, and the Findings None of Them Can Judge
Run an audit tool on a perfectly healthy forty-page website and it can still report a few hundred issues, color dozens of them red and award the site a grade that sounds like a failed exam. Some of those findings are worth an afternoon. Some are worth nothing. The skill is telling them apart, and no tool sold today does that part for you.
October 25, 2026 · 12 min read
The short answer
The best SEO audit tools for most sites are a desktop crawler such as Screaming Frog (free to 500 URLs, $279 a year as of October 2026) or Sitebulb, a page checker such as Lighthouse or SEOquake, and Google Search Console for indexing. Cloud auditors such as Lumar or JetOctopus suit very large sites. None can judge content quality.
On this page
- Every audit tool is a crawler with a rulebook stapled to it
- Screaming Frog and Sitebulb: a full crawl from your own desk
- SEOquake, Lighthouse and the one-page checkup
- Cloud auditors and suite audits, priced as of October 2026
- What Google and Bing will tell you about your own crawl, free
- The findings a crawler cannot weigh
- Sorting a 4,000-issue report in one afternoon
- Which audit tool fits the site you actually have
Every audit tool is a crawler with a rulebook stapled to it
Strip away the dashboards and an SEO audit tool does two things. First it fetches pages the way a search engine bot does, following links from one URL to the next and recording what comes back: status codes, titles, headings, canonical tags, redirects, image sizes, load times. Then it runs that record against a list of rules a vendor wrote, and turns every broken rule into an issue with a color.
The first half is close to objective. The second half is opinion, which is why two tools can audit one site on one morning and disagree about how sick it is. The tools come in four shapes; most sites need two.
Desktop crawlers
Software on your computer that crawls a whole site on demand: Screaming Frog, Sitebulb. Cheap, thorough, limited by your machine's memory.
Page checkers
Extensions and built-in tools that inspect one page at a time: SEOquake, Lighthouse. Quick answers, no view of the whole site.
Cloud auditors
Crawlers on the vendor's servers, run on a schedule, built for very large sites: Lumar, JetOctopus, the suites' audit modules.
The search engines' own reports
Search Console and Bing Webmaster Tools report what Google and Bing actually found. Every other tool is guessing at that.
If you are new to the vocabulary these tools throw at you, read our guide to technical SEO first. The SEO tools hub shows where an audit tool sits in a full stack at each budget.
Screaming Frog and Sitebulb: a full crawl from your own desk
Screaming Frog's SEO Spider is the desktop crawler we reach for first. Its product page lists what it catches: broken links and server errors, redirect chains and loops, missing or duplicate titles and descriptions, exact duplicate pages found with an md5 check, URLs blocked by robots.txt, and images that are too large or lack alt text. The free version crawls up to 500 URLs. Screaming Frog says crawl configuration, saving crawls and advanced features such as JavaScript rendering are also restricted without a license.
As of October 2026 a license costs $279 a year per user on Screaming Frog's pricing page, dropping to $265 each for 5 to 9 licenses, $249 for 10 to 19 and $235 for 20 or more. The paid version's ceiling depends on your memory and storage. A 120-page local site fits in the free version; for a store with 8,000 product URLs, the license is the cheapest serious audit there is.
Sitebulb is the gentler alternative: also on the desktop, but it explains each finding in plain prose where Screaming Frog shows a spreadsheet. Its pricing page lists Lite at 10,000 URLs per audit and Pro at 500,000, with a 14-day Pro trial and no card required. Dollar prices load by script and did not show to our check, so check current pricing; the FAQ puts Sitebulb Cloud from £95 a month.
SEOquake, Lighthouse and the one-page checkup
SEOquake is a free browser extension from Semrush. Its Chrome Web Store listing, updated October 15, 2026, shows about a million users and a 3.5 rating from about 2,600 ratings. It audits the page you are on for issues such as robots directives, hreflang, alt text and structured data, and its SERP overlay prints Semrush metrics under each Google result. One oddity: seoquake.com now redirects to a page checker on Backlinko, a Semrush property, with three free checks a day.
Lighthouse is Google's open-source page auditor, with checks for performance, accessibility, SEO and more. It runs in Chrome DevTools, from the command line or through PageSpeed Insights. Its SEO checks are basic and honest about it: a missing meta description, a page blocked from indexing, an invalid robots.txt, a bad canonical or hreflang, link text that says nothing, tap targets too small for a thumb.
- Use a page checker to confirm a fix on one URL or study a competitor's page, never to judge a whole site.
- Read keyword density as description, not a target. SEOquake reports which words a page repeats most. Google does not ask for a ratio, and its spam policies treat stuffing as a problem; see keyword stuffing.
- Treat Lighthouse's SEO score as a checklist count. Google's documentation says each SEO audit carries equal weight in the score, apart from a manual structured data check, and that Lighthouse does not evaluate the quality of your description.
Many extensions ask permission to read the pages you visit, so install few and remove the ones you stopped using. Our guide to SEO Chrome extensions covers the others worth having and the privacy questions to ask before you click Add to Chrome.
Cloud auditors and suite audits, priced as of October 2026
Past a few hundred thousand URLs, a laptop crawl becomes an overnight job that crashes at 3 a.m. Cloud auditors crawl on a schedule and keep the history. Most businesses never need one. Every figure below comes from the vendor's own pricing or help pages in October 2026, and DataCram is not a partner, affiliate or reseller of any of them.
| Tool | Type | Price | Audit limit | Suits |
|---|---|---|---|---|
| Screaming Frog SEO Spider | Desktop crawler | Free; license $279 a year per user | 500 URLs free; paid limited by memory and storage | Almost everyone, from a 50-page site to a large store |
| Sitebulb | Desktop crawler, cloud option | Check current pricing; Cloud from £95 a month | Lite 10,000 URLs per audit, Pro 500,000 | Owners and marketers who want findings explained in prose |
| SEOquake | Browser extension | Free | One page at a time | Quick checks on your pages and rivals' pages |
| Lighthouse | Built into Chrome, open source | Free | One page at a time | Confirming a fix; speed and accessibility in the same run |
| Ahrefs Free | Cloud audit of your verified sites | Free | 5,000 crawl credits per verified project a month; 170+ issues checked | Small sites that want a scheduled audit at no cost |
| Semrush Site Audit | Suite module | Included in paid plans | 100 pages a month without a paid SEO plan; 140+ checks | Teams already paying for Semrush |
| SE Ranking Website Audit | Suite module | Core $129 a month, or $103.20 billed annually; 14-day trial | 250,000 pages on Core | Small agencies and multi-location businesses |
| JetOctopus | Cloud crawler with log analysis | Growth listed at $349 to $459 a month, depending on billing | 500,000 pages crawled a month; 7-day trial up to 10,000 URLs | Large stores and publishers that need server logs |
| Lumar (formerly Deepcrawl) | Enterprise cloud crawler | Custom pricing after a demo | Set per contract | Enterprises with development teams and release schedules |
Two notes on the free rows. Ahrefs Free only audits sites you verify, so it is no help for studying a competitor. And Semrush's free allowance covers a hundred pages, which is a full audit for many local sites and a sample for everyone else. Plan by plan, our Semrush pricing breakdown and Ahrefs review cover what the suites add on top.
What Google and Bing will tell you about your own crawl, free
A crawler shows what it found. Search Console shows what Google found. Its Page indexing report lists the pages Google left out and why, and URL Inspection shows how Google last saw one page. Search Console's help center adds a line every audit report should print at the top: "Don't expect every URL on your site to be indexed." Google expects to index the canonical pages, not every filtered, paginated or duplicate address.
Bing Webmaster Tools has its own on-demand crawler, Site Scan, which Bing introduced in 2020 as an audit tool that checks a site for common technical SEO issues. It is part of the free account. Our guide to free SEO tools covers both consoles in more depth, and the Search Console guide walks through the indexing reports.
Our own free checks sit beside these. The website audit reviews speed signals, search basics, mobile, security and content and sends the findings as a PDF with fixes. The website health check runs 25 checks on one URL in about ten seconds.
The findings a crawler cannot weigh
An audit tool counts well and judges badly. It knows a title is 71 characters long. It does not know whether the title makes a homeowner in Schertz want to click.
A crawler can tell you
- Which links return 404 or 5xx errors
- Where redirects chain three or four hops deep
- Which pages carry noindex or are blocked by robots.txt
- Which titles and descriptions are missing or duplicated
- Which pages are slow, heavy or missing alt text
Only a person can tell you
- Whether a page answers the search better than the pages above it
- Whether that noindex was a mistake or a decision
- Whether a 404 is a lost page with links or an old page that should be gone
- Whether prices, hours and service areas on the page are still true
- Which fix would bring a customer, and which only moves a score
Google's own documentation undercuts several common audit warnings. Tools flag thin word counts; Google's guidance on helpful content asks whether you are writing to a particular word count and answers its own question: "No, we don't." Tools flag long meta descriptions; Google says there is no limit on their length and that it truncates snippets to fit the screen. Tools flag pages missing from the index; Google says not to expect every URL there. None of that makes the warnings useless. It makes them questions, not orders.
An audit tool can count every heading on the page and still miss that the page is about the wrong thing.
The same goes for the questions Google's guidance asks writers to put to themselves: does the page offer original information, reporting or analysis, and does it show real experience? Our page on E-E-A-T explains why no crawler can score those, and why Google says E-E-A-T itself is not a specific ranking factor.
Sorting a 4,000-issue report in one afternoon
The report arrives sorted by the tool's severity, which is the tool's opinion. Sort it again by damage to the business. This is the order we work in on client sites; it is our practice, not a rule anyone publishes.
- 1
First, anything that hides pages from Google
Noindex on pages that should rank, robots.txt rules blocking folders, server errors on key templates. Confirm each in Search Console first.
- 2
Second, broken paths to the pages that make money
Internal links that 404, and redirect chains on service, product and contact pages. Point each link straight at the final URL. Our guides to redirects and fixing broken links cover the details.
- 3
Third, duplicates and canonicals
Two URLs serving one page, or a canonical tag pointing somewhere odd. The canonical tags guide shows how to read them.
- 4
Fourth, titles and descriptions on the top 20 pages
Fix the pages that earn impressions first. A duplicate title on a 2019 tag archive can wait. The meta tags guide covers what to write.
- 5
Fifth, speed on the templates customers use
One fix to a page template repairs every page built on it. Start with the template your service or product pages share.
- 6
Last, decide what to ignore
Alt text on decorative images, pages you meant to keep out of the index, character counts a few over a vendor's limit. Note why, so the next audit does not reopen the argument.
Crawl again after the fixes, then put the audit on a calendar. A quarterly crawl is part of the routine in our guide to SEO maintenance.
Which audit tool fits the site you actually have
- A local business site under 500 pages: Screaming Frog's free version once a quarter, Lighthouse for single pages, and Search Console every month. Total cost: nothing.
- A growing site of 500 to 50,000 pages: a Screaming Frog license at $279 a year, or Sitebulb if you want the findings explained. Schedule the crawl monthly.
- Anyone already paying for a suite: use the audit inside it before buying another tool. Our Ahrefs vs Semrush comparison lists each suite's audit allowance.
- A store or publisher with hundreds of thousands of URLs: a cloud crawler that keeps history and reads server logs, so you see what Googlebot visits, not only what links exist.
- A site about to be rebuilt or moved: a full crawl before launch, saved, so every old URL can be mapped to a new one. Our website migration work starts there.
The tool is the cheap part. The report it produces can take twenty hours to act on, and an audit nobody works through is a receipt, not a repair.
That is what DataCram's SEO programs do: we run the crawlers we already pay for, sort the findings by what costs you customers, fix them and report the result. Programs run month to month on a defined scope from $625 a month, and the SEO pricing page shows where most local businesses land. If you want to see your own findings first, the free website audit is the place to start.
Questions owners ask about SEO tools
For a whole site, Screaming Frog's SEO Spider, which crawls up to 500 URLs free and finds broken links, redirects, duplicate titles and blocked pages. Pair it with Google Search Console, which shows what Google itself indexed and excluded. For one page at a time, Lighthouse in Chrome DevTools and the SEOquake extension are free. Ahrefs Free also audits sites you verify.
Yes. SEOquake is a free browser extension from Semrush. As of October 2026 its Chrome Web Store listing shows about a million users. It audits the page you are on, overlays Semrush metrics on Google results, reports keyword density and compares URLs, with PDF and CSV exports. The old seoquake.com address now redirects to a Semrush-owned Backlinko page.
As of October 2026, Screaming Frog's pricing page lists the SEO Spider at $279 a year per user, with lower per-license prices from five licenses up. The free version crawls up to 500 URLs but restricts crawl configuration, saving crawls and JavaScript rendering. A license removes the 500 URL cap; the practical limit becomes your computer's memory and storage.
A full crawl every quarter suits most small business sites, plus a crawl after any redesign, migration, plugin overhaul or batch of new pages. Large stores and publishers benefit from monthly or scheduled cloud crawls. Check Search Console's indexing reports monthly between crawls, since they show problems Google actually hit.
Because the scores are each vendor's own invention. The crawl data is mostly objective, but every tool decides which issues count, how severe each one is and how to weight them. Lighthouse, for example, weights its SEO audits equally. Compare a site with itself inside one tool over time, never one tool's score with another's.
Only part of the answer. A crawler can find a stray noindex, a robots.txt block or lost redirects, which are common causes. It cannot see Google updates, competitors improving, or results pages that changed. Compare the date of the drop with Search Console's data first. Our technical SEO guide covers the faults a crawl can find.
Keep reading
- Under the hoodTechnical SEO: The Checklist That Decides Whether Google Can Read Your SiteTechnical SEO in plain English: robots.txt, sitemaps, canonicals, redirects, status codes, rendering and speed, plus a one-afternoon audit you can run free.
- Free SEO toolsFree SEO Tools: The No-Cost Stack, and Exactly Where Each Free Tier StopsThe best free SEO tools from Google, Bing and the free tiers of paid suites, with each one's real limits as of October 2026 and a one-hour monthly routine.
- Keyword research toolsKeyword Research Tools: Free vs Paid, What the Data Means, and the Right One for a Local BusinessKeyword research tools compared: where each gets its numbers, free and paid prices as of October 2026, and which tool suits a local business best.
- Two suites, one budgetAhrefs vs Semrush: Plans, Prices and Limits Side by Side, and Who Should Buy NeitherAhrefs vs Semrush compared on price, credits, rows, rank tracking, history and AI tracking as of October 2026: who should buy which, and who needs neither.
- Google's free dashboardHow to Use Google Search Console: Setup, the Reports Worth Reading and a Monthly RoutineSet up Google Search Console the right way, read the reports that matter, check the new generative AI report and run five checks each month. Free and current.
- Inside the machineHow Search Engines Work: Crawling, Indexing and Ranking, Explained by Google's Own RulesHow Google and Bing find, store and rank pages, in plain English: crawling, rendering, indexing, serving, and where AI Overviews fit. Sourced from Google.
- Everything in SEO ToolsSee the section
Get your audit findings sorted by what they cost you
Send us your site, or the audit report you already have. We will crawl it with the tools we pay for and reply with the handful of fixes that matter and what they would take.
Which of these sounds like you? (pick any)
Rather talk now? Call (210) 346-0848.