scan.now
Premium Scan a site

Crawl a Website and Find Every SEO Problem

Crawls your site the way a search engine does, following internal links and your sitemap, and reports everything holding it back: indexability, titles and descriptions, headings, duplicate and thin content, broken and orphaned links, image alt text, speed, structured data and international targeting. It is a sample rather than a full crawl, and the report says which fraction of your site it covered.

A sample, not a full crawl: We start at this URL, follow internal links and read the sitemap, up to the page budget you choose. On a large site that is a fraction of the pages, and the report says which fraction. How we scan · Acceptable use

Illustration of the seo & site health audit in use

How it works

  1. Enter your site

    We start at the URL you give and follow internal links, honouring robots.txt.

  2. Up to your chosen budget is crawled

    30, 100 or 250 pages, seeded from your entry point and your sitemap. Each is recorded with its status, redirect chain, timing, size, headings, links and metadata.

  3. Read the issues, most serious first

    Site-wide problems such as duplicate titles and orphan pages only appear across a crawl, which is why one-page tools miss them.

What this tool checks

47 checks across 7 areas. Each links to its reference page with the test, the risk and the fix.

Full reference

Titles, headings and content

13 checks

Indexing and crawlability

10 checks

International targeting

3 checks

Links and site structure

7 checks

Images and page weight

3 checks

Structured data and social

4 checks

Technical SEO and speed

7 checks

The ones that most often decide the grade:

High Pages excluded with noindexA noindex directive removes a page from search results entirely. Applied by accident, it is the fastest way to lose traffic. High Crawl errors (4xx / 5xx)URLs reached during the crawl that returned a client or server error. Every one is a dead end for a visitor and for... High Redirect loopsA URL that redirects back to something already in its own chain never resolves. The page is unreachable for everyone. High Page title missingThe title element is the headline of every search result and the label on every browser tab. A page without one has no name. High Duplicate body contentTwo pages with identical body text are one page at two addresses, and search engines will pick one of them for you. High Broken internal linksAn internal link that returns an error is a dead end for the reader and a wasted request for the crawler.

After this one, most people run Website Scanner, SSL / TLS Checker, or Security Headers. Each answers a different question about the same thing, and the full list of tools explains which to reach for when. Every finding links through to the checks reference.

Guides for this tool

Background reading written to go with these results.

13 min read · Updated Sep 13, 2026 Website Security: What a Vulnerability Scan Looks For and How to Fix It

A website vulnerability scan checks the parts of a site an attacker can reach without logging in: Transport security, HTTP headers,...

Read the guide 9 min read · Updated Sep 18, 2026 How to Read a Security Scan Report: Severity, False Positives and What to Fix First

A scan report is a list of findings with severities, and the hard part is deciding what matters. How severities are assigned, how to...

Read the guide

Frequently asked questions

How many pages do you crawl?

As many as the budget you pick: 30, 100 or 250. Breadth-first from the URL you enter, plus URLs taken from your sitemap, honouring robots.txt throughout. On a large site that is a small sample, and the report states the percentage it covered rather than implying it saw everything. The point is to find the patterns your templates repeat, which a sample shows perfectly well.

Is this the same as Lighthouse?

It overlaps deliberately. Lighthouse audits one page in a real browser and measures rendering; this crawls many pages and finds the problems that only exist across a site. The per-page SEO audits here follow Lighthouse's, and the crawl-wide issue model follows SEOnaut's.

Will the crawl slow my site down?

No. Requests are paced, run four at a time at most, and stop at the budget you chose. Even at 250 pages it is a fraction of the load a search engine crawler places on the same site in a day.

Do you run JavaScript?

No. We read the HTML the server sends, which is what a crawler indexes first. If your content only exists after hydration, this scan shows you what a crawler sees before it runs your scripts, which is usually the more useful view.

Can it find orphan pages?

Only where you have a sitemap. Following links can reach nothing but linked pages, so a crawl on its own can never find a page with no links to it. We seed the crawl with sitemap URLs and report the ones that turned out to have no inbound link from any page we saw. Without a sitemap the check is skipped rather than passed, because passing it would mean claiming something we did not test.

Why does word count matter?

It does not, on its own. It is a proxy for whether a page covers its subject, and it is reported so you can look. A 90-word contact page is fine; ninety 90-word pages generated from a template are the pattern search engines act on.