How to Audit a Website With AI (Free)

My site was stuck at 40,000 monthly visits for a year. Forty thousand. Not growing, not shrinking — a flatline that made me want to quit SEO entirely. I finally paid $180 for a “premium audit” and got back a 60-page PDF telling me my titles were too long and I should add more internal links.

I’d known that. Everyone knows that. What I actually needed was someone to look at the crawl data and tell me what was broken in order of impact. Turns out, free tools plus an AI with a decent prompt can do exactly that. Here’s the free website audit workflow I’ve used ever since.

The Problem: Audits Are Expensive or Useless — Usually Both

Paid audit tools run $100+ a month, and the free trials shove a 20-page report at you that’s 80% noise. Meanwhile the actual issues — broken pages, orphaned content, thin pages cannibalizing each other, redirect chains — sit there untouched because nobody connected the raw data to the strategy.

An audit is really two jobs: collecting the data (crawling) and interpreting it (analysis). The first is free with Screaming Frog’s limited version. The second is free with ChatGPT or Claude. You just have to ask the right questions.

The Best Free Tool: Screaming Frog (500-URL Crawl) + ChatGPT or Claude

Screaming Frog’s free license crawls up to 500 URLs — enough for most small and medium sites. It exports everything: titles, meta descriptions, response codes, redirects, word counts, duplicate content. Then you hand those exports to ChatGPT or Claude for the interpretation. That’s the whole stack: free crawler, free AI, zero subscriptions.

What You Need Before You Start

• Screaming Frog SEO Spider (free license, 500 URL limit)
• A free ChatGPT or Claude account
• Your site’s XML sitemap URL
• About an hour, mostly spent pasting and reading

Step-by-Step: Audit Like Someone Paid For It

Step 1 — Crawl your site. Open Screaming Frog, enter your domain, hit start. For sites under 500 URLs it finishes in a few minutes. Watch the crawl for obvious red flags — 404s, redirects, pages with no title — while it runs.

Step 2 — Export the data you’ll actually analyze. You want three exports: All URLs (with titles, descriptions, word counts), Response Codes, and the Inlinks report. Skip the rest for now — analysis paralysis kills more audits than ignorance.

Step 3 — Run a technical analysis pass. Paste your response codes and URL list into the AI:

Here is the crawl data from my site [paste URLs with status codes]. List the technical problems in order of impact: broken pages, redirect chains, blocked pages, duplicate titles, and anything that looks like a crawlability issue. For each, tell me exactly what to fix and how urgent it is. Assume I’m technical enough to use an .htaccess file but not a developer.

Step 4 — Run a content audit pass. This is where the AI earns its keep. Export your URL list with titles and word counts, then:

Here is a list of my site’s pages with word counts [paste data]. Identify: pages under 300 words that look thin, pages that target the same topic and might cannibalize each other, pages with no clear keyword focus, and pages that deserve expansion because the topic matters to my niche ([niche]). Sort by which fix would move traffic the most.

Step 5 — Turn findings into a prioritized list. Ask the AI to convert everything into a simple table: fix, effort (30 min / half day / full day), and expected impact (high/medium/low). Then start at the top. One fix a week beats a panic weekend every time.

Real Result: What You’ll Actually See

My first audit with this workflow surfaced something the $180 report missed entirely: 14 blog posts under 250 words that were ranking on page two for decent keywords — and starving. The AI flagged them as “thin content wasting good intent”, and it was right. I expanded the top four, merged two near-duplicates, and within two months those pages pulled the site off the flatline — 40K became 52K, then 61K.

You’ll also see the boring stuff, and that’s fine: three 404s pointing at old product pages, a redirect chain of four hops, and 11 pages with missing meta descriptions. Fixing the boring stuff is what makes the exciting stuff work.

Limitations: What the Free Setup Won’t Do

Be honest with yourself here. The 500-URL cap is real — bigger sites need the paid Screaming Frog or a crawl service. The free AI tiers will choke on huge pastes; you’ll have to split your exports into chunks, which is tedious. And neither tool measures what you can’t see: search console click data, backlink profiles, or Core Web Vitals. You’re auditing structure, not authority — those are different games.

Also: the AI interprets whatever you paste, and if your export is messy, its analysis will be messy. Garbage in, confident-sounding garbage out. Read the raw data yourself at least once before trusting the summary.

When to Upgrade

Upgrade when your site outgrows 500 URLs, or when you want automated weekly crawling and alerts instead of manual audit sessions. The paid Screaming Frog (~$259/year) or a tool like Semrush covers that. For a site under 500 pages, this free workflow gives you 90% of the value — the missing 10% is monitoring, not insight.

Alternatives to Try

• Google Search Console — free, gives you real indexing and click data the crawler can’t
• PageSpeed Insights — free, for the Core Web Vitals part of the audit
• Sitebulb free trial — friendlier visuals than Screaming Frog if you hate spreadsheets

Related Free Resources

For the analysis side of audits, the free SEO prompts sample pack includes the exact audit-analysis prompts above. And the free AI Creator Stack workflow shows how this audit fits into a full content operation — from research to publishing to reviewing what worked. Everything lives in the free library.

Related Paid Systems

Want the full audit prompt library plus the operational side? The AI Creator Operating System 2026 ($39) includes audit and optimization workflows for your whole content pipeline. And the 50 SEO Prompts for ChatGPT ($9.99) has dedicated technical and content audit prompts, ready to paste.