CrawllytFree SEO Audit Tool
CrawllytSEO · Technical · AI Search Intelligence
Free SEO tool · Crawllyt

Free LLMs.txt Validator and Checker

Find out whether your llms.txt is ready for AI tools. Check a live file by its address, paste the contents or open it from your computer, and get a Crawllyt quality score with a plain-English fix for each item.

What it checks

  • A "# Title" on the first line, the only required part
  • A one-sentence summary and grouped sections
  • Bulleted links with a short note on each
  • Enough pages listed, with none repeated
  • Live test of up to 15 links to catch broken pages
  • A sensible overall length for an index file

How to use it

  1. Log in to your free Crawllyt account.
  2. Enter your website address, paste the file, or open it from your device.
  3. Work through the items marked Error first, then Warning, and check again.

The score is Crawllyt’s own quality measure. Apart from the title line, the checks are recommendations rather than formal rules.

What the checker looks at

The llms.txt proposal is short: it asks for a title on the first line and suggests a summary, sections and annotated links. Crawllyt turns those suggestions into seven practical checks and adds two of its own, links that actually work and a length that suits an index file, for nine checks in total.

How the score works

  • Title heading: 20 points. Without it the file does not follow the format at all.
  • Summary line, grouped sections, link format, link notes, enough pages and no repeated links: 10 points each.
  • Working links: 15 points, shared across up to 15 tested links.
  • File length: 5 points for roughly 200 to 10,000 tokens.
  • 90 or more: Ready to publish. 70 to 89: Almost there. 50 to 69: Needs fixes. Below 50: Rebuild recommended.

Common problems and quick fixes

  • Text above the title: delete anything before the "# Name" line, including blank headings or comments.
  • Links pasted as plain addresses: write them as "- [Page name](https://…): what it covers" so tools can read the label and the note.
  • Broken links: pages that were moved or deleted return errors. Update the address or remove the line.
  • The file shows as a web page: your server is sending an HTML page instead of the text file. Check the file name and folder, and any redirects.

Checking files that are not public yet

Paste the contents or open the file from your computer to check a draft before you publish it. Opened files are read by your browser and are not stored by Crawllyt.

Frequently asked questions

Where should my llms.txt file be?

At the root of your domain, for example https://example.com/llms.txt. Files in a subfolder can still be checked, but AI tools usually look at the root first.

Why does my file show an error for the title?

The first line with text must start with "# " followed by your site or project name. Move any other text below it.

Why are some links marked as not answering?

Some websites block automated requests or respond slowly. These links are not counted as broken; open them in your browser to confirm they work.

Does a perfect score guarantee AI tools will use my site?

No. The score measures how clear and correct your file is. Each AI company decides whether and how it reads llms.txt.

Can I check someone else’s llms.txt?

Yes. Enter any public website address to review how other sites structure their file.

Home   ›   SEO   ›   Site Audit

Site Audit

Real page checks. Affected URLs. Clear next steps.

Crawllyt · v29

Public pages only · Recursively discovers up to 5,000 internal URLs. Keep this tab open; large scans can take a long time. Query URLs and non-page files are excluded.

Start with a URL

Your report will show every check, including passed checks and items requiring manual verification. No scores are shown until a website has been fetched successfully.

On-page SEOTitles, descriptions and lengths, duplicate titles across the sample, H1–H6 headings, image alt text.
Technical & trackingRobots.txt, GA4 and GTM IDs, Search Console meta tag, broken links and redirect destinations.
AI search & GEOSchema types, llms.txt, visible-content signals and clearly labelled heuristic scores.