Robots.txt Checker

Check the robots.txt response for a public website.

Page URL

Check results

Checking…

About this check

This checks the response from /robots.txt on the final page origin. Use Search Console to check whether a specific Google crawler can fetch an important URL.

Related tools

Website SEO Checker
Search Indexing Directives
Noindex Checker

WebCheckKit

All tools Check multiple pages Launch checklist