Free Tool

Robots.txt Tester

Fetch and parse your robots.txt file. View all crawl rules, test whether specific paths are allowed or blocked for Googlebot.

Want automated monitoring for all of this?

PerfectSearch continuously monitors your bot visibility and alerts you when something breaks.