AI Tools Finder
Home › Dev Tools › Robots.txt Tester

Robots.txt Tester — Check Blocked URLs

Paste your robots.txt and check whether a URL is blocked or allowed for each bot.

Related tools

UTM Code Generator Create UTM tracking links for Google Analytics: fill in Source/Medium/Campaign... and get a ready-to-copy standard URL. Meta Tag Generator Generate SEO meta tags (title, description, keywords, robots, viewport) to paste into your <head>. Open Graph Generator Generate Open Graph tags (og:title, og:description, og:image, og:url) for Facebook and Zalo. Twitter Card Generator Generate Twitter Card tags (summary, summary_large_image) so your links display nicely on Twitter/X. Robots.txt Generator Create a robots.txt file with Allow/Disallow rules, Sitemap declarations, and Crawl-delay for bots. Sitemap Generator Generate a sitemap.xml file from a list of URLs, with changefreq, priority, and lastmod set for each URL.
🔒 Robots.txt Tester — Check Blocked URLs runs entirely in your browser — the data you enter is not sent to any server. Free, no sign-up required. See145 free dev tools more.