robots.txt Tester
Test which URLs are allowed or blocked by your robots.txt rules.
Results
+
/allow: /+
/blog/my-postallow: /-
/dashboarddisallow: /dashboard-
/api/toolsdisallow: /api/*+
/aboutallow: /
Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever