← Tool Details & Guide
Robots.txt Generator
Configure Directives
Target Search Engine / Bot
All Robots (*)
Googlebot (Google)
Bingbot (Microsoft Bing)
Baiduspider (Baidu)
YandexBot (Yandex)
DuckDuckBot
Yahoo! Slurp
Crawl Delay (Seconds)
No Delay (Standard)
5 Seconds
10 Seconds
20 Seconds
XML Sitemap URL
Disallowed Paths (Block Crawling)
×
×
×
Add Disallow Path
Allowed Paths (Explicitly Allow)
×
Add Allow Path
robots.txt Preview
Output: robots.txt
Copy
Download
Copied to clipboard!