Loading...
This website uses cookies to improve user experience. Read more in our Privacy Policy.
Loading...
Hold Ctrl (or Cmd on Mac) to select multiple user agents. Selected: 1 agent
Disallow: /wp-admin/
WordPress admin dashboard
Disallow: /wp-includes/
WordPress system files
Disallow: /wp-content/plugins/
WordPress plugin folders
Allow: /wp-admin/admin-ajax.php
Required for site functionality
Allow: /wp-content/uploads/
Images and media files
Adds delay between crawler requests
Please verify that you're not a robot to generate your robots.txt file.
# Your robots.txt file will appear here
Please complete the human verification above to download or copy your robots.txt file.
Last month, a small business owner called me in a panic. "Google isn't showing any of my pages!" he said. Turns out, he'd tried to create a robots.txt file himself and accidentally blocked his entire website. One tiny typo cost him three weeks of lost traffic.
Don't be that guy.
Creating a robots.txt file might seem simple, but mess up the syntax and you could accidentally hide your whole site from Google. Or worse, you could leave sensitive pages completely exposed.
Our Robots.txt Generator takes the guesswork out of it. Just click what you want to block or allow, and we'll create a bulletproof robots.txt file that actually works.
Think of robots.txt as a bouncer for your website. It stands at the front door and tells visiting search engine bots, "Hey, you can check out these pages, but stay away from those ones over there."
Real-world example: Your WordPress admin area is at /wp-admin/. You definitely don't want that showing up in Google search results, right? Robots.txt keeps it hidden.
But here's what trips people up - the syntax is super picky. Miss a slash, forget a colon, or use the wrong case, and boom - your file either doesn't work or blocks the wrong stuff.
No memorizing weird syntax or Googling "how to write robots.txt" for the hundredth time.
Because nobody has time to learn robot syntax when you've got a business to run.
We've built templates for every major platform that already know what to block and what to leave alone.
/wp-admin/ (your admin area)/wp-includes/ (WordPress core files)/wp-content/plugins/ (plugin folders)/wp-content/uploads/ (your images)/wp-admin/admin-ajax.php (site functions)See exactly what your robots.txt file will look like before you download it.
Which means no surprises when you upload the file to your website.
User-agent: * Disallow: /admin/ Disallow: /private/ Disallow: /tmp/ Disallow: /staging/
User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/
User-agent: * Disallow: /cart/ Disallow: /checkout/ Disallow: /account/ Disallow: /admin/
User-agent: * Disallow: /dev/ Disallow: /test/ Disallow: /staging/ Disallow: /*.pdf$
/admin/ or /wp-admin/ (admin areas)/private/ (personal stuff)/tmp/ (temporary files)/staging/ (test environments)Discover our complete suite of free SEO tools designed to help you optimize your website, improve rankings, and drive more organic traffic.
Optimize your keyword usage and avoid over-optimization penalties.
Try Tool →Create perfect robots.txt files without breaking your website.
✓ Current ToolAll tools are 100% free • No signup required • Instant results
Stop leaving your website's crawlability to chance. Create a professional robots.txt file that guides search engines to your good stuff while keeping the private pages private.
Create your file in 2 minutes - completely free
Don't let a tiny text file break your SEO. Use SEO Shouts' Robots.txt Generator and do it right the first time.
Built by people who've seen every robots.txt disaster imaginable, so you don't have to experience them yourself.