About the Robots.txt Generator
Choose a preset or write your own rules for each crawler, add your sitemap and download a ready-to-upload robots.txt.
Robots.txt Generator
Create a robots.txt file with crawler rules, sitemap links and presets, including blocking AI crawlers.
- Fill in your page details
- Check the live preview
- Copy the code
Runs in your browser. Your data and files never leave your device.
Frequently asked questions
Does robots.txt stop a page appearing in Google?
Not reliably — a blocked page can still be indexed if other sites link to it. Use a noindex meta tag (and let Google crawl the page) to keep it out of results.
Related tools
- XML Sitemap GeneratorTurn a list of page URLs into a valid XML sitemap to submit to Google Search Console.
- Meta Tag GeneratorGenerate title, description, canonical, Open Graph and X/Twitter meta tags with live Google and social previews.
- Favicon GeneratorCreate a complete favicon package — ICO, PNG, Apple and Android icons — from an image or text.
- QR Code GeneratorCreate free QR codes for links, text, Wi-Fi, email, phone, SMS and contact cards. Download PNG or SVG — no sign-up, no expiry.
- Schema Markup GeneratorGenerate JSON-LD structured data for local businesses, organisations, articles, products, FAQs, events and breadcrumbs.
- UTM Link BuilderAdd UTM campaign tracking parameters to links for Google Analytics and other analytics tools.