Free Robots.txt Generator

Robots.txt Settings

Choose crawl rules, add paths, and generate a plain-text robots.txt file.

● Local generation

Basic setup

Use a full website URL so sitemap links are generated correctly.

Website URL

Preset

Crawl delay

Include Sitemap line Include Host line Add short generated-by comment

Custom rules

Add paths like /wp-admin/, /private/, or /thank-you/. Do not paste full URLs here.

User-agent

Disallow paths

Allow paths

Extra sitemap URLs

Add additional sitemap URLs if your site has separate sitemap files.

robots.txt guides search crawlers, but it is not a security barrier. Do not use it to protect private files.

Your robots.txt is generated on your device.

AnoxFlow does not upload, store, sell, or send your website URL or robots.txt content to our hosting, any AI service, or any third-party API. Everything is generated locally inside your browser.

Technical transparency: this page uses plain browser JavaScript, text fields, Blob download, and clipboard access only when you click copy. It does not use backend processing, database writes, external JavaScript libraries, hidden tracking, or server-side crawling.