Robots.txt Generator & Checker

Create a valid robots.txt file to instruct search engine robots which pages or files they can and cannot crawl.

Google recommends including the full sitemap URL.
Use caution! Paths are case-sensitive. Do not disallow necessary CSS/JS files.