1. Agreement to Terms
By accessing, browsing, or using airobotstxt.com (referred to as "the Service", "the Website", or "we"), you agree to comply with and be bound by these Terms of Service. If you do not agree with any part of these terms, you should discontinue using the website immediately.
2. Description & Free Use License
airobotstxt.com provides a suite of browser-based tools allowing developers, creators, publishers, and SEO professionals to generate, validate, and analyze robots.txt files for 40+ web crawlers, including AI/LLM scrapers, search engines, and social media preview bots.
We grant you a free, non-exclusive, non-transferable license to use the tools and export generated rules for commercial or personal websites without royalty or licensing fees.
3. Disclaimer of Warranties ("AS IS")
The tools, recommendations, syntax outputs, and validation statuses provided on this site are for informational and configuration assistance purposes only and are provided on an "AS IS" and "AS AVAILABLE" basis without warranties of any kind.
Webmaster Testing Responsibility:
Webmasters are solely responsible for testing and validating their robots.txt files in a non-production staging environment prior to live deployment. The Robots Exclusion Standard (REP) is a voluntary protocol. While compliant crawlers (such as Googlebot, Bingbot, GPTBot, and ClaudeBot) respect these directives, rogue or unauthorized scrapers may ignore robots.txt instructions.
4. Limitation of Liability
In no event shall airobotstxt.com, its maintainers, or affiliates be liable for any direct, indirect, incidental, consequential, special, or exemplary damages arising from or in connection with your use of this service. This includes, without limitation: search engine de-indexing, fluctuations in organic search rankings, unauthorized scraping by third-party bots, server bandwidth consumption, or data loss.
5. Intellectual Property Rights
All output text, generated rules, and directives produced by your interactions remain your property. All software logic, branding, custom UI components, styling, and curated database records of crawler user-agents on airobotstxt.com are protected by applicable intellectual property laws.
6. Third-Party Trademarks & Disclaimers
Names of crawlers, search engines, and artificial intelligence systems (such as OpenAI, GPTBot, ChatGPT, Claude, Anthropic, Google, Gemini, Perplexity, ByteDance, Common Crawl, Bing) are trademarks or registered trademarks of their respective owners. Their mention on airobotstxt.com is strictly nominative for compatibility and configuration purposes, and implies no affiliation, endorsement, or sponsorship.
7. Changes to Terms
We reserve the right to revise these Terms of Service at any time. Continued use of the Service following any updates signifies your agreement to the modified terms.
8. Contact Information
For inquiries regarding these Terms of Service, please contact us at:
Legal Contact:
support@airobotstxt.com