Your site and AI search: a new setting

What's new

AI tools like Claude, ChatGPT, and Gemini are increasingly how people find information online, similar to how search engines like Google work. You can now control whether these tools are allowed to read and index your site's content. The setting is on by default and can be turned off at any time by navigating to Site settings > Basic > Allow AI crawlers.

Things to know

• Changing this setting has no effect on your search engine indexing preferences. You can have AI crawlers on while search engine indexing is off, or the other way around.
• Content on password-protected pages is never accessible to crawlers, regardless of this setting.