Opt out of AI training in robots.txt
Ask AI crawlers not to train on your site with the __usage_ai-training robots.txt group while staying in search. Opting out can cost you Gemini answers.
#robots-txt
Filtering by topic #robots-txt · clear
Block AI Crawlers on Your Own Server
Measure how much of your traffic is AI crawlers from your own access log, then block or rate limit them in nginx, Apache or Caddy without losing real visitors.