Folson Academy
Sign in
Menu
Course outline

GEO / AI Search

Let AI crawlers in, or go invisible in AI answers

robots.txt often blocks GPTBot, PerplexityBot, and ClaudeBot by accident. Audit it with one prompt, then serve real HTML.

Blocking AI crawlers in robots.txt is usually accidental (a security plugin, a broad block-bad-bots rule). If the crawler that reads your page can't get in, no AI engine can ever cite you. This is the cheapest, highest-leverage GEO fix, and most teams have never checked it.