Marketplace
← Back to marketplace
Prompt GEO Audits

Audit robots.txt + server access for the full site map

Are AI bots being blocked anywhere on our site?

Technical SEO Quarterly Intermediate
Open OtterlyAI →
Copy & paste prompt

Run this in Claude

Run Otterly crawlability checks on our top 10 landing pages and produce a heatmap of which AI bots are blocked.

Tip: replace anything in [BRACKETS] with your own values, then paste this into Claude with the OtterlyAI connector enabled.

Details

Persona Technical SEO
Cadence Quarterly
Difficulty Intermediate
The question it answers
Are AI bots being blocked anywhere on our site?
How OtterlyAI solves it
Trigger crawlability checks across a list of top URLs; aggregate which bots fail by URL.
What you'll get
URL × bot heatmap, summary of blocking patterns (robots.txt vs server-side 403), and a fix list.
Workflow / API
POST /audits/geo/crawlability-checks (batched) → poll → aggregate

Related items

Other workflows in GEO Audits.

Brand Performance Check

Prompt GEO Audits

Check your brand performance

1.8K

Crawlability check on a key landing page

Prompt GEO Audits

Can the AI engines actually fetch this page?

1.3K

AI content-readiness score for a landing page

Prompt GEO Audits

Is this page structurally optimized for AI engines to extract and cite?

1.2K

Ready to deploy this Prompt?

Start a free OtterlyAI trial — no card required.

Start free trial →