Skip to content

Lab

Experiments & Tools

Interactive tools, benchmarks, and live tests exploring technical SEO, crawler behavior, and how AI engines and search bots read the web.

Interactive ToolLive
Open tool

AI Crawler Visibility Checker

Can AI crawlers see your website?

Test any URL against GPTBot, ClaudeBot, PerplexityBot, and others. Analyzes robots.txt rules, firewall & CDN blocks, noindex headers, and JavaScript dependency.

  • robots.txt rule evaluator
  • Firewall & CDN detection
  • JS dependency check
  • Simulated crawler view
Live BenchmarkPublic Logs
Open tool

AI Crawler Rendering Test

A live log of which bots run JavaScript

The instrument behind the write-up: a honeypot page and edge log recording which AI crawlers request it and which of them run its script instead of only reading the HTML.

  • Edge request vs JS callback
  • IP range verification
  • Zero personal data logged
  • Public real-time logs