# AgentCrumbs

> AI visibility, crawler analytics and agent readiness. Find out which AI agents crawl your site, how well they can read it, and what to fix.

AgentCrumbs is a web app (currently in private beta) by TDNSA. It answers three questions for a website owner:
which AI crawlers and agents visit the site, which visitors arrive from AI assistants such as ChatGPT,
Perplexity, Claude or Gemini, and how well the site can be read by AI agents.

## Features

- Agent readiness check: scores a domain on robots.txt, AI crawler access, XML sitemap, structured data (JSON-LD), llms.txt, /.well-known/agent.json and OpenAPI, and explains what to fix.
- Crawler analytics: detects AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, …) and verifies them against the vendors' published IP ranges, so spoofed user-agents are flagged.
- AI referrals: counts visitors who come from AI assistants and, with consent, follows them to conversions.
- Teams: several people can share the sites of one account.

## Tracking

- Browser snippet: one script tag, `https://www.agentcrumbs.io/snippet/agent.js` with a `data-site-id` attribute. Records page views and AI referrals.
- Server side: most AI crawlers don't run JavaScript, so their requests are forwarded from the server with the site's ingest key.
  - [@agentcrumbs/node](https://www.npmjs.com/package/@agentcrumbs/node): Express and Next.js middleware, helpers for other Node servers, and an access-log forwarder for Caddy, nginx and Apache.
  - [@agentcrumbs/astro](https://www.npmjs.com/package/@agentcrumbs/astro): Astro integration, including static sites.
  - Shopware 6 plugin: tracking plus an llms.txt and a product API for AI agents.

## Links

- [Home](https://www.agentcrumbs.io/): free agent readiness check for any domain
- [Startseite (Deutsch)](https://www.agentcrumbs.io/de)
- [Request beta access](https://www.agentcrumbs.io/signup)
- [Agent manifest](https://www.agentcrumbs.io/.well-known/agent.json)
- [TDNSA](https://tdnsa.com/): the company behind AgentCrumbs

## Contact

mailto:hello@agentcrumbs.io
