Open data
Open datasets.
The reference facts behind our guides, as free JSON files — plus the Pro benchmark tier.
Search and AI crawler registry
Search engine and AI crawlers and robots.txt tokens that matter to business websites: the company that runs each, whether it serves search, AI search, user-requested fetching or model training, how to verify a visit (reverse DNS or published IP ranges) and the official documentation link.
- File
- /data/ai-crawlers.json (JSON)
- Records
- 14
- Last reviewed
- License
- Creative Commons Attribution 4.0 (people may reuse with credit)
AI findability glossary
Plain-language definitions of terms used in business search and AI discovery — AIO, AEO, GEO, SEO, structured data, Schema.org properties, crawler names, llms.txt, IndexNow, MCP and WebMCP — each with a link to an official source where one exists.
- File
- /data/glossary.json (JSON)
- Records
- 38
- Last reviewed
- License
- Creative Commons Attribution 4.0 (people may reuse with credit)
Business structured data checklist
Schema.org properties for business pages with their status on Google’s LocalBusiness structured data documentation (required, recommended, or valid Schema.org but not listed by Google) and a plain-language explanation of each.
- File
- /data/business-structured-data-checklist.json (JSON)
- Records
- 11
- Last reviewed
- License
- Creative Commons Attribution 4.0 (people may reuse with credit)
Industry to Schema.org type map
Which Schema.org business type fits each industry, the facts customers look for, and the questions they ask AI assistants.
- File
- /data/industry-schema-map.json (JSON)
- Records
- 24
- Last reviewed
- License
- Creative Commons Attribution 4.0 (people may reuse with credit)
Business website AI readiness checks
The checks the free Poseidon DS website check runs on a business site — page loading, HTTPS, indexing, title, canonical address, crawler access, sitemap, structured data, readable facts and llms.txt — with the reason each one matters. It describes a method, not a score.
- File
- /data/ai-readiness-checks.json (JSON)
- Records
- 14
- Last reviewed
- License
- Creative Commons Attribution 4.0 (people may reuse with credit)
A machine-readable list of all datasets is at /data/catalog.json. Each file states its sources and review date. If you find an error, tell us.
Pro — benchmark datasets
Free reference data above. Benchmarks below.
The datasets above are free reference facts. The Pro tier adds AI visibility benchmarks: aggregate check statistics from audit findings created after client businesses explicitly opt in in writing. No business names, locations or individual audit records are published.
- One industry
- $249 per month
- All industries
- $4,995 per year
- API access
- Starter $49/mo · Agency $199/mo — API access page
- Opt-in threshold
- A benchmark is published only after at least 30 distinct businesses have opted in for that industry. Below that, the endpoint returns a “collecting data” status with the eligible business count.
| Industry | Status | Opted-in businesses |
|---|---|---|
| Law firm | Collecting data | 0 of 30 |
| Dental practice | Collecting data | 0 of 30 |
| Medical clinic | Collecting data | 0 of 30 |
| HVAC company | Collecting data | 0 of 30 |
| Roofing contractor | Collecting data | 0 of 30 |
| Plumbing company | Collecting data | 0 of 30 |
| Electrical contractor | Collecting data | 0 of 30 |
| General contractor | Collecting data | 0 of 30 |
Full status list and endpoints: /api-access · Index for machines: GET /api/v1/benchmarks
Last updated