Open data

Open datasets.

The reference facts behind our guides, as free JSON files — plus the Pro benchmark tier.

Search and AI crawler registry

Search engine and AI crawlers and robots.txt tokens that matter to business websites: the company that runs each, whether it serves search, AI search, user-requested fetching or model training, how to verify a visit (reverse DNS or published IP ranges) and the official documentation link.

File
/data/ai-crawlers.json (JSON)
Records
14
Last reviewed
License
Creative Commons Attribution 4.0 (people may reuse with credit)

AI findability glossary

Plain-language definitions of terms used in business search and AI discovery — AIO, AEO, GEO, SEO, structured data, Schema.org properties, crawler names, llms.txt, IndexNow, MCP and WebMCP — each with a link to an official source where one exists.

File
/data/glossary.json (JSON)
Records
38
Last reviewed
License
Creative Commons Attribution 4.0 (people may reuse with credit)

Business structured data checklist

Schema.org properties for business pages with their status on Google’s LocalBusiness structured data documentation (required, recommended, or valid Schema.org but not listed by Google) and a plain-language explanation of each.

File
/data/business-structured-data-checklist.json (JSON)
Records
11
Last reviewed
License
Creative Commons Attribution 4.0 (people may reuse with credit)

Industry to Schema.org type map

Which Schema.org business type fits each industry, the facts customers look for, and the questions they ask AI assistants.

File
/data/industry-schema-map.json (JSON)
Records
24
Last reviewed
License
Creative Commons Attribution 4.0 (people may reuse with credit)

Business website AI readiness checks

The checks the free Poseidon DS website check runs on a business site — page loading, HTTPS, indexing, title, canonical address, crawler access, sitemap, structured data, readable facts and llms.txt — with the reason each one matters. It describes a method, not a score.

File
/data/ai-readiness-checks.json (JSON)
Records
14
Last reviewed
License
Creative Commons Attribution 4.0 (people may reuse with credit)

A machine-readable list of all datasets is at /data/catalog.json. Each file states its sources and review date. If you find an error, tell us.

Pro — benchmark datasets

Free reference data above. Benchmarks below.

The datasets above are free reference facts. The Pro tier adds AI visibility benchmarks: aggregate check statistics from audit findings created after client businesses explicitly opt in in writing. No business names, locations or individual audit records are published.

One industry
$249 per month
All industries
$4,995 per year
API access
Starter $49/mo · Agency $199/mo — API access page
Opt-in threshold
A benchmark is published only after at least 30 distinct businesses have opted in for that industry. Below that, the endpoint returns a “collecting data” status with the eligible business count.
IndustryStatusOpted-in businesses
Law firmCollecting data0 of 30
Dental practiceCollecting data0 of 30
Medical clinicCollecting data0 of 30
HVAC companyCollecting data0 of 30
Roofing contractorCollecting data0 of 30
Plumbing companyCollecting data0 of 30
Electrical contractorCollecting data0 of 30
General contractorCollecting data0 of 30

Full status list and endpoints: /api-access · Index for machines: GET /api/v1/benchmarks

Last updated