idlidu robots

Dated AI crawl permissions for agents & counsel — point-in-time robots.txt, ai.txt, and public policy pages.

API surface (v1)

Host: robots-api.idlidu.com · MCP: robots-mcp.idlidu.com

• GET /v1/domains/{domain}/as-of
• GET /v1/domains/{domain}/history
• GET /v1/permission?domain=&agent=&path=&date=
• GET /v1/indices · gptbot_allow_share

Read the methodology →