Parallel World

Reads the public robots.txt of a website (one request to https://<host>/robots.txt, nothing else on the site) and says, for each AI crawler and AI agent of the migurei bot registry (training crawlers such as GPTBot and ClaudeBot, search bots, fetchers that act for a user, and others), whether that bot is allowed or disallowed for the path "/", which robots.txt rule decided it, and whether the file exists. Each bot also carries observed_on_pw: the counts our own lab site pw.migurei.ai recorded for that bot (published on https://pw.migurei.ai/ja/research/ai-bot-first-visits; the same for every domain, not about the domain asked, not a prediction). Input is a domain or URL; only public domain names are accepted (no IP addresses, no ports, no private hosts). Read-only; the domain is not stored. robots.txt is a request to bots, not access control, and a User-Agent is only a claim.

Returns the facts published on this website, in Japanese: service overview, plans, prices and payment terms, how the scanner behaves, how to contact us, and the operating company. Each fact comes with the URL of the page that shows it. Read-only; it returns nothing that is not on the pages.

Given the IP address and the User-Agent string of a request (for example from a server log), says whether that IP is inside the IP ranges the bot's operator publishes. The User-Agent is matched against the migurei bot registry (registry/bots); the IP is matched, IPv4 and IPv6, against the operator's published feed snapshot bundled with the registry (the snapshot date and registry version are in the answer). Status: verified (IP is in the operator's published ranges), ip_not_in_feed (the User-Agent names a registered bot but the IP is not in its ranges), no_feed (registered bot, but its operator publishes no IP ranges, so it cannot be checked), unknown_ua (no registered bot matches). Needs no outside request. Only public internet addresses are accepted (private, loopback, link-local, CGNAT, multicast, documentation and reserved addresses are refused). Read-only; the IP address and User-Agent are not stored and not logged. "verified" only means the IP is in the operator's ranges; the snapshot goes stale between updates.