Free live demo · Synthetic input

Robots Check

Interpret supplied robots.txt for a requested agent and path.

Best-effort parser; not permission to scrape, and not a terms-of-service review. Do not paste private records, credentials or production data.

Try it now

The example is synthetic. Edit it if needed. The request is sent to the same public API used by agents.

Run the synthetic example to see the response.

POST https://aibitious.com/404/v1/lab/robots_check