For AI agents: a documentation index is available at /llms.txt
Skip to main content

/crawl/*

GET 

/crawl/*

Get the status of a crawl job and its paginated page results. Returns progress counters, per-page metadata with content URLs, and a next URL for offset-based pagination via the skip parameter.

Request

Responses