For AI agents: a documentation index is available at /llms.txt
Skip to main content

/batch-scrape/*

GET 

/batch-scrape/*

Get batch scrape progress and paginated page results with content URLs.

Request​

Query Parameters

    skip number
    token string
    allowedDomains string[]
    credentials object
    externalProxyServer string
    integrationId string
    proxy ProxyType

    Possible values: [datacenter, residential]

    proxyCity string
    proxyCountry string
    proxyLocaleMatch string

    Possible values: [0, 1, false, true]

    proxyPreset string
    proxyState string
    proxySticky string

    Possible values: [0, 1, false, true]

Responses​

Schema
    statusCrawlStatusrequired

    Possible values: [cancelled, completed, failed, in-progress]

    totalnumberrequired
    completednumberrequired
    failednumberrequired
    expiresAtstringrequired
    nextstringrequired
    data object[]required
  • Array [
  • statusPageStatusrequired

    Possible values: [cancelled, completed, failed, in-progress, queued]

    contentUrlstringrequired
    metadata objectrequired
    titlestringrequired
    descriptionstringrequired
    languagestringrequired
    scrapedAtstringrequired
    sourceURLstringrequired
    statusCodenumberrequired
    errorstringrequired
  • ]
Was this page helpful?