/batch-scrape/*
GET/batch-scrape/*
Get batch scrape progress and paginated page results with content URLs.
Request
Query Parameters
skip number
token string
allowedDomains string[]
credentials object
externalProxyServer string
integrationId string
proxy ProxyType
Possible values: [datacenter, residential]
proxyCity string
proxyCountry string
proxyLocaleMatch string
Possible values: [0, 1, false, true]
proxyPreset string
proxyState string
proxySticky string
Possible values: [0, 1, false, true]
Responses
- 200
- 400
- 401
- 403
- 404
- 408
- 429
- 500
- 503
Schema
- Fields
- Example (auto)
- Array [
- ]
statusCrawlStatusrequired
Possible values: [cancelled, completed, failed, in-progress]
totalnumberrequired
completednumberrequired
failednumberrequired
expiresAtstringrequired
nextstringrequired
data object[]required
statusPageStatusrequired
Possible values: [cancelled, completed, failed, in-progress, queued]
contentUrlstringrequired
metadata objectrequired
titlestringrequired
descriptionstringrequired
languagestringrequired
scrapedAtstringrequired
sourceURLstringrequired
statusCodenumberrequired
errorstringrequired
{
"status": "cancelled",
"total": 0,
"completed": 0,
"failed": 0,
"expiresAt": "string",
"next": "string",
"data": [
{
"status": "cancelled",
"contentUrl": "string",
"metadata": {
"title": "string",
"description": "string",
"language": "string",
"scrapedAt": "string",
"sourceURL": "string",
"statusCode": 0,
"error": "string"
}
}
]
}
The request contains errors or didn't properly encode content.
The request is missing, or contains bad, authorization credentials.
The request targets a destination that is not allowed.
Resource couldn't be found.
The request took has taken too long to process.
Too many requests are currently being processed.
An internal error occurred when handling the request.
Service is unavailable.
Was this page helpful?