Note: A new v2 version of this API is now available with improved features and performance.
Get Crawl Status
1 min read
get/crawl/{id}
Request example
Response
get/crawl/{id}
Authorization
Path parameters
The ID of the crawl job
Responses
application/json
Successful response
The current status of the crawl. Can be
scraping, completed, or failed.The total number of pages that were attempted to be crawled.
The number of pages that have been successfully crawled.
The number of credits used for the crawl.
The date and time when the crawl will expire.
The URL to retrieve the next 10MB of data. Returned if the crawl is not completed or if the response is larger than 10MB.
The data of the crawl.
Show child attributesHide child attributes
HTML version of the content on page if
includeHtml is trueRaw HTML content of the page if
includeRawHtml is trueList of links on the page if
includeLinks is trueScreenshot of the page if
includeScreenshot is trueShow child attributesHide child attributes
Title extracted from the page, can be a string or array of strings
Show child attributesHide child attributes
Description extracted from the page, can be a string or array of strings
Show child attributesHide child attributes
Language extracted from the page, can be a string or array of strings
Show child attributesHide child attributes
Keywords extracted from the page, can be a string or array of strings
Show child attributesHide child attributes
Alternative locales for the page
Other metadata extracted from HTML, can be a string or array of strings
Show child attributesHide child attributes
The status code of the page
For PDF inputs, the number of pages parsed (capped by the parsers maxPages option).
For PDF inputs, the document's true page count before any maxPages capping. Omitted when it cannot be determined; a totalPages greater than numPages indicates the result was truncated.
The error message of the page

