Skip to main content
GET
/
v1
/
web
/
crawl
/
{jobId}
Poll crawl job status and results
curl --request GET \
  --url https://api.urltodata.ai/v1/web/crawl/{jobId} \
  --header 'Authorization: Bearer <token>'
{
  "status": "scraping",
  "total": 123,
  "completed": 123,
  "pages": [
    {
      "url": "<string>",
      "content": "<string>",
      "name": "<string>",
      "description": "<string>",
      "ogUrl": "<string>",
      "countCharacters": 123,
      "urls": [
        "<string>"
      ]
    }
  ],
  "next": 123
}

Documentation Index

Fetch the complete documentation index at: https://docs.urltodata.ai/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

Authorization
string
header
default:your-api-key
required

API key as Bearer token (e.g. Bearer mp_abc123_secret)

Path Parameters

jobId
string
required

Query Parameters

skip
integer

Pagination offset

Required range: x >= 0

Response

200 - application/json

Crawl job status

status
enum<string>
Available options:
scraping,
completed,
failed,
cancelled
total
integer
completed
integer
pages
object[]
next
integer | null