Skip to main content
POST
/
v1
/
web
/
crawl
Start a crawl job to extract content from a website
curl --request POST \
  --url https://api.urltodata.ai/v1/web/crawl \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "url": "<string>"
}
'
{
  "jobId": "<string>"
}

Documentation Index

Fetch the complete documentation index at: https://docs.urltodata.ai/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

​
Authorization
string
header
default:your-api-key
required

API key as Bearer token (e.g. Bearer mp_abc123_secret)

Body

application/json
​
url
string<uri>
required
​
limit
integer

Response

202 - application/json

Crawl job created

​
jobId
string