> ## Documentation Index
> Fetch the complete documentation index at: https://docs.urltodata.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Poll crawl job status and results



## OpenAPI

````yaml /openapi.json get /v1/web/crawl/{jobId}
openapi: 3.1.0
info:
  title: urltodata.ai
  description: >-
    API for extracting transcripts, metadata, and structured data from YouTube,
    TikTok, Instagram, X (Twitter), Facebook, and the web.
  version: 0.1.0
servers:
  - url: https://api.urltodata.ai
    description: Production API
security:
  - bearerAuth: []
paths:
  /v1/web/crawl/{jobId}:
    get:
      summary: Poll crawl job status and results
      operationId: getWebCrawlStatus
      parameters:
        - name: jobId
          in: path
          required: true
          schema:
            type: string
        - name: skip
          in: query
          description: Pagination offset
          schema:
            type: integer
            minimum: 0
      responses:
        '200':
          description: Crawl job status
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/CrawlJobStatus'
components:
  schemas:
    CrawlJobStatus:
      type: object
      properties:
        status:
          type: string
          enum:
            - scraping
            - completed
            - failed
            - cancelled
        total:
          type: integer
        completed:
          type: integer
        pages:
          type: array
          items:
            $ref: '#/components/schemas/ScrapedPage'
        next:
          type:
            - integer
            - 'null'
    ScrapedPage:
      type: object
      properties:
        url:
          type: string
        content:
          type: string
          description: Markdown content
        name:
          type: string
        description:
          type: string
        ogUrl:
          type: string
        countCharacters:
          type: integer
        urls:
          type: array
          items:
            type: string
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      x-default: your-api-key
      description: API key as Bearer token (e.g. Bearer mp_abc123_secret)

````