> ## Documentation Index
> Fetch the complete documentation index at: https://www.cometchat.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

> Retrieves the processing status of discovered URLs by their unique IDs. Use this endpoint to monitor the progress of URL crawling within a parent website crawl.  **Behavior:** Only returns records for

# Poll Discovered URLs Status

For the complete error reference, see [Error Guide](/rest-api/ai-agents-apis/error-codes).


## OpenAPI

````yaml post /ai-agents/agent-builder/knowledge-base/website/{parentUniqueId}/discovered-urls/status/poll
openapi: 3.0.0
info:
  title: AI Agents APIs
  description: API reference for CometChat AI Agents service
  version: '1.0'
servers:
  - url: https://{appId}.api-{region}.cometchat.io/v3
    variables:
      appId:
        default: appId
        description: (Required) App ID
      region:
        enum:
          - us
          - eu
          - in
        default: us
        description: Select Region
security: []
tags:
  - name: ai-agent
    description: ''
paths:
  /ai-agents/agent-builder/knowledge-base/website/{parentUniqueId}/discovered-urls/status/poll:
    post:
      tags:
        - crawl-web-pages
      summary: Poll Discovered URLs Status
      description: >-
        Retrieves the processing status of discovered URLs by their unique IDs.
        Use this endpoint to monitor the progress of URL crawling within a
        parent website crawl.


        **Behavior:** Only returns records for existing unique IDs; non-existing
        IDs are omitted from the response.
      operationId: CrawlWebPagesController_getDiscoveredUrlsStatus
      parameters:
        - name: parentUniqueId
          required: true
          in: path
          description: Parent website crawl unique ID
          schema:
            example: f47ac10b-58cc-4372-a567-0e02b2c3d479
            type: string
      requestBody:
        required: true
        description: Array of discovered URL unique IDs to query status for
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/DiscoveredUrlsStatusQueryDto'
            examples:
              example1:
                summary: Query multiple discovered URL statuses
                value:
                  uniqueId:
                    - fb45bb1e-bc81-45a8-85be-36b2aa4f289e
                    - c2847dcd-636c-4e7a-9217-593ccf2a7bb1
      responses:
        '200':
          description: Status for requested discovered URLs (omits non-existing uniqueIds)
          content:
            application/json:
              schema:
                type: object
                example:
                  success: true
                  data:
                    fb45bb1e-bc81-45a8-85be-36b2aa4f289e: processed
                    c2847dcd-636c-4e7a-9217-593ccf2a7bb1: discovered
              example:
                success: true
                data:
                  fb45bb1e-bc81-45a8-85be-36b2aa4f289e: processed
                  c2847dcd-636c-4e7a-9217-593ccf2a7bb1: discovered
      security:
        - apiKey: []
components:
  schemas:
    DiscoveredUrlsStatusQueryDto:
      type: object
      properties:
        uniqueId:
          description: Array of discovered URL unique IDs to query status for
          example:
            - fb45bb1e-bc81-45a8-85be-36b2aa4f289e
            - c2847dcd-636c-4e7a-9217-593ccf2a7bb1
          type: array
          items:
            type: string
      required:
        - uniqueId
  securitySchemes:
    apiKey:
      type: apiKey
      description: API Key (i.e. Rest API Key from the Dashboard).
      name: apikey
      in: header

````