Skip to main content

Endpoint

Authentication

Required.

Request body

string
required
The agent ID.
string
required
The URL to crawl. Must be a valid HTTP or HTTPS URL.
string
required
Crawl mode: crawl (recursive), sitemap (discover from sitemap), or single (one page only).
number
Maximum number of pages to crawl. Range: 1–100. Default: 50.
number
Maximum crawl depth for link following. Range: 1–3. Default: 2.

Response

boolean
object
The created web source object (see List Web Sources for the full shape).

Limits

  • Maximum 10 web sources per agent.

Example