Endpoint
Authentication
Required.Request body
string
required
The agent ID.
string
required
The URL to crawl. Must be a valid HTTP or HTTPS URL.
string
required
Crawl mode:
crawl (recursive), sitemap (discover from sitemap), or single (one page only).number
Maximum number of pages to crawl. Range: 1–100. Default:
50.number
Maximum crawl depth for link following. Range: 1–3. Default:
2.Response
boolean
object
The created web source object (see List Web Sources for the full shape).
Limits
- Maximum 10 web sources per agent.