Discover URLs

Automatically discover related pages from the same domain as a web source. Useful for finding all pages to include in the knowledge base.

Endpoint

POST /web-sources/{id}/discover

Required.

string

required

The web source ID.

boolean

object

The web source with updated discovered URLs.

number

Number of URLs discovered.

curl -X POST https://api.mind-e.co/web-sources/ws-id-here/discover \
  -H "Authorization: Bearer sk_live_your_key_here"

{
  "success": true,
  "webSource": { "..." },
  "discoveredCount": 15
}

After discovering URLs, review the list and remove any you don’t want included. Then use Train to process the content.