curl --request POST \
--url https://app.phonely.ai/api/agent-websites \
--header 'Content-Type: application/json' \
--header 'X-Authorization: <api-key>' \
--data '
{
"uid": "<string>",
"agentId": "<string>",
"url": "<string>",
"limit": 5,
"maxDepth": 1,
"excludePaths": [
"<string>"
],
"includePaths": [
"<string>"
]
}
'{
"message": "<string>"
}Crawl and add websites to an agent’s knowledge base. Supports customizable crawling parameters including depth limit, URL filtering, and page limits.
curl --request POST \
--url https://app.phonely.ai/api/agent-websites \
--header 'Content-Type: application/json' \
--header 'X-Authorization: <api-key>' \
--data '
{
"uid": "<string>",
"agentId": "<string>",
"url": "<string>",
"limit": 5,
"maxDepth": 1,
"excludePaths": [
"<string>"
],
"includePaths": [
"<string>"
]
}
'{
"message": "<string>"
}User ID
Agent ID
Base URL to crawl
Maximum number of pages to crawl (max 10)
1 <= x <= 10Maximum crawling depth (max 10)
1 <= x <= 10Array of URL paths to exclude from crawling
Array of URL paths to include in crawling (if specified, only these paths will be crawled)
Websites added successfully