Add website pages and keep them current
Use approved website content as a source and understand when a website needs a refresh.
Before you begin
Open the agent’s Knowledge tab. Use current, approved documents and remove unnecessary personal data before uploading.
Step by step
- 1
Choose the right URL
Use a public, canonical page with the actual answer. A search page, login page or product filter may contain little useful stable text.
- 2
Add and inspect
Choose the URL source option, add the address and wait for processing. Check the source name and extracted content where available.
- 3
Use crawl inputs deliberately
If the add-source controls offer sitemap or feed discovery, review the selected pages rather than importing an entire unrelated site.
- 4
Configure supported syncing
For sources that support automatic syncing, enable it and inspect the last and next sync indicators. A changed website is not instantly reflected in stored knowledge.
- 5
Verify after a change
When a policy changes, refresh the source and test the specific updated fact. Remove older copies that contradict it.
Good to know
The crawler cannot reliably access content behind login, bot protection or complex client-only interactions. Use an approved document or text source when necessary.
Check the result
Wait until processing is complete, then ask a question whose answer appears in the source and inspect the answer and citations.
Questions & troubleshooting
The URL imported the wrong text
Choose the direct article URL, remove navigation-only pages and check whether a cookie/login wall was fetched.
A changed price is still old
Check sync status and other sources containing that price. Live commerce tools and stored website knowledge serve different purposes.
Rate this guide on this device. Ratings are not sent to Corthex.