Skip to content
Knowledge & sources

Add website pages and keep them current

Use approved website content as a source and understand when a website needs a refresh.

Where to find itAI agents → agent → Knowledge → Add source

Before you begin

Open the agent’s Knowledge tab. Use current, approved documents and remove unnecessary personal data before uploading.

Example workspace · Demo data. Ready sources can be tested; uploaded content still needs processing. Select the image to enlarge it.
Knowledge source list with processing status and source controls

Example workspace · Demo data. Ready sources can be tested; uploaded content still needs processing. Select the image to enlarge it.

Step by step

  1. 1

    Choose the right URL

    Use a public, canonical page with the actual answer. A search page, login page or product filter may contain little useful stable text.

  2. 2

    Add and inspect

    Choose the URL source option, add the address and wait for processing. Check the source name and extracted content where available.

  3. 3

    Use crawl inputs deliberately

    If the add-source controls offer sitemap or feed discovery, review the selected pages rather than importing an entire unrelated site.

  4. 4

    Configure supported syncing

    For sources that support automatic syncing, enable it and inspect the last and next sync indicators. A changed website is not instantly reflected in stored knowledge.

  5. 5

    Verify after a change

    When a policy changes, refresh the source and test the specific updated fact. Remove older copies that contradict it.

Good to know

The crawler cannot reliably access content behind login, bot protection or complex client-only interactions. Use an approved document or text source when necessary.

Check the result

Wait until processing is complete, then ask a question whose answer appears in the source and inspect the answer and citations.

Questions & troubleshooting

The URL imported the wrong text

Choose the direct article URL, remove navigation-only pages and check whether a cookie/login wall was fetched.

A changed price is still old

Check sync status and other sources containing that price. Live commerce tools and stored website knowledge serve different purposes.

Was this article helpful?

Rate this guide on this device. Ratings are not sent to Corthex.