Live plans and a one-time free trial. Start a 24/7 assistant on your site. Start your free trial →

Docs/Crawling & knowledge

How we learn your pages

Automatic schedule, what we read, manual runs, and statuses.

The chatbot answers from your pages and from text you add yourself. We do not teach other customers your content; answers use only what is saved for that website.

We start reading your pages automatically when you first register a website. After that, re-reads are a plan credit: trial includes that first read only; Starter is 1 per month; Pro is 1 per week; Business is 1 per day. Start crawl for [your website] uses the same credit — if the automatic read already ran this period, the button is locked with an upgrade prompt.

Because a scheduled re-read would otherwise spend the only credit, you can turn off automatic recrawls on Knowledge. That keeps the period’s credit for a manual run. The page shows the next credit or next automatic read in your local timezone.

A completed read replaces previously saved pages for that website. The latest read is what the bot prefers when facts disagree — contact details, hours, prices, product names, or anything else that changed on the live site. Answers you typed yourself remain, but if they conflict with the newest read, the live site wins. Failed or empty reads leave the previous answers in place.

We stay on your website. We follow internal links, read sitemaps when your plan allows, and can pick up product, category, and blog pages. We skip files such as PDFs and images. Other websites’ pages are not read.

Pages that load extra content after they open are still read, so prices, FAQs, and catalog details that appear after load can still be learned. We also pick up contact details, hours, and listed prices when they appear on the page.

From that pass we save the page text plus contact facts when we find them: phones, emails, WhatsApp links, physical addresses, hours, and listed prices. Those facts are what the bot quotes for contact, hours, location, and listed prices.

While a read runs you will see Queued, Processing (with page counts), Completed, Failed, or Canceled. If it fails, the reason is under the progress bar — not a bare “failed”.

How much we can read (pages and time) is capped by your plan so a huge site on a small plan will not ingest everything. If answers miss a deep page, upgrade or add that content yourself, then read again.