Apify (Advanced Website Crawler)

First, install the integration to your bot:

1. In Botpress Studio, select Explore Hub in the upper-right corner.
2. Search for the Apify integration. In the Hub, it’s listed as Advanced Website Crawler.
3. Select Install Integration.

In the Configuration menu, you should see two fields:

• API Token
• Webhook Secret (Optional)

Leave these empty for now—you’ll come back to them after completing the setup in your Apify account.

Next, get your Apify API token:

1. Log in to your Apify account.
2. Select Settings from the bottom-left corner.
3. Go to API & Integrations.
4. Under Personal API tokens, copy the API token—it should start with apify_api_.

Now, you can configure the integration in Botpress:

1. In the integration’s API Token field, paste your Apify API token.
2. Select Save Configuration.
3. Copy the integration’s webhook URL (starting with https://webhook.botpress.cloud).

Finally, create a Webhook integration:

1. Go to the Website Content Crawler in the Apify Store.

2. Select Try for Free, then Save & Start. This opens the Actor’s configuration page.

3. Select the Integrations tab (on the Actor’s page, not the left sidebar).

4. Scroll down to Generic integrations, then select HTTP webhook.

5. Under Start when, select the following options:

   • Run succeeded
   • Run created
   • Run failed
   • Run timed out
   • Run resurrected
   • Run aborted

6. Paste your Botpress webhook URL into the URL field.

7. Select Save.