Skip to main content
The data you want to include in your Algolia indices might not be present on the websites you’re crawling. With Crawler, you can add external data to your during a crawl. Crawler accepts external data sources for Google Analytics and CSV files. After creating an external data source, you can use it in any crawler within the same .

​
Reusable external data

External data isn’t related to one specific crawler: it belongs to an application ID. All configurations with the same application ID can reuse the external data. The crawler fetches the data independently of any crawler’s configuration and handles the cache internally to make sure that data is ready whenever a crawl is scheduled.

​
Next steps

To learn more about the different external data sources, see:
Last modified on March 12, 2026