--- title: The SiteSpect Engine API robots, bots, & crawlers management description: Engine API Implementations --- [Skip to content](https://doc.sitespect.com/knowledge/the-sitespect-engine-api-bot-management#main-content) English Show submenu for translations ![Monetate-Logo-Full-Color-1](https://doc.sitespect.com/hs-fs/hubfs/Monetate-Logo-Full-Color-1.png?width=340&height=49&name=Monetate-Logo-Full-Color-1.png) - [A/B Testing](https://www.sitespect.com/testing-and-experimentation/) - [Personalization](https://www.sitespect.com/personalization-targeting/) - [Recommendations](https://www.sitespect.com/recommendations/) Open main navigation Close main navigation - [A/B Testing](https://www.sitespect.com/testing-and-experimentation/) - [Personalization](https://www.sitespect.com/personalization-targeting/) - [Recommendations](https://www.sitespect.com/recommendations/) - English Show submenu for translations How can we help you? - There are no suggestions because the search field is empty. 1. [Knowledge Base](https://doc.sitespect.com/knowledge?hsLang=en) 2. [Site](https://doc.sitespect.com/knowledge/site?hsLang=en) # The SiteSpect Engine API robots, bots, & crawlers management ## Engine API Implementations There are two methods for utilizing the SiteSpect Engine API which will impact how you can approach bot management. The SiteSpect Engine API can be implemented server-side or client-side from the browser. If your implementation uses the [SiteSpect reverse-proxy please reference this](https://doc.sitespect.com/knowledge/how-does-sitespect-handle-robots-bots-and-crawlers?hsLang=en).   Engine API on the server-side only: - - Does not use Automatic Robot Detection (ARD).  - Does not use passthrough list. This can be enabled if a valid browser User Agent is passed from the app. Please contact sitespect@helpdesk.com to discuss this. - Do not use the IAB/ABC International Spiders and Bots List within SiteSpect. Common scripting languages where user-agents are not customized will be considered robots. e.g. curl and python are some common user-agents that will be unintentionally flagged a robots. - It is recommended you only send SiteSpect Engine API requests for non bot traffic. One method to achieve this would be through the use of a CDN. - Engine API client-side / in the browser: - Does not use Automatic Robot Detection (ARD). - Passthrough list can be enabled if required. Please contact sitespect@helpdesk.com to discuss this. - - IAB/ABC International Spiders and Bots List can provide bot, crawlers and browser detection. The level of IAB detection required will depend on your SiteSpect configuration so please speak to your SiteSpect Consultant, Account Manager or email helpdesk@sitespect.com to discuss enabling this. - It is recommended you only send SiteSpect Engine API requests for non bot traffic. One method to achieve this would be through the use of a CDN. - [Get Started](https://doc.sitespect.com/knowledge/get-started?hsLang=en#main-content) - [SiteSpect Support](https://doc.sitespect.com/knowledge/get-started?hsLang=en#sitespect-support) - [Overview Information](https://doc.sitespect.com/knowledge/get-started?hsLang=en#overview-information) - [Intro to SiteSpect](https://doc.sitespect.com/knowledge/get-started?hsLang=en#intro-to-sitespect) - [Account Setup](https://doc.sitespect.com/knowledge/get-started?hsLang=en#account-setup) - [Artificial Intelligence](https://doc.sitespect.com/knowledge/get-started?hsLang=en#artificial-intelligence) - [Dashboard](https://doc.sitespect.com/knowledge/dashboard?hsLang=en) - [Build](https://doc.sitespect.com/knowledge/build?hsLang=en#main-content) - [Setting Up a Campaign](https://doc.sitespect.com/knowledge/build?hsLang=en#setting-up-a-campaign) - [Create a Client-Side Campaign](https://doc.sitespect.com/knowledge/build?hsLang=en#create-a-client-side-campaign) - [Create a Server-Side Campaign](https://doc.sitespect.com/knowledge/build?hsLang=en#create-a-server-side-campaign) - [Metrics](https://doc.sitespect.com/knowledge/build?hsLang=en#metrics) - [Audiences](https://doc.sitespect.com/knowledge/build?hsLang=en#audiences) - [Triggers](https://doc.sitespect.com/knowledge/build?hsLang=en#triggers) - [Variations](https://doc.sitespect.com/knowledge/build?hsLang=en#variations) - [Traffic Management](https://doc.sitespect.com/knowledge/build?hsLang=en#traffic-management) - [Preview](https://doc.sitespect.com/knowledge/build?hsLang=en#preview) - [Factors](https://doc.sitespect.com/knowledge/build?hsLang=en#factors) - [Advanced Settings](https://doc.sitespect.com/knowledge/build?hsLang=en#advanced-settings) - [Omnichannel](https://doc.sitespect.com/knowledge/build?hsLang=en#omnichannel) - [Regular Expressions (Regex)](https://doc.sitespect.com/knowledge/build?hsLang=en#regular-expressions-regex) - [WATTS](https://doc.sitespect.com/knowledge/build?hsLang=en#watts) - [Recommendations](https://doc.sitespect.com/knowledge/build?hsLang=en#recommendations) - [Monitor](https://doc.sitespect.com/knowledge/monitor?hsLang=en) - [Analyze](https://doc.sitespect.com/knowledge/analyze?hsLang=en#main-content) - [Data Export and Integration](https://doc.sitespect.com/knowledge/analyze?hsLang=en#data-export-and-integration) - [SiteSpect Reports](https://doc.sitespect.com/knowledge/analyze?hsLang=en#sitespect-reports) - [Site](https://doc.sitespect.com/knowledge/site?hsLang=en#main-content) - [Tools](https://doc.sitespect.com/knowledge/site?hsLang=en#tools) - [Configuration](https://doc.sitespect.com/knowledge/site?hsLang=en#configuration) - [Developers](https://doc.sitespect.com/knowledge/developers?hsLang=en#main-content) - [API Reference](https://doc.sitespect.com/knowledge/developers?hsLang=en#api-reference) - [Code Samples](https://doc.sitespect.com/knowledge/developers?hsLang=en#code-samples) - [Tips & Tricks](https://doc.sitespect.com/knowledge/developers?hsLang=en#tips-tricks) - [Mobile](https://doc.sitespect.com/knowledge/mobile?hsLang=en) - [Implementation, Deployment, and Security](https://doc.sitespect.com/knowledge/implementation-deployment-and-security?hsLang=en#main-content) - [How does SiteSpect work with CDNs?](https://doc.sitespect.com/knowledge/implementation-deployment-and-security?hsLang=en#how-does-sitespect-work-with-cdns) - [Single Tenant Implementations](https://doc.sitespect.com/knowledge/implementation-deployment-and-security?hsLang=en#single-tenant-implementations) - [Security Features](https://doc.sitespect.com/knowledge/implementation-deployment-and-security?hsLang=en#security-features) - [Deployment and Implementation Overview](https://doc.sitespect.com/knowledge/implementation-deployment-and-security?hsLang=en#deployment-and-implementation-overview) - [SiteSpect Engine & Admin API](https://doc.sitespect.com/knowledge/implementation-deployment-and-security?hsLang=en#sitespect-engine-admin-api) - [Third-Party Integration](https://doc.sitespect.com/knowledge/third-party-integration?hsLang=en#main-content) - [Google](https://doc.sitespect.com/knowledge/third-party-integration?hsLang=en#google) - [Zuko](https://doc.sitespect.com/knowledge/third-party-integration?hsLang=en#zuko) - [Troubleshooting](https://doc.sitespect.com/knowledge/troubleshooting?hsLang=en) - [Releases](https://doc.sitespect.com/knowledge/releases?hsLang=en#main-content) - [Superfresh](https://doc.sitespect.com/knowledge/releases?hsLang=en#superfresh) - [Feedback](https://doc.sitespect.com/knowledge/feedback?hsLang=en) - [A/B Testing](https://www.sitespect.com/testing-and-experimentation/) - [Personalization](https://www.sitespect.com/personalization-targeting/) - [Recommendations](https://www.sitespect.com/recommendations/) [![Monetate-Logo-Full-Color-1](https://doc.sitespect.com/hs-fs/hubfs/Monetate-Logo-Full-Color-1.png?width=200&height=29&name=Monetate-Logo-Full-Color-1.png "Monetate-Logo-Full-Color-1")](http://monetate.com) [mailto:email@email.com](mailto:email@email.com) Copyright © 2026, Monetate