AI bots Retrieve Web content through crawlers for model training. These AI bots may generate a large number of requests, resulting in a surge in billing requests. You may not want the AI robot to trigger fingerprinting. The device fingerprint service maintains a set of AI robot filtering lists. You can enable or disable the inspection service as needed.
Please note that requests filtered by AI bots will not be returned to blackbox, only related error prompts will be returned.
Search bots filtering based on User-Agent is a filtering mechanism that we provide for free to filter out common and well-behaved search bots. Since the detection logic is not complicated and there may be leakage, we will regularly update and maintain the machine filter list.
Configure
1.Log in to the customer portal, navigate to Device Fingerprint- Management-Request Filtering-Bots, and enable Exclude AI Bots
User-AgentAI bots Filtering List
User-AgentAI bots Filtering List| 来源 | 字符串 |
|---|---|
| OpenAI | ChatGPT-User GPTBot |
| Duckduckgo | DuckAssistbot |
GoogleOther | |
| Huawei | PetalBot |
| LinerBot | LINER Bot |
| Factset | Factset_spyderbot |
| Amazon | Amazonbot |
| Apple | Applebot |
| OAISearchBot | OAI-SearchBot |
| Qualified | QualifiedBot |
| ICC | ICC Crawler |
| Anthropic | ClaudeBot |