AI爬虫太多了，如何屏蔽AI爬虫！
现在的AI爬虫太多了，他们每天乱爬，导致服务器支撑不住！
国外的很多，国内的也不少！
# 百度文心/千帆 | 阿里通义 | 字节豆包/扣子 | Kimi(月之暗面) | 智谱GLM | DeepSeek | 讯飞星火
baidusparkbot|baidu-yunguan|baiduai|tongyi-ai|qwenbot|doubao|coze|moonshot|zhipuai|chatglm|deepseek|sparkbot
# 腾讯元宝/搜狗 | 360 | 天工(昆仑万维) | 秘塔 | 阶跃星辰 | MiniMax(海螺) | 零一万物 | 华为盘古
yuanbao|yisouspider|sogou|360spider|tiangong|metaso|stepfun|minimaxbot|yibot|pangu
下面我们来看看在宝塔面板里用的AI爬虫屏蔽方案，Nginx 拦截
宝塔 Nginx 配置（推荐，复制即用）
操作步骤
宝塔 → 网站 → 选你的站点
设置 → 配置文件
在 server { ... } 里、所有 location 块之前 粘贴下面代码
保存 → 重载配置
# ========== 屏蔽 AI / 数据采集爬虫 精简版 ==========
if ($http_user_agent ~* "(gptbot|oai-searchbot|chatgpt-user|openai|claudebot|claude-web|anthropic-ai|ccbot|perplexitybot|perplexity-user|bytespider|cohere-ai|amazonbot|meta-externalagent|applebot-extended|google-extended|googleother|diffbot|imagesiftbot|timpibot|tineye-bot|magpie-crawler|omgili|aihitbot|blexbot|dataforseobot|piplbot|mj12bot|petalbot|barkrowler|seokicks|dotbot|semrushbot|ahrefsbot|baidusparkbot|baiduyunguance|baiduai|tongyi-ai|qwenbot|doubaobot|coze|moonshotbot|moonshot|zhipuai|chatglm|deepseekbot|deepseekcrawler|sparkbot|yuanbaobot|tiangong|metaso|stepbot|minimaxbot|yibot|pangu|python-requests|python-urllib|scrapy|curl/|wget|go-http-client|httpx|okhttp|jsoup|libwww-perl|winhttprequest|node-fetch|axios|apache-httpclient|java/[0-9])") {
return 403;
}
# ========== 屏蔽结束 ==========
