# ========== 国内主流搜索 & AI 爬虫 - 全部放行 ========== # 百度全系 User-agent: Baiduspider Allow: / User-agent: Baiduspider-render Allow: / User-agent: Baiduspider-image Allow: / # 字节跳动 / 头条 / 豆包 User-agent: Bytespider Allow: / # 搜狗 / 微信搜一搜 User-agent: Sogou web spider Allow: / User-agent: Sogou inst spider Allow: / # 神马 / 夸克 AI User-agent: YisouSpider Allow: / # 360 / 好搜 User-agent: 360Spider Allow: / User-agent: HaosouSpider Allow: / # 必应 & Copilot User-agent: bingbot Allow: / # 华为花瓣 & 小艺(可选放行) User-agent: PetalBot Allow: / # ========== 海外 AI / 海外爬虫(按需保留,不用可整段删除) ========== User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / # ========== 所有其他爬虫:执行原有禁止规则 ========== User-agent: * Disallow: /*?* Disallow:/kkp* Disallow:/wow* Disallow:/find* Disallow:/gwcs* Disallow:/amsu* Disallow:/ool* Disallow: /technology/ Disallow: /tools/ Disallow: /special/ceshiceshiceshi/ Disallow: /special/ceshi/ Disallow: /special/cscscs2/ Disallow: /course/ios2text.html Disallow: /2020index.html Disallow: /2020javaee.html Disallow: /2020mindex.html Disallow: /special/hmandroidzly/ Disallow: /special/2019khym/index.shtml Disallow: /special/2019smss/index.shtml Disallow: /special/2018khym/index.shtml Disallow: /special/2019khhm2/index.shtml Disallow: /special/2019khhm1/index.shtml Disallow: /java/service/