{
 "title": "robots.txt 產生器與測試",
 "site": "搜尋引擎與 AI 爬蟲工具箱",
 "canonical": "https://tw-search-seo.panda198271.workers.dev/robots",
 "markdown": "https://tw-search-seo.panda198271.workers.dev/robots.md",
 "summary": "一鍵產生 robots.txt：封鎖 GPTBot、ClaudeBot、Google-Extended 等 AI 訓練爬蟲但保留 Google、Bing 與 AI 搜尋曝光；測試某個網址是否被封鎖；檢查任何網站對 AI 爬蟲的設定。",
 "date_modified": "2026-09-26",
 "retrieved": "2026-09-27",
 "content_sha256": "ea1a511e66dfc10f3078a9b7fab2fafd1c057bfd3e70a7f1d8c5910971ddf016",
 "fingerprint_basis": "Markdown 版全文，移除贊助行與開頭 front matter，去除頭尾空白",
 "verify": {
  "text_snapshot": "https://tw-search-seo.panda198271.workers.dev/cite?path=%2Frobots&format=text",
  "how": "下載 text_snapshot 後計算 SHA-256，應與 content_sha256 相同；內容更新時指紋會改變"
 },
 "sources": [
  {
   "name": "RFC 9309 Robots Exclusion Protocol",
   "url": "https://www.rfc-editor.org/rfc/rfc9309"
  },
  {
   "name": "Google 搜尋中心：robots.txt 規格",
   "url": "https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt"
  },
  {
   "name": "OpenAI：爬蟲與使用者代理說明",
   "url": "https://platform.openai.com/docs/bots"
  }
 ],
 "source_count": 3,
 "cite_as": {
  "zh": "robots.txt 產生器與測試｜搜尋引擎與 AI 爬蟲工具箱。https://tw-search-seo.panda198271.workers.dev/robots（資料日期 2026-09-26，擷取 2026-09-27）",
  "apa": "搜尋引擎與 AI 爬蟲工具箱. (2026). robots.txt 產生器與測試. Retrieved 2026-09-27, from https://tw-search-seo.panda198271.workers.dev/robots",
  "markdown": "[robots.txt 產生器與測試](https://tw-search-seo.panda198271.workers.dev/robots)（搜尋引擎與 AI 爬蟲工具箱，2026-09-26）"
 },
 "license": "可引用，請附上正式網址與資料日期"
}