User-agent: * Disallow: /*.csv$ Disallow: /block/search_detail* Disallow: /block/* Disallow: /products/add_favorite_list/* Disallow: /products/sample/ User-agent: Baiduspider Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: BaiduImagespider Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: dotbot Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: MegaIndex Disallow: / User-agent: PetalBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: SeekportBot Disallow: / User-agent: GeedoProductSearch Disallow: / User-agent: AwarioBot Disallow: / User-agent: BrightEdge Disallow: / User-agent: AhrefsBot Crawl-Delay: / User-agent: BLEXBot Crawl-Delay: / User-agent: GPTBot Crawl-Delay: 30 User-agent: AhrefsSiteAudit Crawl-Delay: 30 User-agent: * Disallow: /products/review?pageno=26 User-agent: * Disallow: /products/list?category_id=4&name=%E9%81%AE%E5%85%89&pageno=37&disp_number=50&orderby=4 User-agent: * Disallow: /products/list?category_id=4&name=無地&pageno=3&disp_number=50&orderby=4&PageSpeed=noscript&slug=cafecurtain