User-agent: * Disallow: /api/ Disallow: /re-second_companies.asp Disallow: /offerdetail/ Disallow: /search_products.asp Disallow: /more_products.asp Disallow: /wrapper_item_list.asp User-agent: Bytespider Disallow: / User-agent: GPTBot 1.0 Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: dotbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SeznamBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: YisouSpider Disallow: / User-agent: istellabot Disallow: / User-agent: "Vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the Crawl-Delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com)" Disallow: /