User-agent: Baiduspider User-agent: googlebot-news User-agent: MJ12bot # 2017-02-08 User-agent: AhrefsBot # 2017-02-09 User-agent: seoscanners # 2017-02-09 User-agent: linkdexbot # 2017-02-10 User-agent: PetalBot # 2020-09-20 User-agent: LCC # 2020-09-22 User-agent: SemrushBot # 2020-09-22 User-agent: BLEXBot # 2020-09-22 User-agent: FacebookBot # 2024-06-11; however, ignored by bloody FB! User-agent: Amazonbot # 2024-06-15 User-agent: Bytespider # 2024-06-15 User-agent: WormlyBot # 2024-06-16 User-agent: dotbot # 2024-06-16 Disallow: / # times are seconds User-agent: CCBot Crawl-Delay: 60 User-agent: Slurp Crawl-Delay: 45 User-agent: bingbot Crawl-Delay: 25 User-agent: Googlebot Crawl-Delay: 30 User-agent: GPTBot Crawl-Delay: 300 User-agent: ClaudeBot Crawl-delay: 60 User-agent: * Crawl-Delay: 3600 Disallow: /downloads/ Disallow: /emff_0.5.8/ # Commented out since google lamments (why the heck?) # Disallow: /graphics/ Disallow: /news/newsmenu.inc.php Disallow: *ContactTime.inc.php Disallow: geshi.php Disallow: /pdfs/ Disallow: /pics/ Disallow: /scripts/ Disallow: /transfer/ Disallow: *doc.kml Disallow: /working/ Disallow: /articles/libs/ Sitemap: http://bebac.at/sitemap.xml