Sitemap: http://extrasolar.spaceart.org/sitemap.xml User-agent: * Disallow: /911/ Disallow: /cgi-bin/ Disallow: /client/ Disallow: /cmn/ Disallow: /img/ Disallow: /cmnlocal/ Disallow: /imglocal/ Disallow: /include/ Disallow: /includelocal/ Disallow: /reports/ Disallow: /404error.html Disallow: /error.html Disallow: /biteme.html Disallow: /*.shtml User-agent: Baiduspider Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: Baiduspider/2.0;+http://www.baidu.com/search/spider.html Disallow: / User-agent: +Baiduspider Disallow: / User-agent: +Baiduspider/2.0;++http://www.baidu.com/search/spider.html Disallow: / User-agent: Mozilla/5.0(compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) Disallow: / User-agent: Browsershots Disallow: / User-agent: EasouSpider Disallow: / User-agent: Exabot Disallow: / User-agent: ezooms Disallow: / User-agent: Ezooms/1.0 Disallow: / User-agent: Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot[at]gmail[dot]com) Disallow: / User-agent: NaverBot Disallow: / User-agent: Yeti Disallow: / User-agent: sogou spider Disallow: / User-agent: Sosospider+ Disallow: / User-agent: spider Disallow: / User-agent: Yandex Disallow: / User-agent: YandexBot Disallow: / User-agent: YandexImages Disallow: / User-agent: Yandex.com Disallow: /