# All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /toplists/ Disallow: /toplists.tpl/ Disallow: /linkex/ # GoogleBot Disallow: /cgi-bin/ Disallow: /toplists/ Disallow: /toplists.tpl/ Disallow: /linkex/ Sitemap: http://www.oasianporn.com/sitemap.xml