# robots.txt for http://www.provider.net.ru/ User-agent: * Disallow: /wstat7/ Disallow: /stats/ Disallow: /db/ Disallow: /include/ Disallow: /lib/ Disallow: /mysql/ Disallow: /ads/ Disallow: /phpadsnew/ Disallow: /phpadsnew/www/ Disallow: /phpadsnew/www/delivery/ Disallow: /plus/ Disallow: /forum/index.php/u/ Disallow: /forum/index.php/re/ Host: www.provider.net.ru User-agent: * Disallow: Host: provider.net.ru