# robots.txt file for http://www.consumerfreedom.com # file keeps from visiting spiders from searching unwanted directories User-agent: * Disallow: /admin/ Disallow: /administrator Disallow: /customtags Disallow: /images Disallow: /templates Disallow: /utilities Allow: /downloads/reference/ Allow: /cartoons/ Allow: /pad/ Allow: /rss/ Allow: /news/ User-agent: twiceler Disallow: /