# Robots.txt file from http://taofang.com # All robots will spider the domain User-agent: * Allow: / Disallow: /verify Disallow: /rate/add Disallow: /report Disallow: /message/new Disallow: /rate/comment Disallow: /forum/post Disallow: /rate/verifysecret Disallow: /rate/edit Disallow: /agent/rentedit Disallow: /message/result Disallow: /about/aboutus Disallow: /about/contactus Disallow: /about/terms Disallow: /about/hire Disallow: /feedback Disallow: /profile Sitemap: http://taofang.com/sitemap-index.xml