Competitive analysis is par for the course in search--but Bill "IncrediBILL" Atchison offers up a list of tools you can use to help keep "keep lazy and nosy assed SEO's or other competitors from
quickly analyzing all your hard work and simply stealing what you've done."
You can block the archive.org crawler, which will keep competitors from scraping your archived
pages--preventing them from seeing how your site evolved over time. Add archive.org and the Xenu (a link sleuthing tool) to your .htaccess file and you'll keep snoopers out. You should also block
bots, speeding crawlers and other unauthorized tools with your .htaccess file.
Meanwhile, disabling the search engine cache allows you to "cloak pages and just show the search
engines raw text yet show the visitors a complete page layout," IncrediBILL says. And don't forget that you can make your domain registration private with tools like DomainByProxy.
Read the whole story at IncrediBILL's Random Rants »