The Best robots.txt File
http://www.last.fm/robots.txt
They are not usually anywhere near this funny.
The Best robots.txt File
A robots.txt file is a way for a site administrator to give instructions to web crawlers (robots) that are crawling the site.
{{ blurb }}
{{/blurb}} {{#picture_url}}