Hacking Your Own Server with Google!
Here’s a guy who accidentally cause over $1000 in charges on his cloud server by telling a google service about it. Google decided to download the data – all of the data – every hour with hundreds of crawlers. Nice.
Be careful out there. Some google services and many generic web crawlers do not honor the robots.txt.
