Summummabitch!
As some of you know, I've been scouring content from the web to make my
MP3 collection pages more SEO friendly. So of course with my huge collection of songs it would take until the end of the next millennium to gather reviews, artist bios, and lyrics manually. Naturally, I built a tool.
Now of course, my tool has to be as unnecessarily sophisticated as it can be, which means I'm doing major website scraping, multithreading, thread pumping and dynamic throttling. I ran my tool for every artist/album/track in my collenction against
AMG and other sites. Over 30,000 website hits in a matter of a few hours. Collected everything I could. Sweet.
Of course as I'm reviewing my results, I realize there's a major bug in my screen scraping routine. D'oh! I go to run my tool again, and suddenly, I get no results. I check my search result manually and this is the message I get any time I do a search on AMG from my home laptop:
Through traffic monitoring of our websites we have identified your IP address accessing allmusic.com at a rate and speed inconsistent with the noncommercial and personal use permitted by our site's Terms of Service. As a result, further access to allmusic.com has been denied. Because IP addresses can be shared by numerous users, your access may be being denied based on the aggregate use of your IP address rather than your own individual use. To ensure that this is not the case, simply create your own individual user account by becoming a Registered Member of allmusic. [Click on the “Register†button in the upper right hand corner of the home page.] Once you’ve become a Registered Member and are logged in, you will once again have full access to allmusic, and will continue to have access, as long as your usage remains consistent with our Terms of Service. If you are already a Registered Member of allmusic, simply ensure that you are logged in when you use the site. Thank you. - xxx.xxx.xxx.xxx
Dammit!
Though technically, it is for personal use, I suppose I could see how after reviewing their logs they could interpret my usage as a Denial of Service attack. Come on, what If I were a search engine spider? Hehe. I just thought that was way too fuckin' funny! Now of course, you know me. I'm not going to let this stop me, but this was great! Hah!
Labels: ASP.Net, Comedy, Programming, Technology, VB.Net, Web Development