218.22.2X.X in Hefei, China – Please don’t scrape the site!

Meet the GIMP and the GimpMagazine have been offline for hours today, because someone needed to download all the content in parallel. I have no idea if this is flattering or an attack. I have blocked the IP and will re-open it after I got a mail from you

This was simply too much load for the machine.

rtm_692051918086

Edit: Now the machine should be able to keep up, I limited the memory consumption of Apache. It will be slow, but will stay up.

The next video is in the works, I can start editing tomorrow after the grades meetings are over. Lots of stuff happening here, more in the show.

5 thoughts on “218.22.2X.X in Hefei, China – Please don’t scrape the site!

  1. Why on earth bother attacking you guys? 🙂
    Could be the result of an out-of-control or non rate-limited wget to scrape everything. Punks!

    • The user agent is “Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)” – not even nasty Free Software based. 😉 I guess too that this is a wild script.

      Some time ago I had one IP from somewhere in Russia dowload a video repeatedly over quite a time – 2 TB worth of traffic. I hope for him that he has a flat rate. By miracle I kept under the threshold of my traffic limit.

      • A day later still 4 to 10 requests per second from that IP, all denied by the apache server. Now I simply drop these packages with netfilter. Strange.

        • You could always reroute the requests to servers that the Chinese firewall would hate, and possibly have the Chinese secret police drop by and start asking questions of the requestor. 😉

Anything to add from your side of the computer?

This site uses Akismet to reduce spam. Learn how your comment data is processed.