Just for your information, at this moment it is about 15:30 and since 14:00 I experienced a really bad performance of the website. Maybe because it is 6/7 hours later here and the server was doing some maintenance but it was so slow I was getting time-outs.
info@elgg.org
Security issues should be reported to security@elgg.org!
©2014 the Elgg Foundation
Elgg is a registered trademark of Thematic Networks.
Cover image by Raül Utrera is used under Creative Commons license.
Icons by Flaticon and FontAwesome.
- Arsalan Shah@arsalanlee
Arsalan Shah - 0 likes
- Paweł Sroka@srokap
Paweł Sroka - 0 likes
- Eric@starkey
Eric - 0 likes
- Paweł Sroka@srokap
Paweł Sroka - 0 likes
- LT@latrevino
LT - 0 likes
- Eric@starkey
Eric - 0 likes
- Paweł Sroka@srokap
Paweł Sroka - 0 likes
- Gerard@gkanters
Gerard - 0 likes
- Paweł Sroka@srokap
Paweł Sroka - 0 likes
You must log in to post replies.me too!
We have significant traffic from several crawlers that impacts general server performance.
I understand, today it is not much better and hopefully you will be able to withstand these 'crawlers'.
Regards,
Eric
I've ended up blocking them by IPs. Their own robots.txt rules didn't help. Server load is back to normal now.
WooooHooo
:) Nice
They returned today. I've blocked their whole subnet: 5.10.83.0/24. Let us know if you have friends there ;-)
@Pawel I have a nice set of Rewrite rules based on USER AGENT to scan for bad bots. They will get a 403 page in return. If you are interested I can PM it to you. I do not want to publish them, since the bots might change their signature.
We don't need it at the moment. It was single bot this time. Right now we're mostly crawled by google and within reasonable limits.
I'll keep that in mind in case of similar problem. Thanks!