Comments on: Apache Web Server Over Optimization: A Cautionary Tale http://www.vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale Sun, 28 Mar 2010 15:27:20 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: Glenn Jimersonhttp://www.vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/comment-page-1#comment-303 Glenn Jimerson Sun, 28 Mar 2010 15:27:20 +0000 http://www.vistawebmedia.com/?p=451#comment-303 Ouch! Banning Google bot has definitely got to hurt. I'd say your first move would be to flush your APF blocked IP's list and restart APF so you've cleaned out any blocked Google Bot Ip's. The next step would be to register your site with Google Webmaster Tools: http://www.google.com/webmasters/ . Once you get done verifying your site you can tell Google just how fast you want them to crawl your site: http://www.google.com/support/webmasters/bin/answer.py?answer=48620&hl=en. It may take a couple tweaks given how large your site it but it's a step in the right direction. Ouch! Banning Google bot has definitely got to hurt. I’d say your first move would be to flush your APF blocked IP’s list and restart APF so you’ve cleaned out any blocked Google Bot Ip’s. The next step would be to register your site with Google Webmaster Tools: http://www.google.com/webmasters/ . Once you get done verifying your site you can tell Google just how fast you want them to crawl your site: http://www.google.com/support/webmasters/bin/answer.py?answer=48620&hl=en. It may take a couple tweaks given how large your site it but it’s a step in the right direction.

]]> By: Mridulhttp://www.vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/comment-page-1#comment-300 Mridul Sun, 28 Mar 2010 01:41:58 +0000 http://www.vistawebmedia.com/?p=451#comment-300 I have a similar situation with DDOS. It is the google bot that is getting banned. My site has more than 50K feeds, and DDOS is now banning google bot... :-( Any idea how to solve this ? I have a similar situation with DDOS. It is the google bot that is getting banned. My site has more than 50K feeds, and DDOS is now banning google bot… :-( Any idea how to solve this ?

]]> By: Glenn Jimersonhttp://www.vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/comment-page-1#comment-227 Glenn Jimerson Tue, 09 Feb 2010 07:28:44 +0000 http://www.vistawebmedia.com/?p=451#comment-227 Thank you for the tip Nick! I'll definitely check it out. Thank you for the tip Nick! I’ll definitely check it out.

]]> By: Nick Hammondhttp://www.vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/comment-page-1#comment-226 Nick Hammond Tue, 09 Feb 2010 05:47:14 +0000 http://www.vistawebmedia.com/?p=451#comment-226 Take a look at nginx too, performs very well under high load. The server configuration is also a little cleaner too.http://nginx.org/ Take a look at nginx too, performs very well under high load. The server configuration is also a little cleaner too.

http://nginx.org/

]]> By: Glenn Jimersonhttp://www.vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/comment-page-1#comment-161 Glenn Jimerson Wed, 18 Nov 2009 21:49:15 +0000 http://www.vistawebmedia.com/?p=451#comment-161 If you want to optimize your sever the right way check out this outstanding article from Ask Apache: http://www.askapache.com/linux-unix/optimize-nice-ionice.html If you want to optimize your sever the right way check out this outstanding article from Ask Apache: http://www.askapache.com/linux-unix/optimize-nice-ionice.html

]]>