[vox-tech] System Slow down

[Richard Crawford]

On Tuesday 06 March 2007 12:29:57 Gandalf Parker wrote:
> Do you have a web server like Apache running? Do the apache logs show alot
> of bot hits? I recently had to do some major robots.txt work for no other
> reason than the google image bot falling in love with my system.

I hadn't thought about that.  I'm showing a lot of hits from both Google and 
MSN.  I've put in the toughest robots.txt file I can think of:

User-agent: *
Disallow: /

Though I'm still seeing a lot of hits.


-- 
Richard S. Crawford (http://www.mossroot.com)
"That which does not kill me makes me stranger."
    -Llewellyn, from Ozy & Millie