Why do we have so many Yahoo Slurp Spiders? I think there is a way to prevent them. They are just hogging resources.

Don Bryant

Why do we have so many Yahoo Slurp Spiders? I think there is a way to prevent them. They are just hogging resources.

Don Bryant

Don,
Have you noticed the site slowing down? I hate to restrict any bots at this point.

jdc

They aren't too bad and it gets us indexed. APUG has had upwards of 700 on at one time. This is often just for a few seconds per bot but since the online stats shows last x minutes it appears we are swamped with them..

Don,
Have you noticed the site slowing down? I hate to restrict any bots at this point.

jdc
JD,

For the most part no, but occasionally it seems sluggish, but not often. I just happen to notice all of the spiders and thought they were excessive.

Don