Yahoo Slurp Spiders

[Don Bryant]

Why do we have so many Yahoo Slurp Spiders? I think there is a way to prevent them. They are just hogging resources.

Don Bryant

[jd callow]

Why do we have so many Yahoo Slurp Spiders? I think there is a way to prevent them. They are just hogging resources.

Don Bryant

Don,
Have you noticed the site slowing down? I hate to restrict any bots at this point.

jdc

[Sean]

They aren't too bad and it gets us indexed. APUG has had upwards of 700 on at one time. This is often just for a few seconds per bot but since the online stats shows last x minutes it appears we are swamped with them..

[Don Bryant]

Don,
Have you noticed the site slowing down? I hate to restrict any bots at this point.

jdc

JD,

For the most part no, but occasionally it seems sluggish, but not often. I just happen to notice all of the spiders and thought they were excessive.

Don