Members: 5,078   Posts: 21,011   Online: 104
      
Results 1 to 4 of 4
  1. #1
    Don Bryant's Avatar
    Join Date
    Oct 2006
    Posts
    1,405

    Yahoo Slurp Spiders

    Why do we have so many Yahoo Slurp Spiders? I think there is a way to prevent them. They are just hogging resources.

    Don Bryant

  2. #2
    jd callow's Avatar
    Join Date
    Oct 2006
    Location
    Milan
    Posts
    773
    Images
    2
    Quote Originally Posted by Don Bryant View Post
    Why do we have so many Yahoo Slurp Spiders? I think there is a way to prevent them. They are just hogging resources.

    Don Bryant
    Don,
    Have you noticed the site slowing down? I hate to restrict any bots at this point.

    jdc

  3. #3
    Sean's Avatar
    Join Date
    Oct 2006
    Posts
    130
    Images
    3
    They aren't too bad and it gets us indexed. APUG has had upwards of 700 on at one time. This is often just for a few seconds per bot but since the online stats shows last x minutes it appears we are swamped with them..

  4. #4
    Don Bryant's Avatar
    Join Date
    Oct 2006
    Posts
    1,405
    Quote Originally Posted by jd callow View Post
    Don,
    Have you noticed the site slowing down? I hate to restrict any bots at this point.

    jdc
    JD,

    For the most part no, but occasionally it seems sluggish, but not often. I just happen to notice all of the spiders and thought they were excessive.

    Don

 

 
DPUG.ORG is a division of Photocentric Ltd.  |   All Content Copyright 2011 Photocentric Ltd.
Contact Us  |  Support Us!  |  Advertise  |  Site Terms  |  Archive  |   Search  |  Mobile     Facebook     Twitter     Linkedin     RSS