Home Messages Index
[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index

Re: Yahoo slurp acting strangely

  • Subject: Re: Yahoo slurp acting strangely
  • From: Roy Schestowitz <newsgroups@schestowitz.com>
  • Date: Wed, 09 Feb 2005 11:24:56 +0000
  • Newsgroups: alt.internet.search-engines
  • References: <BE2F8AB5.2A9BC%invalid@invalid.invalid>
  • User-agent: KNode/0.7.2
Philip Ronan wrote:

> Hi,
> 
> For the last couple of days I've been getting a lot of 404 errors on my
> website. Turns out that many of them are being generated by the Yahoo
> "slurp" spider (66.196.65.*), which has started randomly substituting
> directory names and file names with junk like "/mwou/", "/FukumoA/",
> "/FFALinks.htm" and "/v242b/".
> 
> I emailed Yahoo about it, but they didn't reply of course. Has anyone else
> noticed this behaviour, or are they doing this purely for my benefit??
> 
> Phil

Yahoo Slurp often make traversal mistakes on my site, but it is not what you
describe. They decent to wrong levels when presented with the Apache
interface to directory contents. Are you sure it is always Slurp? Also, are
the paths they look for somehow meaningful to you? Is it possible that they
all come from a different site? Maybe search these names and find the
commonality...

Roy

-- 
Roy Schestowitz
http://schestowitz.com

[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index