__/ [Ray] on Monday 09 January 2006 21:55 \__
> On 9 Jan 2006 08:33:18 -0800, johnsolver@xxxxxxxxx wrote:
>
>>Hi,
>>I've got a site with a lot of content, google indexes ~60k pages and
>>visits daily, yahoo however isn't. Slurp (yahoo) requests around 6
>>pages a day and they aren't unique (rescans already scanned pages).
>>
>>I'm at a loss, what can I do to remedy this? Some people suggested
>>changing the dynamic links ?ftdid=324 etc. to some kind of static
>>representation but that would mean changing all the links and kicking
>>google in the teeth while I'm not even certain that would help with
>>yahoo.
>>
>>>From what I've read bots know how to handle dynamic urls and this is a
>>problem from the past...
>>
>>Please help...
>>Thanks.
>
> Hi I've found exactly the same scenario, all I can put it down to is
> Yahoo is lazy or not too concerned about how fresh it's index is?
What's the address of the site? Are you using Google Sitemaps? Any JavaScript
menus that might stand in the way? What are the pages which get requested by
Yahoo?
I personally found that Yahoo and MSN would only bother crawling 10% of what
Google crawls on my main domain. In smaller domains, they crawl everything,
just like Google. They haven't got the 'deepcrawler' of Google. Their
exploration scope is typically narrower. It might explain why they fail to
provide information about rare problems (arcane search terms), but do
alright otherwise.
Roy
|
|
