Home Messages Index
[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index

Re: Time for deep crawl results to show up

  • Subject: Re: Time for deep crawl results to show up
  • From: "Beach Comber" <BeachNews@worldbeachlist.com>
  • Date: 22 Feb 2005 04:59:21 -0800
  • Complaints-to: groups-abuse@google.com
  • Injection-info: g14g2000cwa.googlegroups.com; posting-host=162.24.9.213; posting-account=czlVmQ0AAABi7rBmFf1jKh5Ucn8BNjzh
  • Newsgroups: alt.internet.search-engines
  • Organization: http://groups.google.com
  • References: <1109028790.238809.18770@g14g2000cwa.googlegroups.com> <cve1f8$1sk7$2@godfrey.mcc.ac.uk> <XSvSd.13511$%U2.1123@lakeread01> <cvekpu$3103$2@godfrey.mcc.ac.uk> <591m119gqrvgt5emvthpmp46qj45livted@4ax.com> <cvf6ph$3sp$3@godfrey.mcc.ac.uk>
  • User-agent: G2/0.2
  • Xref: news.mcc.ac.uk alt.internet.search-engines:55699
> Interesting... why not just have a single gigantic site map?
Cascading being
> necessarily better?

Roy, from what I've heard, Google really doesn't like more than 50
links per page.  With a single, giant site map you may only see the
first 50 or so links followed for any other indexing.

For my site, the URL's themselves are shallow but the link chains can
get rather long.  It is now day four and Google is still hitting pages
every few minutes.  Yesterday is pulled over 1700 in.  The spider hit
the important content back on day one, so I'm hoping to see some of
that in the index before too much longer.  In a way, it is like waiting
for Christmas.

Beach Comberr
http://worldbeachlist.com/


[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index