0

There are 3000 entries inside sitemap.xml,but it turns out that Google just crawls 300 of them,what's the problem?

  • because 3000 is a WOW amount. –  Oct 16 '09 at 06:47
  • I don't think it's in the number of entries. According to this Wikipedia article you can point to 5000 * 1000 entries. http://en.wikipedia.org/wiki/Sitemaps#Sitemap_limits – Luke Oct 16 '09 at 06:52

3 Answers3

2

I'd suggest taking a look into Google Webmaster Tools. There you see the number of submitted URLs and the number of indexed URLs. If URLs get indexed depends on links back to the page, so they might not get indexed even if they're crawled (note the difference). Furthermore, Webmaster Tools tells you if any crawling errors ocurred, which might be the case if only some of your URLs get crawled.

msp
  • 121
  • 3
  • +1. Additionally, Webmaster Tools will parse sitemap.xml for you, and show you if there are errors. http://www.google.com/webmasters/ –  Oct 16 '09 at 12:27
1

It can takes weeks for Google to fully index a site. The quality and perceived importance if the page (incoming links) is a contributing factor.

0

  1. Is Google just crawling the first 300, or some other set?

  2. How long have your waited for the crawl? I've seen Google wait a long time (>2 wk) before getting around to crawling everything on a sitemap.

user123079
  • 86
  • 4