10 Tips to use sitemap file for faster crawling and indexing of your site pages



Google Webmaster blog just posted a article on sitemap FAQ’s. Sitemap.xml is a best way to crawl and index your site pages quickly. The pages having no direct links from main page or those difficult to find to search engine crawlers can be easily discovered by crawler bots from sitemap file.

Sitemap is a xml format file that can be placed on your sites root directory. All your site links are listed in sitemap.xml file. Sitemap format should be accepted by all search engine bots. The universal standard about sitemap.xml can be found on site sitemap.org.

Here is the summary from Google sitemap FAQ’s:

1) Sitemap.xml file can be used by search engine crawlers to discover the pages from your site.

2) The information in sitemap.xml file is: All your site urls and individual page importance. URL importance factor is a index stating the importance of the page for search engines. This is typically a factor from 0 to 1. Crawlers can better understand your site from these links from sitemap.xml file.

Sitemap sample

3) Submitting the sitemap to search engine does not mean that your site will get higher rank. It’s just a way to make search engines aware of your site links.

4) No search engine will penalize your site in terms of ranking or indexing pages for submitting a sitemap file or wrong sitemap file.

5) You can place your sitemap file anywhere on your site domain. Make sure to submit the same path in Webmaster tools. Submit sitemap to Google in Google Webmaster tools here.

6) The preferred sitemap format by search engine bots is XML format over HTML format. However submitting both format is a great idea.

7) You can avoid duplicate content penalty from search engines by giving preference to duplicate content URLs, i.e. higher preference for url that you want to be indexed for particular content page linked from different URLs.

8 ) Placing the URL at the beginning of your sitemap.xml file does not mean higher preference than URLs placed at the end of sitemap file.

9) You can submit any number of sitemap files for one domain. Make sure to create a sitemap index file in this case.

10) And last great tip: Use this sitemap generator WordPress plugin to create and submit sitemap to Google.

Submit sitemap to different search engines here:

Submit sitemap to Google: https://www.google.com/webmasters/tools/

Submit sitemap to Yahoo: http://siteexplorer.search.yahoo.com/

Submit sitemap to MSN:
Use below ping url: http://api.moreover.com/ping?u=http://www.yourdomain.com/yoursitemap.xml
Example:
http://api.moreover.com/ping?u=http://www.etechbuzz.com/sitemap.xml

Submit sitemap to ASK.com:
Use below ping url: http://submissions.ask.com/ping?sitemap=http%3A//www.yourdomain.com/sitemap.xml
Example: http://submissions.ask.com/ping?sitemap=http%3A//www.etechbuzz.com/sitemap.xml

If you like This post, you can follow eTechBuzz on Twitter. Subscribe to eTechBuzz feed via RSS or EMAIL to receive instant updates.

18 Responses to “10 Tips to use sitemap file for faster crawling and indexing of your site pages”

  1. Ahad Bokhari says:

    Hey Vijay,

    Good post and solid information yar. Im a flash developer located in Karachi, Pakistan. I will be launching my brand/website (fluidnewmedia) shortly. I deal with Flash and Flex RIW’s/RIA’s.

    Usually i use SWF Object to [embed] my files into html. SWF object allows you to add alternate content to your divs beneath the .swf file which makes for better indexing + xml generated sitemaps.

    Don’t know as much as you do about SEO and have been approached by several companies offering SEO for Blogging. Any thoughts on good SEO for dynamic Flash sites?

    Thanks and keep up the good work!!!

  2. Hi

    Thanks for these great tips.

    All what you said is about sites.
    What about blogs?

    Do blogs need sitemaps?

    thanks.

  3. Ahad Bokhari says:

    Blogs are a type of site….Yes i am sure you can gain from adding a sitemap onto your blog. Best way to get traffic to your blog is by reaching out to the community posting on other blogs and of course what Vijay said take part in the Best Blog for 2008 Contest in your particular category…Dont know the link dude but check out on this blog for the appropriate listing and information….

    GL!! :-)

  4. […] 10 Tips to Use Sitemap Files for Faster Crawling and Indexing of Your Site Pages by Vijay at eTechBuzz.com. […]

  5. You cannot have a sitemap for a blog as you cannot put the sitemap on a server unless you host your own blog.

  6. horacio says:

    hi, here is an example of my sitemap.xml file in my SMF Forum

    http://empleo.wadooa.com/sitemap.xml

    bye.

    p.s. I used the sitemap mod for smf(simple machine forum)

  7. […] think Google crawler is taking more time to index your pages, then create sitemap and submit XML sitemap to Google. Also put HTML sitemap on […]

  8. […] think Google crawler is taking more time to index your pages, then create sitemap and submit XML sitemap to Google. Also put HTML sitemap on […]

  9. […] think Google crawler is taking more time to index your pages, then create sitemap and submit XML sitemap to Google. Also put HTML sitemap on […]

  10. Polski Sklep says:

    Hi
    Thanks for these great tips. It really helped me to boost the amount of visitors on my website.

  11. Generator says:

    For non-Wordpress sites there is a good and free sitemap generator: http://www.web-site-map.com/
    Of course it can be used for WordPress as well:)

  12. how to rewrite sitemap in my site,
    i need to send my sitemap to google webmater, but its showing problem
    i send with sitmap, i know its need sitemap.xml file
    and how to create this file

  13. hi , i need smf sitemap like xml, how to put sitemap with xml is there any mod

  14. bitlink says:

    Supurb! thanks for the links and help – all my sites submitted now!
    cheers. mike

  15. good,I can implement these tips.thankyou

  16. thankyou information was useful

  17. RayMeds says:

    Very nice article what you have shared about sitemap. This is really very helpful for me. I am happy because of i have prepared my presentation with the help of this article.

    Regards
    sharon baker, NY

  18. freshturko says:

    Good sharing and nice post..
    freshturko.com

Leave a Reply

Spam Check: * Time limit is exhausted. Please reload the CAPTCHA.

© 2008 eTechBuzz.com. All rights reserved - Articles cannot be reproduced without our permission..