By : Nidhi Gupta

What is a Google Sitemap?

A Google Sitemap is a very simple XML document that lists all the pages in your website, but the Google Sitemaps program is actually much more important than that. In fact, the Sitemaps program provides a little peek inside Google’s mind - and it can tell you a lot about what Google thinks of your website!

Why Should You Use Google Sitemaps?

Until Google Sitemaps was released in the summer of 2005, optimizing a site for Google was a guessing game at best. A website’s page might be deleted from the index, and the Webmaster had no idea why. Alternatively, a site’s content could be scanned, but because of the peculiarities of the algorithm, the only pages that would rank well might be the “About Us” page, or the company’s press releases.

As webmasters we were at the whim of Googlebot, the seemingly arbitrary algorithmic kingmaker that could make or break a website overnight through shifts in search engine positioning. There was no way to communicate with Google about a website - either to understand what was wrong with it, or to tell Google when something had been updated.

That all changed about a year ago when Google released Sitemaps, but the program really became useful in February of 2006 when Google updated it with a couple new tools.

So, what exactly is the Google Sitemaps program, and how can you use it to improve the position of your website? Well, there are essentially two reasons to use Google Sitemaps:

1. Sitemaps provide you with a way to tell Google valuable information about your website
2. You can use Sitemaps to learn what Google thinks about your website

What You Can Tell Google About Your Site

Believe it or not, Google is concerned about making sure webmasters have a way of communicating information that is important about their sites. Although Googlebot does a pretty decent job of finding and cataloging web pages, it has very little ability to rate the relative importance of one page versus another. After all, many important pages on the Internet are not properly “optimized”, and many of the people who couldn’t care less about spending their time on linking campaigns create some of the best content.

Therefore, Google gives you the ability to tell them on a scale of 0.0 to 1.0 how important a given page is relative to all the others. Using this system, you might tell Google that your home page is a 1.0, each of your product sections is a 0.8, and each of your individual product pages is a 0.5. Pages like your company’s address and contact information might only rate a 0.2.

You can also tell Google how often your pages are updated and the date that each page was last modified. For example your home page might be updated every day, while a particular product page might only be updated on an annual basis.

Spread the word: related/bookmark it/readit

By : Nidhi Gupta

There are many SEO tips and tricks that help in optimizing a site but one of those, the importance of which is sometimes underestimated is sitemaps. Sitemaps, as the name implies, are just a map of your site - i.e. on one single page you show the structure of your site, its sections, the links between them, etc. Sitemaps make navigating your site easier and having an updated sitemap on your site is good both for your users and for search engines. Sitemaps are an important way of communication with search engines. While in robots.txt you tell search engines which parts of your site to exclude from indexing, in your site map you tell search engines where you’d like them to go.

Sitemaps are not a novelty. They have always been part of best Web design practices but with the adoption of sitemaps by search engines, now they become even more important. However, it is necessary to make a clarification that if you are interested in sitemaps mainly from a SEO point of view; you can’t go on with the conventional sitemap only (though currently Yahoo! and MSN still keep to the standard html format). For instance, Google Sitemaps uses a special (XML) format that is different from the ordinary html sitemap for human visitors.

One might ask why two sitemaps are necessary. The answer is obvious - one is for humans, the other is for spiders (for now mainly Googlebot but it is reasonable to expect that other crawlers will join the club shortly). In that relation it is necessary to clarify that having two sitemaps is not regarded as duplicate content. In ‘Introduction to Sitemaps’, Google explicitly states that using a sitemap will never lead to penalty for your site.

Why Use a Sitemap

Using sitemaps has many benefits, not only easier navigation and better visibility by search engines. Sitemaps offer the opportunity to inform search engines immediately about any changes on your site. Of course, you cannot expect that search engines will rush right away to index your changed pages but certainly the changes will be indexed faster, compared to when you don’t have a sitemap.

Also, when you have a sitemap and submit it to the search engines, you rely less on external links that will bring search engines to your site. Sitemaps can even help with messy internal links - for instance if you by accident have broken internal links or orphaned pages that cannot be reached in other way (though there is no doubt that it is much better to fix your errors than rely on a sitemap).

If your site is new, or if you have a significant number of new (or recently updated pages), then using a sitemap can be vital to your success. Although you can still go without a sitemap, it is likely that soon sitemaps will become the standard way of submitting a site to search engines. Though it is certain that spiders will continue to index the Web and sitemaps will not make the standard crawling procedures obsolete, it is logical to say that the importance of sitemaps will continue to increase.

Sitemaps also help in classifying your site content, though search engines are by no means obliged to classify a page as belonging to a particular category or as matching a particular keyword only because you have told them so.

Having in mind that the sitemap programs of major search engines (and especially Google) are still in beta, using a sitemap might not generate huge advantages right away but as search engines improve their sitemap indexing algorithms, it is expected that more and more sites will be indexed fast via sitemaps.

Generating and Submitting the Sitemap

The steps you need to perform in order to have a sitemap for your site are simple. First, you need to generate it, then you upload it to your site, and finally you notify Google about it.

Depending on your technical skills, there are two ways to generate a sitemap - to download and install a sitemap generator or to use an online sitemap generation tool. The first is more difficult but you have more control over the output. You can download the Google sitemap generator from here. After you download the package, follow the installation and configuration instructions in it. This generator is a Python script, so your Web server must have Python 2.2 or later installed, in order to run it.

The second way to generate a sitemap is easier. There are many free online tools that can do the job for you. For instance, have a look at this collection of Third-party Sitemap tools. Although Google says explicitly that it has neither tested, nor verified them, this list will be useful because it includes links to online generators, downloadable sitemap generators, sitemap plugins for popular content-management systems, etc., so you will be able to find exactly what you need.

After you have created the sitemap, you need to upload it to your site (if it is not already there) and notify Google about its existence. Notifying Google includes adding the site to your Google Sitemaps account, so if you do not have an account with Google, it is high time to open one. Another detail that is useful to know in advance is that in order to add the sitemap to your account, you need to verify that you are the legitimate owner of the site.

Currently Yahoo! and MSN do not support sitemaps, or at least not in the XML format, used by Google. Yahoo! allows webmasters to submit “a text file with a list of URLs” (which can actually be a stripped-down version of a site map), while MSN does not offer even that but there are rumors that it is indexing sitemaps when they are available onsite. Most likely this situation will change in the near future and both Yahoo! and MSN will catch with Google because user-submitted site maps are just a too powerful SEO tool and cannot be ignored.

Spread the word: related/bookmark it/readit

By : Nidhi Gupta

Sitemaps and hypertext links are “food” for search engine robots. Text links are valuable for optimal spidering, and sitemap is important in order to help search engine robots reach your website’s deeper pages.

Hypertext Links

Search engine robots are not terribly sophisticated. They cannot click a button, submit a form, pull down a menu, or perform any other type of online “user interaction” that might be used by a human visitor. Robots are able to index the text on a page and click through hypertext links. For this reason, adding navigational text links to your web pages (often located at the bottom of the page) provides the search engine robots with another means to click through the links of your web pages when it cannot access these other types of navigation.

Search engine robots cannot use JavaScript menu system. They can only follow “plain old” hyperlinks. Since the ability to move around on your site is vital to the robots’ successful indexing of your content, you want to make it as easy as possible for them to visit all of your pages. Use of text links at the bottom of your pages is one of the best ways to make sure that the search engine robots can move around on your site. Be sure to include links to your site’s principal pages on all the pages in your site. Always remember to put a link to your sitemap page here too.

Sitemaps

A sitemap page is a supercharged version of the bottom-of-the-page hypertext links. The sitemap provides “food” for a hungry search engine robot. A sitemap page will, at very least, have links to all of the major pages on your site. Depending on the size of your site, it may actually link to all of your pages. This means that once the robot gets to the sitemap page, it can visit every page on your entire site. Having all of the content of your site included in the search engine database is a good thing: you are much more likely to come-up in the search engine results when somebody is performing a search related to your topic.

A good sitemap will:

• Provide text links to at least the most important pages on your site; depending on the size of the site, it may have links to every page

• Give a short explanation of each page on your site, to inform your visitors about your website

• Give your visitors the information they need when lost in your website, and show them how to reach the page they are looking for

• Provide a pathway for the search engine robots to follow in order to reach your most important pages

• Provide important keyword phrases in the sitemap text and hypertext links that help the automated search engine robot “understand” what the page is about

• Help search engine robots find static landing pages that then link to dynamically generated pages they may not otherwise find

Even if your website is small, add a sitemap for your visitors and for the search engine robots.

To make your sitemap most attractive to the search engine robots and your human visitors, be sure to include descriptive text along with the page URLs and links. Use your keywords in that text, including appropriate content for each of the pages to which you link. Be careful not to overuse your keyword phrases, though, or you may be penalized in the rankings. Remember that this is a map that will be used by both search engine robots and your human visitors. If the content of the page makes sense to the people who visit your site, chances are it will make sense to the visiting robots as well.

When you make it easy for your visitors to navigate your site, they will find what they are looking for. When you make it easy to search engine robots to move around on your site, you increase your chances of being favorably listed in their search results.

Spread the word: related/bookmark it/readit