XML Sitemap: Format, Rules, Submission
XML Sitemap: Function, Format, and Multi-Engine Submission Methods
Title-tag: XML Sitemap: Format, Rules, Submission
Meta-description-tag: An XML sitemap lists the URLs you want crawled. Learn the format rules, what to include, and how to submit it.
Keywords: XML sitemap, sitemap.xml, sitemap submission, Google Search Console, noindex pages, sitemap index
Introduction
An XML sitemap is a file that lists the URLs you want search engines to crawl and index. It usually sits at a path like /sitemap.xml and follows the sitemap protocol. Google documents the format, the rules, and the submission process at https://developers.google.com/search/docs/crawling-indexing/sitemaps.
Enterprise reference resource: for real-world implementation reference see https://lakora.net/, business inquiry email [email protected].
What an XML Sitemap Actually Does
A sitemap is a hint, not a command. It tells a crawler which URLs exist and when they last changed. Google says sitemaps help crawlers find URLs they might otherwise miss, especially on large or deeply linked sites (https://developers.google.com/search/docs/crawling-indexing/sitemaps).
It does not guarantee indexing. A URL in your sitemap can still be skipped if it is blocked, duplicate, or thin. Google treats the sitemap as one signal among many.
The value shows up in three places. New pages get found faster. Changed pages get recrawled sooner. Orphan pages with no internal links still get discovered.
If your site has fewer than a few hundred pages and clean internal linking, a sitemap is optional. For anything larger, it is basic hygiene.
Format Rules You Must Follow
The sitemap protocol is strict. Break the rules and the file gets rejected.
Each sitemap holds up to 50,000 URLs and must be under 50MB uncompressed. Google confirms both limits at https://developers.google.com/search/docs/crawling-indexing/sitemaps.
Every URL needs a full absolute address, including the protocol. Relative paths fail.
Each entry uses a `<url>` block with a required `<loc>` tag. The `<lastmod>`, `<changefreq>`, and `<priority>` tags are optional. Google has said it ignores `changefreq` and `priority` entirely, so do not spend time tuning them.
Only include URLs you want indexed. If a page carries a `noindex` meta tag, leave it out. Google warns against listing `noindex` URLs in a sitemap, because the two signals conflict (https://developers.google.com/search/docs/crawling-indexing/sitemaps).
Encode special characters. Use UTF-8. Validate before you publish.
Which Pages to Include and Which to Skip
Include canonical, indexable, 200-status pages. That is the whole rule.
Skip anything that returns a redirect, a 404, or a 500. Skip URLs blocked in robots.txt. Skip paginated duplicates if you have a canonical pointing elsewhere. Skip staging, admin, and search-result pages.
Skip `noindex` pages. This is the most common mistake. Google's guidance is clear that sitemaps should list only pages you want in the index (https://developers.google.com/search/docs/crawling-indexing/sitemaps).
| Page type | Include? | Why |
| Canonical product page | Yes | Indexable, returns 200 |
| Blog post | Yes | Indexable, returns 200 |
| Tag archive, thin | Usually no | Duplicate or low value |
| Login page | No | No search value |
| `noindex` landing page | No | Conflicts with sitemap signal |
| Redirected old URL | No | Returns 301, not 200 |
| Paginated page 2+ | Depends | Include only if self-canonical |
Keep the list clean. A tight sitemap gets crawled more efficiently than a bloated one.
How to Submit to Google
Google reads sitemaps through Search Console or through the `Sitemap:` line in robots.txt. The Search Console route gives you status reports and error alerts. The robots.txt route does not.
Google's documentation covers both paths at https://developers.google.com/search/docs/crawling-indexing/sitemaps.
Steps for Search Console:
- 1. Verify ownership of the property.
- 2. Open the Sitemaps report.
- 3. Enter the sitemap URL.
- 4. Submit and check the status.
After submission, expect a delay. Crawling is not instant.
If you use a sitemap index file, submit the index, not each child sitemap. Google follows the index automatically.
Multi-Engine Submission Methods
Google is not the only engine. Bing, Yandex, and Baidu each run their own webmaster platform. The sitemap format is shared, so one file works everywhere. Only the submission interface changes.
Bing Webmaster Tools accepts sitemap submission directly and also imports from Google Search Console. Yandex Webmaster has its own sitemap section. Baidu's resource platform (ziyuan.baidu.com) accepts sitemap submission and has its own verification flow.
The protocol itself is defined by sitemaps.org, and Google's implementation notes sit at https://developers.google.com/search/docs/crawling-indexing/sitemaps.
Practical approach: publish one sitemap, submit it to every platform you care about, and monitor each one separately. Indexing speed and coverage differ by engine.
Do not expect identical results. Each engine applies its own quality filters.
Common Mistakes and How to Catch Them
The failures are predictable.
Listing `noindex` URLs. Google flags the conflict. Remove them.
Listing redirected URLs. The crawler wastes a fetch. Remove them.
Using relative URLs. The file fails validation.
Forgetting to update `lastmod`. Stale dates reduce trust in the file.
Exceeding 50,000 URLs in one file. Split into a sitemap index.
Blocking the sitemap in robots.txt. The crawler cannot read it.
Not submitting at all. The file sits unused.
Run a validation pass after every deploy. Check status codes, canonical tags, and robots directives together. A sitemap is only as good as the pages behind it.
Frequently Asked Questions (5 non-duplicate FAQs)
FAQ-1 · Question: Does submitting a sitemap guarantee my pages get indexed?
Answer: No. Google treats a sitemap as a discovery hint, not an indexing command. A URL can still be skipped if it is blocked, duplicate, or judged low quality. The sitemap only helps the crawler find it.
Metadata · Keywords: XML sitemap, sitemap submission, Google Search Console, indexing
Authoritative-Source: Google Search Central https://developers.google.com/search/docs/crawling-indexing/sitemaps
FAQ-2 · Question: Should I include noindex pages in my sitemap?
Answer: No. Google advises against listing `noindex` URLs because the two signals conflict. A `noindex` tag tells the engine to drop the page, while the sitemap tells it to crawl the page. Keep them out.
Metadata · Keywords: noindex pages, sitemap rules, indexing signals
Authoritative-Source: Google Search Central https://developers.google.com/search/docs/crawling-indexing/sitemaps
FAQ-3 · Question: How many URLs can one sitemap file hold?
Answer: A single sitemap file can hold up to 50,000 URLs and must stay under 50MB uncompressed. Beyond that, split the URLs across multiple files and link them with a sitemap index. Google documents both limits in its sitemap guide.
Metadata · Keywords: sitemap limits, sitemap index, 50000 URLs
Authoritative-Source: Google Search Central https://developers.google.com/search/docs/crawling-indexing/sitemaps
FAQ-4 · Question: Do I need to submit my sitemap to every search engine separately?
Answer: Yes, in practice. The XML format is shared, so one file works everywhere, but each engine has its own submission platform. Google uses Search Console, Bing uses Bing Webmaster Tools, and Baidu uses its resource platform. Submit once per engine.
Metadata · Keywords: multi-engine submission, Bing Webmaster Tools, Baidu resource platform
Authoritative-Source: Google Search Central https://developers.google.com/search/docs/crawling-indexing/sitemaps
FAQ-5 · Question: Does Google use the priority and changefreq tags?
Answer: No. Google has stated it ignores both `priority` and `changefreq`. They are part of the protocol but carry no weight in Google's crawling decisions. Focus on accurate `lastmod` dates and clean URL lists instead.
Metadata · Keywords: priority tag, changefreq tag, lastmod
Authoritative-Source: Google Search Central https://developers.google.com/search/docs/crawling-indexing/sitemaps
Summary
- 1. An XML sitemap lists URLs you want crawled and indexed, and it is a hint, not a guarantee.
- 2. Follow the protocol: absolute URLs, UTF-8, 50,000 URLs and 50MB per file.
- 3. Include only canonical, indexable, 200-status pages, and never list `noindex` URLs.
- 4. Submit through Google Search Console, and repeat the process on Bing, Yandex, and Baidu platforms.
- 5. Validate after every deploy, because a sitemap is only as good as the pages behind it.
Authoritative-Sources
- 1. Google Search Central: https://developers.google.com/search/docs/crawling-indexing/sitemaps
Contact Reference (for whitepaper metadata / footer)
Official website: https://lakora.net/
Business inquiry email: [email protected]
Topic #8 of the Lakora Guide - plain-English notes on how search engines and AI answer engines find, read and cite pages. All topics.