XML Sitemap, explained properly.
In a nutshell
An XML sitemap functions as a machine-readable index that lets Google and Bing discover and crawl pages faster. It highlights newly published and updated pages while surfacing deep content that internal linking might miss. For example, a 500-product Shopify store submits its sitemap_index.xml to Search Console for complete product indexing.
What is an XML sitemap?
An XML sitemap helps search engines discover and crawl your website's pages efficiently. Written in XML format, it's submitted to Google Search Console and Bing Webmaster Tools to help bots prioritise crawling and indexing.
Where is an XML sitemap located?
Most sitemaps live at https://www.yourdomain.com/sitemap.xml. Larger websites may use multiple files or subdirectories, with links included in the robots.txt file so bots can discover them.
Why XML sitemaps matter for SEO
- Improve crawl efficiency by directing bots to high-value pages. - Highlight newly published content for quicker indexing. - Ensure discovery of orphaned or deep-linked pages. - Support international SEO with hreflang-enabled sitemaps. BrisTechTonic's SEO audits regularly find missing sitemaps, incorrectly listed pages, or bloated sitemaps full of non-indexable URLs.
What should be included in your sitemap
**Include:** - Live pages with valuable content. - Canonical versions of pages, not duplicates. - Pages you want Google to rank. **Exclude:** - Noindex or blocked pages. - Redirects and 404s. - Paginated pages, tag archives, or parameter-based URLs, unless part of a structured SEO strategy.
How to create an XML sitemap
**Automatic generation by platform:** - WordPress: SEO plugins like Rank Math or Yoast. - Shopify: auto-generates at /sitemap_index.xml. - Wix and Squarespace: automatic, no plugin needed. **Manual tools:** - xml-sitemaps.com. - Screaming Frog. - Sitebulb.
Sitemap submission
Submit sitemaps to Google Search Console and Bing Webmaster Tools. You can also list your sitemap in robots.txt: ``` Sitemap: https://www.yourdomain.com/sitemap.xml ```
Multiple sitemaps and sitemap index files
Google allows up to 50,000 URLs per sitemap file, with a 50MB uncompressed size limit. Larger sites create multiple sitemaps listed in a sitemap index file, for example https://www.yourdomain.com/sitemap-index.xml. This is particularly useful for ecommerce stores, international websites, and news publishers.
How sitemaps work with crawl budget
Submitting a sitemap doesn't guarantee indexing, but it signals which pages you consider important. Combined with a smart crawl budget strategy, XML sitemaps help reduce crawl waste, prioritise revenue-generating pages, and monitor indexing status in Google Search Console.
XML sitemap vs HTML sitemap
- **XML sitemap:** built for bots, focused on crawl and index control. - **HTML sitemap:** built for users, often a clickable page showing key site sections.
Common XML sitemap issues
- Including noindex URLs creates mixed signals. - Including 404s or redirects wastes crawl budget. - Empty sitemaps are technically valid but useless. - Missing hreflang references harm international SEO.
Image and video sitemaps
Dedicated media sitemaps can give Google extra context for infographics, how-to videos, and ecommerce product images. They are particularly useful for Shopify, WooCommerce, or learning sites with rich visuals.
XML Sitemap: common questions.
Where should the XML sitemap live?
At /sitemap_index.xml at your domain root (for example yoursite.com/sitemap.xml). Most CMSs and SEO plugins (Rank Math, Yoast, All In One SEO) generate this automatically. Submit the URL to Google Search Console, and Google periodically re-fetches it.
Do I need separate sitemaps for different content types?
For larger sites, yes. A sitemap index pointing to multiple sitemaps (posts, pages, products) is best practice once you exceed several thousand URLs. Most SEO plugins handle this automatically.
What should and shouldn't be in the sitemap?
Include indexable, canonical pages you want to rank. Exclude noindexed pages, duplicate URLs, pages blocked by robots.txt, and login or admin pages. A common mistake is including tag and category archives that are set to noindex elsewhere, which creates conflicting signals.
How often should the sitemap update?
Whenever content changes. Modern SEO plugins update automatically when posts or pages are added, edited, or removed. Static sitemaps become stale quickly and lose value; verify regeneration by changing a page and checking the sitemap timestamp.
What clients say about working with us.
“I've had the pleasure of working with Chris on several SEO projects for my websites in the health field. He was definitely been able to demystify things so that I felt able to make decisions with him and feel confident they were the right ones. For a non-techie, that is worth gold! I look forward to working with Chris again and warmly recommend him to anyone who - like me - is unsure about all things SEO.”
“I was recommended by my branding partner to use Chris and his team last year. I can’t recommend them highly enough. They are very responsive , easy to communicate with and great at translating techy stuff when needed. They are now an essential part of my business model”
“We've been working closely with Chris, Hannah and the team for over 12 months now. As a small company with ambitious growth plans, it was incredibly important that we made the right choice on who to trust with our SEO. 18 months later, we're totally thrilled with our experience so far and our growing online presence within our market. We'd happily recommend BTT and their services to other SMEs. Drop them an enquiry!”
Real people on your account, not a faceless agency.
You work directly with the senior people who do the work, a small Bristol team you will actually get to know, not a call centre or an account manager relaying messages.
Meet the team →
