Skip to content

How to Easily Explore a Website’s Sections and Resources Using Its Sitemap

A sitemap serves two distinct purposes depending on whether it’s intended for a search engine crawler or a human visitor. The XML sitemap lists…

Femme consultant un plan de site web imprimé sur un bureau en bois dans un bureau à domicile moderne
5 min

A sitemap serves two distinct purposes, depending on whether it is intended for a search engine crawler or a human visitor. An XML sitemap lists URLs for search engines, while an HTML sitemap shows users how a site’s navigation is structured.

Confusing the two leads to false expectations: submitting an XML file to Google guarantees neither that pages will be crawled nor that they will be indexed, and the file is no use for visually browsing a site’s sections.

XML sitemap tags: what Google actually uses

The sitemap protocol allows several tags for each URL. Among them, lastmod, priority and changefreq appear in almost every automatic generator. Their actual usefulness, however, differs from what many guides suggest.

Google ignores the priority and changefreq fields. Including them in a file does not trigger a validation error, but it has no effect on crawl frequency or rankings. Any documentation that presents priority as an SEO lever is outdated or inaccurate.

The lastmod tag is the only metadata Google takes into account, provided it reflects a substantial change to the content. Updating the date without changing the page text sends a misleading signal. When the date is consistently and verifiably accurate, it helps Googlebot prioritize its visits. Otherwise, it is ignored.

A sitemap is not the only way for search engines to discover pages, either. Adding a Sitemap: directive to the robots.txt file signals the location of the XML file without going through Google Search Console or Bing Webmaster Tools. This option remains underused, particularly on sites that manage multiple subdomains with separate sitemaps.

The structure of the Euromedia Télévision sitemap illustrates this principle well: each URL is listed with its last-modified date, making the site hierarchy easier for both search engines to index and people to read.

Man browsing a website sitemap displayed on a large screen in an open-plan office

HTML sitemap and navigation: find a section without digging

An HTML sitemap is still the most direct way for visitors to access all the sections of a site. Unlike an XML sitemap (a raw file that is unreadable without a tool), an HTML sitemap is a standard web page, with clickable links organized by category.

On medium-sized sites, this page often brings together all sections: company pages, content categories, product pages and legal notices. The hierarchy is visible at a glance, whereas the main navigation menu shows only the first two levels.

Accessing the HTML sitemap of an existing site

The most common convention is to place this page at /plan-du-site or /sitemap (without the .xml extension). There is usually a link in the footer. If it is missing, manually trying these URLs in the address bar works in most cases.

Not all sites offer an HTML sitemap. CMS platforms such as WordPress rarely generate one by default. In that case, you will need to use other methods to reconstruct the site hierarchy.

Tools for visualizing a website’s structure

When no HTML sitemap is available, several approaches can help reconstruct a site’s structure. The right choice depends on the level of detail required and the size of the site being explored.

  • Browser DevTools (the Network tab) let you inspect every request made as a page loads, including CSS and JS files and API calls. They are not a mapping tool, but they reveal the resources loaded by a given page and the URLs called dynamically.
  • Dedicated crawlers (Screaming Frog, Sitebulb, or scripts based on Puppeteer/Headless Chrome) follow a site’s internal links and reconstruct its full hierarchy. They export URL lists, page depth, HTTP response codes and links between pages.
  • Online visualization tools such as Octopus.do or DynoMapper generate graphical representations of a site’s structure. They are useful for quick audits or presentations, but their free versions often limit the number of pages they can crawl.
  • Reading the sitemap.xml file directly (available at /sitemap.xml or referenced in robots.txt) provides a raw list of indexable URLs. Comparing it with a crawl helps identify orphan pages (listed in the sitemap but inaccessible through the site’s navigation).

Young woman exploring a website sitemap on a tablet from her sofa in a cozy living room

DevTools: inspect the resources loaded by a page

The Network tab in DevTools (F12 in Chrome, Firefox or Edge) displays every file requested by the browser in real time. Filtering by type (document, script, image, XHR) helps isolate relevant requests. This method does not map an entire site, but it reveals resources that are invisible in the source code: remote fonts, third-party scripts and calls to internal APIs.

For a one-off audit, we prefer to compare this inspection with the XML sitemap. Differences between the two lists often point to inconsistencies: pages that have been deleted but are still in the sitemap, or, conversely, recent pages that have never been listed.

XML sitemap versus HTML sitemap: when to use each

An XML sitemap is for bots. An HTML sitemap is for people. The two can coexist without replacing one another, but their uses differ depending on the goal.

  • To manually browse a site’s sections, an HTML sitemap (or, failing that, a crawl exported as a site hierarchy) is the right format. It provides clickable links and a visual hierarchy, and requires no technical tools.
  • To diagnose indexing coverage, the XML sitemap, compared with data from Search Console or Bing Webmaster Tools, remains the go-to reference. It lets you check which URLs have been submitted, crawled and indexed.
  • To reconstruct the architecture of a competitor’s site or a site without documentation, an external crawler combined with a review of the robots.txt file and XML sitemap provides the most complete picture.

A well-structured site keeps both formats up to date. An outdated HTML sitemap confuses visitors just as much as a stale XML sitemap confuses Googlebot. Consistency between a site’s navigation, HTML sitemap and XML sitemap is a reliable indicator of how well the site is maintained.

The key takeaway: a sitemap, whether XML or HTML, is not an optional extra. It is a diagnostic tool for SEO professionals and a navigation shortcut for visitors. Ignoring either format leaves part of your audience (human or robotic) without a guide.

How to Easily Explore a Website’s Sections and Resources Using Its Sitemap