go-sitemap-parser

go-sitemap-parser is an open-source Go library for parsing sitemaps from any starting point. Its Parse() function accepts a robots.txt URL, a sitemap index URL, or a plain sitemap URL and resolves the rest.

Key Features:

• Flexible Entry - Starts from robots.txt, a sitemap index, or a single sitemap URL.
• Recursive Parsing - Walks sitemap index to child sitemaps to URLs.
• Concurrency Controls - Configurable max depth and max concurrency for fetching and parsing.
• Tolerant Or Strict - Offers both lenient and strict parsing modes.
• Format Coverage - Supports robots.txt, XML, RSS 2.0, Atom 1.0, plain text, and gzip files.

Choose go-sitemap-parser when a Go service needs concurrent, recursive sitemap parsing from a domain or a single URL.