I have created a community driven news aggregator like Hacker News. Each news link has a comments page. Hundreds of links are added each day. I tried to create an XML sitemap for Google Search Console using an online generator. It is listing all the links (including the comments page for each link) into the XML sitemap. The main links of the site are
home - example.com/?page=home users- example.com/?page=users blog - example.com/?page=blog
The contents of the home page can be filtered and corresponding links are displayed using URL parameters.
example.com/?page=home&type=1 will show the video links submitted to the site example.com/?page=home&type=2 will show the blog links submitted to the site like the type there is one other filters - topic example.com/?page=home&topic=1 will display all the technology related news example.com/?page=home&topic=2 will display all the business related news
these filters can also be used together
example.com/?page=home&topic=1&type=1 will display all video links to technology
comment page for each news is dynamically generated when comment link on an news link is clicked.
Which will open a comment page for news with the id 144.
The problem I am having is that online generator is going to all the comment pages and including this in the sitemap. This will be thousands of comment pages.
I have decided to manually create the sitemap.
Blog pages can be navigated in the same way.
The users page displays the users info and links to the profile The profile is also a dynamic page like comments and does not exist till a userid is specified
All the users profiles are also being listed by the sitemap generator.
What all links should be included in the XML sitemap?
What should be included and what should be left out?