We used https://www.xml-sitemaps.com/ to crawl our website to create a sitemap but for some reason, only a page can be found, but we have more than just a page. And this is our site (https://www.wgvs.com/). I assume there is something to prevent other robots to crawl our site.

up vote 2 down vote accepted

Your website is dynamically loaded using JavaScript. That means that most bots/tools will not be able to crawl your site.

The solutions to this are to either use server-side prerendering or change the architecture of your site so that it is no longer an SPA.

  • that also includes Google's bot? – Long Nguyen Dec 4 at 20:24
  • 1
    @LongNguyen Google's bot is an exception and it should be able to crawl it. Just make sure that your site renders properly by testing it in Google Search Console. – Maximillian Laumeister Dec 4 at 20:30
  • In our case, do you what is the best way to generate the xml sitemap? Thanks – Long Nguyen Dec 4 at 20:38
  • @LongNguyen It depends on what server-side framework (or integrated hosting service) you are using for your website. Each framework usually has its own process for generating a sitemap. If your server-side is totally static, you will need to run a deploy-time script or add some server-side code to generate the sitemap ahead-of-time or dynamically, respectively. – Maximillian Laumeister Dec 4 at 20:41

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.