It is very ok to do it.
The index bots(crawlers) will not be confused about that in any manner because they only read the .XML files about the sitemap. So, just a recommendation if you're going to perform that action of having 2 sitemaps, create a no index tag in the sitemap.xml file for the site map page in order to not affect search engine searches unless you want that your site map appears in the searches engines.
You can have an .XML for all your links/sites, that's the purpose of the sitemap.xml file.
As you're talking about Google, I would recommend you to use Google Search Console to handle all the search results regarding your domain/site.