I moved a site from WordPress to Magento. But now Google webmaster does not index the site. I have submitted the sitemap, but it remains pending. I also have a
robots.txt file which has the following content
User-agent: * Allow: / sitemap: http://www.example.com/sitemap.xml
Is there anything I have to do after moving from WordPress to Magento?
I feel the problem is with robots.txt because in my crawl errors page in google search console, robots.txt fetch shows an orange status instead of a green tick. Under that tab, it shows a message 'Google couldn't crawl your site because we were unable to access your site's robots.txt file'. But when I go to mydomain.com/robots.txt, it displays my robots.txt file.
,I have tried Fetch as google in search console. It fetches completely when I use 'fetch' and partially when I use 'fetch and render'.