Solved: Pages were being blocked by meta robots deliberately
A lot of pages are being blocked in the robots.txt file and when I checked the file there were no indications of a rule that blocks these.
The robots.txt file is structured:
Sitemap: https://domain.com/sitemap.xml User-agent: * Disallow: /directory-1/ Disallow: /directory-2/ Disallow: /directory-3/ Disallow: /directory-4/ Disallow: /directory-5/ User-agent: Googlebot-Image Disallow:
None of the directories in the robots file match the URLs that are being blocked.
I was wondering if the incomplete
Disallow could be the issue, despite it being only applicable to Googlebot-Image?