I need to allow only specific pages at some site. Let's say:
/ /page1 /page2 ...
Now I don't get how to whitelist the root page at robots.txt
Disallow: / # block everything Allow: /page1 Allow: /page2 Allow: ? # how to allow the / ???
And I'm stuck here, because Allow: / will allow everything back
Is it even possible?