Return to Answer

replaced http://webmasters.stackexchange.com/ with https://webmasters.stackexchange.com/

Source Link

edited Apr 13, 2017 at 12:33

Since the default for URLs is 'index' (for Google, at least), why leave a blank line in robots.txt with regards to Disallow:?

I'd omit it before I'd specify it.

Since the default for URLs is 'index' (for Google, at least), why leave a blank line in robots.txt with regards to Disallow:?

I'd omit it before I'd specify it.

Since the default for URLs is 'index' (for Google, at least), why leave a blank line in robots.txt with regards to Disallow:?

I'd omit it before I'd specify it.

Source Link

created Feb 13, 2017 at 8:50

Since the default for URLs is 'index' (for Google, at least), why leave a blank line in robots.txt with regards to Disallow:?

I'd omit it before I'd specify it.