Skip to main content
Improved
Source Link
TopQnA
  • 3.2k
  • 8
  • 9

You can ask Google not to crawl in couple ways:

Method 1: Using robots.txt file. Create a robots.txt with code below and place in your dev server root folder.

User-agent: *

Disallow: /

Method 2:

The second method, just restrict the access using username and password. If you are using cPanel hosting, you can easily do this, and same in other hosting too. Meaning when you will fetch your dev server it should ask you to login.

You can ask Google not to crawl in couple ways:

Method 1: Using robots.txt file. Create a robots.txt with code below and place in your dev server root folder.

User-agent: *

Disallow: /

Method 2:

The second method, just restrict the access using username and password. If you are using cPanel hosting you can easily do this, and same in other hosting too. Meaning when you will fetch your dev server it should ask you to login.

You can ask Google not to crawl in couple ways:

Method 1: Using robots.txt file. Create a robots.txt with code below and place in your dev server root folder.

User-agent: *

Disallow: /

Method 2:

The second method, just restrict the access using username and password. If you are using cPanel hosting, you can easily do this, and same in other hosting too. Meaning when you will fetch your dev server it should ask you to login.

Source Link
TopQnA
  • 3.2k
  • 8
  • 9

You can ask Google not to crawl in couple ways:

Method 1: Using robots.txt file. Create a robots.txt with code below and place in your dev server root folder.

User-agent: *

Disallow: /

Method 2:

The second method, just restrict the access using username and password. If you are using cPanel hosting you can easily do this, and same in other hosting too. Meaning when you will fetch your dev server it should ask you to login.