Search Results
| Search type | Search syntax |
|---|---|
| Tags | [tag] |
| Exact | "words here" |
| Author |
user:1234 user:me (yours) |
| Score |
score:3 (3+) score:0 (none) |
| Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
| Views | views:250 |
| Code | code:"if (foo != bar)" |
| Sections |
title:apples body:"apples oranges" |
| URL | url:"*.example.com" |
| Saves | in:saves |
| Status |
closed:yes duplicate:no migrated:no wiki:no |
| Types |
is:question is:answer |
| Exclude |
-[tag] -apples |
| For more details on advanced search visit our help page | |
Results tagged with robots.txt
Search options not deleted
user 57526
Robots.txt is text file used by Website owners to give instructions about their site to web robots. Basically it tells robots which parts of the site are open and which parts are closed. This is called The Robots Exclusion Protocol.
0
votes
0
answers
12
views
How to make sub-directories appear in Google Search Engine? [duplicate]
I tried typing robots.txt in the root directory of website:
User-agent: *
Allow: /products/
But doesn't seem to work. Or maybe it takes a while for the search engine to pick it up. … I put this robots.txt file in the same directory:
User-agent: *
Dis-allow: /helloworld.html
and added <meta name="robots" content="noindex">, but I don't know if I am on the right track or if it's effective …
- 101