New answers tagged indexing
1
Google scans your source code for items that look like URLs and will try to crawl them and index them, even if they are not in an <a href.
Based on the crawling that Googlebot has done on my site, Google seems to think that strings in the page source are URLs if:
They end in a common page extension such as "html", "htm", or "php".
They contain a slash ...
0
If the page redirects using a standard 301 then it would take sometime for Google to drop the page and amend the new one. New pages and changes to existing pages via redirects take time as said and this can take anywhere from 1 week to a couple of months if the page is regularly visited. You do not have control over the Facebook.com domain so there is ...
0
search engines don't execute Javascript
This isn't strictly true anymore - they do execute some javascript, sometimes.
Where will the users be directed from search in this case?
They will be directed to the page with the content relevant to their search - i.e. the external page, in this case.
Will it be bad for SEO if I show only product names ...
0
Try changing your DNS to Googles DNS and see if that works.
Aside from that I don't think this a problem on your end what so ever.
Google DNS:
8.8.8.8
8.8.4.4
0
Google searches and indexes multiple languages. There are tons of question on this site about how to organize based on languages (paths, sub-domains, auto-detection, TLDs, etc).
However, it does not search automatically for translated keywords as you suggest. The assumption is that if someone is searching in a language, they will most likely want a page of ...
0
Yes, Google and other search engine spiders will crawl multiple languages. You will want to use unique URLs for each language, however. Usually that's done by including the language code in the URL as a folder or subdomain.
Google also has some advice for providing "alternate" languages of the same page here
0
As you already aware of google sitemap guidelines, i won't dig more into it. Based on my experience, i don't think you can keep other domain's sitemap at your main domain.
I am completely agree with your above comment. it is not necessary to have sitemap file for improving search engine rankings. It just help search engine crawlers to find pages on your ...
1
It is more or less the same as writing:
<meta name="robots" content="index, follow">
Interestingly, the "all" variant is not actually suggested by Google as an alternative, but it works* nonetheless.
Either command (when placed in the <head> section of your HTML code) tells search engines to index the page the tag is on, as well as crawl ...
0
Using htaccess and php header redirect is best ways for your website, also better for Search engine optimization.
0
If you are wanting to get your images indexed for the appropriate keywords, that would often be included in the filename of the image, then referencing a php file without these keywords is not going to benefit SEO. Google doesn't only get keywords from the image filename, but it is a big clue, and it is helpful to users.
I can see that a RewriteRule ...
1
OK, I've finally found a plausible explanation, why Google has indexed folders and files outside of the document root:
The website I've launched last week is a second version of a project. The first version was Joomla! based and its dosument root was to the project root:
/var/www/.../mywebsite.tld
The second version bases on Zend Framework 2 and ...
2
In order to block all robots in your website, the correct code is:
User-agent: *
Disallow: /
Don't forget the / (slash) after Disallow:.
To block only subdirectories and their internal webpages with robots.txt, you have to list them one by one. Thus you need to know their names:
User-agent: *
Disallow: /vendor/
Disallow: /module/
...
To understand how ...
Top 50 recent answers are included
