Tag Info

New answers tagged

1

You have done your research and seem to have a good handle on the situation. To sum up: Using robots.txt would prevent search engines from crawling the PDF files. If third party sites linked directly to the PDF files, then search engines might include the URLs in the search index (but would still not be able to index their contents.) Using X-Robots-Tag ...


1

Simple answer, only slightly difficult solution- robots.txt. It is the fastest and most effective way of removing a page from the index. You can also noindex the page, but that depends upon having Google revisit the page. The robots.txt is much much quicker though nothing is real-time. Google will revisit the robots.txt after 24 hours has expired in ...


9

There are at least 3 ways: Links to your site. Using Google Webmaster Tools (now called Search Console) Registrar dumps, triggers, and other options. Google will find many new sites quickly from some registrars. For example, Google found one domain name I registered using GoDaddy, indexed it, and began sending search results within 20 minutes of ...


10

That's a very bad idea and your site will suffer in the organic search rankings. For one, Google does have image recognition abilities and so your assumption that the bot can't "view" the image is wrong. And two, the algorithm does render pages to decide whether they are not mobile friendly and if your pages are delivering different content to users and to ...


2

According to this we are still waiting to see what Bing will do, so I would assume (I know) not. Here is an excerpt regarding Bing: What Can We Expect? Google’s disregard for JavaScript in the past has also been used by many websites to their advantage. It will be important to understand the repercussions of Google being able to index all of ...


0

What you can try is to go to Google Webmaster Tools, then select the website then the gear icon then site settings and select that you'll define the crawl rate (instead of letting google choose it). Next, use the slider to change the crawl rate to the maximum. Depending on how popular your site is, the maximum could range from google making 2 to over 10 ...


0

Search engines are notoriously slow. The reason for this is simple. The internet is so vast that it is impossible for any search engine to highly responsive. I am sure some of your pages will show-up correctly while others will take longer. Just make sure you did all your work correctly and either 404 the old URL or 301 redirect them to the new path. Your ...


2

Google does not visit your website only once. They do it on regular basis. So after a while it should fix itself. But it takes time. To be on a safer side, update your website and add the URL for recrawling. How to request a recrawl: https://support.google.com/webmasters/answer/6065812?hl=en. Submitting the webpage to Google's index: ...


1

The fragment identifier (ie. everything after the #) is not sent to the server, so unless you are using JavaScript/AJAX then your server won't be able to process these as URL parameters. (?) So, using a hash (#) would not seem to be a solution in your case as it simply won't work - unless I'm missing something? What's wrong with using a rel="canonical" ...


2

What happens if your configuration will be detected by a search engine: Mixing canonical links and noindex will mostly lead to search engines ignoring your canonicals. This may lead to duplicate content issues if you also have canonicalized dynamic URLs or alike. Without the canonicals being respected properly the search engines will decide which url is ...


0

Sometimes a couple of hours, sometimes a couple of days, in rare cases a one or two weeks. Can't really give you a better answer really. It depends on your rank (how important are you to users (according to them)?), the amount of visitors, the amount of fresh content, the relevance of the page itself, dumb luck (e.g.: It's your turn again). It also depends ...


0

Don't do this. This will create a bad ranking page, with duplicates (the next/prev pages) and will cost your more than you will gain. Rule of thumb: Don't make pages just for bots. To prefent indexing you could just add the robots metatag with the value NOINDEX. What you need is a sitemap xml :) Those are perfect fort situations like this; To indicate pages ...


0

If you have an XML sitemap, you can specify a lastmod tag like below and it gives a hint to the search engine crawler when the page has last been updated: <url> <loc>http://www.example.com/</loc> <lastmod>2005-01-01</lastmod> <changefreq>monthly</changefreq> <priority>0.8</priority> ...


0

First of all you will need to prepare a sitemap. Sitemap is nothing just a map of your site which will list each page of your website. It tells search engines that about your new pages. Then you have to tell submit these sitemap to Google Webmaster Tools.



Top 50 recent answers are included