Hot answers tagged

25

Google will automatically remove pages that now return a 404 status. They will get removed 24 hours after Googlebot next tries to crawl them. If you want to speed up the process slightly, return "410 Gone" status for those URLs instead. Then they will be removed without the day grace period after they are next crawled. The only problem is that it ...


17

Google's Matt Cutts has addressed this via video: It’s a fair question. I think we can handle it either way, so we should be able to process it. But if we see a lot of pages or a lot of things ranking on a site all of a sudden, then we might take a look at it from the manual webspam team. So if it doesn’t make any difference whatsoever to you in terms of ...


14

In the root of the directory of the subdomain website, add a file called robots.txt containing: User-agent: * Disallow: / This will tell web crawlers not to index the site at all. They do not have to obey, but the main ones will.


11

Ironically the answer is on this page and every other Stack Exchange site :) You have to define an OpenSearchDescription for your site. If you look at the source code of this page you will see in the header: <link rel="search" type="application/opensearchdescription+xml" title="Pro Webmasters - Stack Exchange" href="/opensearch.xml"> And if you ...


8

I contacted John Mueller at Google about this issue. He had his team take a look at it and got back to me with the answer. The word "behance" is coming from an SVG image on your page. The image is https://onceuponafoodblog.com/wp-content/plugins/simple-social-icons/symbol-defs.svg and it has a number of <title> elements in its source code, the ...


7

For purposes of this answer I'm assuming you are talking about Google Custom Search/Site Search and not the Google Search Appliance which would be a VERY good idea, albeit an expensive one. Outsourcing your search to Google Custom Search is not a bad idea but it may not be the best fit for your site/business model/whatever due to Google's limitations ...


7

It will take time and enough incoming links with gethis as the anchor text to get Google to assume people want gethis instead of a mistype on the phrase get his. Google is making the assumption that users want get his when that phrase is typed and 99.9999% of the time it is correct. In simple terms your site will have to gain popularity before it is ...


6

This is deliberate. To quote from this post on the Official Google Webmaster Central blog: "Starting in April, for browsers with the appropriate support, we will be using the "referrer" meta tag to automatically simplify the referring URL that is sent by the browser when visiting a page linked from an organic search result. This results in a ...


6

Using a robots.txt file in your subdomain will help (and Google will obey this), but another step you can take is to specify with a Google Webmasters account that you don't want this subdomain to be indexed. You can also use a meta tag on all pages in the subdomain: <meta name="robots" content="noindex"> If this happens to be a site that you are ...


5

You shouldn't simple add an extra page simply for an additional index, Google cares about quality not just quantity, so if the page offers nothing special and useful for your visitors then you should remove the page, however if the page is helpful then keep it. You should put your visitors first and the search engines last, with this logic its hard to fail.


5

While it may be seen as a different question the answer has largely been dealbt with here Google thinks my domain doesn't exist or is misspelled when users search for it The fastest way to correct this is to make your site the authoritative for your company name. The sooner your site is seen by Google to be the destination for your (misspelled word) ...


5

There are no TLDs that Google finds preferential to others; they are all treated equally in rankings. There are some geo-specific TLDs that Google will default to a specific country and use that as an indicator that the website is more important in a specific geographic region. But all TLDs are treated equally. Google's systems treat new gTLDs like other ...


5

Of course it should be possible to use any kind of URL design. It wouldn’t make sense for Google to exclude many sites just because they don’t use the URL’s query component for the search function. Did you check Google’s documentation? For the target property it says: "This must be a URL that points to an address on the same domain as the content being ...


5

That happens automatically. Google extracts what it thinks are key bits of information from the page, without needing any special markup or configuration on the site owner's part. It's likely an evolution of the list and table snippets which started appearing around 2011.


4

Search engine robots don't perform searches on your site directly (i.e., using search forms). In order for them to crawl and index search results, the search parameters would have to be contained within URLs, like: example.com/search/index.php?keywords=fruits example.com/search/index.php?keywords=apple example.com/search/index.php?keywords=banana Then ...


4

Sure there are concerns in dumping huge numbers of pages onto your site and whether it would be considered spam or not or have a negative SEO effect. I just want to give my perspective since I feel you are within a safe range of pages and likely have fair domain trust due to domain age and stability. My experience is this. My site can add over 3000 pages ...


4

After some investigation it turns out that this is a problem with Google Maps. The red pin pointer is inserting some text on the page which is getting pulled into search results so it's not really something that can be fixed until Google look into it. Oh well.


4

Yes. Although Google can submit some forms they generally do not do so. So any content that is only available via a form submission should be assumed to be hidden from search engines. Yes. This is functionally the same as an HTML sitemap. You can also submit an XML sitemap (although they don't guarantee crawling).


4

A site needs to exist for a while and get popular before Google will recommend it for its brand name and URL. The good news is that Google is indexing your site and will show it in search results in "verbatim" mode: This indicates that Google knows about the website and will show it if you say "I really mean what I'm searching for, don't show me synonyms ...


4

Google and other major search engines are pretty good at learning and returning brandings that are purposely mispelt. Even my own site spelt BYBE Google used to returning results for 'BABY' and 'BABE' for almost a year, other good examples: Flickr Reddit Digg Tumblr Mashbord Fiverr All purposely misspelt; Google will associate the correct and incorrect ...


4

Using the inurl operator for Google should do the trick. Assuming your PDF files all have the .pdf extension, adding -inurl:pdf to your search will exclude those URLs. https://www.google.com/search?safe=off&q=site:example.com%2Fsubfolder%2F+-inurl%3Apdf


4

You have an error in your robots.txt file. On line 11 you have Allow: /, a robots.txt file doesn't say what files and directories you can allow, only what you can disallow. The only supported commands for the robots.txt file are "User-agent" and "Disallow". As the Disallow: /random command is after the invalid command it is possible the Google Searchbot ...


4

Google will occasionally rewrite titles and descriptions to give people a more varied search result. It is true that the video you mention does not mention 'domain' in the title or the description within the source. However, YouTube as you know brings up similar videos in the sidebar, these may be very relevant, or slightly relevant. Google can rewrite ...


4

You can use CSE. It is a platform provided by Google that allows web developers to feature specialized information in web searches, refine and categorize queries and create customized search engines, based on Google Search.


4

Adding or removing a property from Search Console has no effect on ranking, besides some minor edge cases (e.g. if you had set custom crawl settings or URL parameters). So any ranking drop you've seen is almost certainly a coincidence. For the majority of data you see in GSC, Google collects that data whether or not there is an associated webmaster account. ...


4

It can be that Google "found" the URL in a different way other than looking at the sitemap (following a link, for example). Google uses many different strategies to find and crawl content, the important thing is that the URL was found but you should still check that the exact URL submitted is the correct one (to make sure there are no canonical issues).


3

Google doesn't want to index search results. Matt Cutts said so: http://www.mattcutts.com/blog/search-results-in-search-results/ Google now penalizes sites that try that. Google considers search pages to be very low quality landing pages. Why should a user click off a page of search results, only to land on another? If you think you can target these ...


3

As JCL1178 mentioned in their answer, Google will only return results for what it has indexed. Not only does this mean that some of your results may never appear, but if your site is ever de-indexed for some reason, you've lost the search from your web site. Having something as important as search rely on an unsupported 3rd party service is dangerous. Since ...


3

Google does not necessarily use the meta description in the SERPs. It uses whatever text it thinks is appropriate, which may or may not include (part of) the meta description. (Google updated its cache of your homepage less than two weeks ago on 28 Dec 2012.) EDIT (2013-01-15): Interesting to note that I see today your updated title and description are now ...


3

Googlebot would NOT be able to crawl such a website. Googlebot does not use cookies, so it would not maintain a session to be able to crawl. If the sessionid were in the url, Googlebot would still have trouble because it would get different sessionids each time it crawled the home page and you would have massive duplicate content problems. Furthermore, ...


Only top voted, non community-wiki answers of a minimum length are eligible