New answers tagged

0

GET requests could be seen as unique url. So any bot can access get data more quickly as unique url and judge contents. You can also cross verify all GET ajax calls againsts request url and desired format.


3

Googlebot only performs POST requests under very limited circumstances where it is believed by the Googlebot that it is safe and appropriate. Google takes precautions to avoid performing tasks on a site that could result in executing an unintended user action and Google making POST requests is for crawling purposes only to index what the end user would see. ...


0

Based on your comments I am making the assumption that you will be defining a catch all dns record for your domain, eg: *.example.com IN A 1.1.1.1 so that all sub domains of example.com that are not specifically mentioned will be routed to the web server. In this instance this would be handled by your server code. All you would do is detect the domain name, ...


0

A redirect is by definition a 302 header code which will result in a new request. 404 error pages should never redirect anywhere as they are an end of the line code. In addition if you where to do this and redirect the user to the homepage with a 404 error that would cause all sorts of issues later on down the track as search engines would treat your ...


1

404 errors occur all the time and there is no need to be concerned. The only time that you really need to do anything is if the 404 error is for a page that is meant to be there in which case you need to find where it went, but for random pages like that which have never existed there is no need to worry you can safely ignore it, it won't affect your server ...


1

Based on your edit there is no cause for concern. 404 errors are very common in the search console simply due to the fact that someone somewhere has linked to that page. It could also be the Googlebot having a glitch trying to append index.html to the end of the URL. This is also a common issue due to many URL rewriting configurations leaving out the file ...


0

The first thing you need to understand is that if the blog post doesn't exist at all then when Googlebot tries to access it you will receive a 404 error in the search console. In addition even if you remove the page from the search console and from your sitemap.xml file if there are links to those old pages anywhere else on the internet and Google comes ...


0

There are a range of plugins you can add to your WordPress installation which will trigger a 404 error instead of redirecting to the homepage when a page could not be found. I am not going to recommend one as ProWebmasters is not designed for recommending software or plugins but what I will do is give you this link http://www.lmgtfy.com/?q=wordpress+hard+404+...


2

The file which is being requested is a json file used by some websites to map certain sections of the site and certain pages to a native app so that going into those sections or pages will automatically open the native app and use the app instead of the browser for iOS devices. It appears as though Google is trying to see if you have this file on your site ...


1

My collegue figured it out. As stated here: http://www.lunametrics.com/blog/2015/09/04/google-analytics-default-page/, it was because we had set the google analytics Default page to index.php in the View Settings of that website. In our case, we shouldn't have done that since we do not use /index.php in the subdirectories. So, please be aware that if you ...


4

If you never intended to have such urls in your site and they truly mean nothing for you, then it's better to keep serving them as a 404 - a page that is not found - not existing in the site. Use redirects if you used to have a page with important content, indexed and present in SERPs, that brings a lot of traffic to your site. In the 404 section of ...



Top 50 recent answers are included