New answers tagged crawl-errors
Google webmasters will tell you the source of the error.... if this is simply pointing to a file in a directory, you may consider preventing anyone, including Google from browsing that folder and find such files, this can be done by creating a default php file in that folder: Step 1- create a file called: index.php step 2- add the following code to it: ...
I am going through something similar though my situation is slightly different. If all of your on-site links are correct and any sitemaps that you have are correct (and I would check them), then I would suspect that these are coming from links made by scraper spammer sites. Your one example is a bit odd though. The cat_url=custom-cms, unless something your ...
When you have a URL in the page without a nofollow, loaded directly, it is most likely that Google will follow it. In your case, when Google is following it, it is being served with a page by your script, so it is not entirely Google's fault. You have really two options here: Add a canonical link. You mentioned that you have already done that. Add a ...
Finally found the error. The problem was in the canonical link: I had: <link href="http:www.somedomain.com/whateveryouwant.php" rel="canonical"/> It should be <link href="http://www.somedomain.com/whateveryouwant.php" rel="canonical"/> The "//" were missing. The Seo-Spider recommended by @closetnoc did help me to find the problem.
The link you refer to in your example is not absolute, because it does not contain the http://www.mysite.com/ part. However, there is nothing wrong in using relative paths in your link (i.e, starting with '/'). This is authorized and ok. It is not an issue. Browse your page and check the page source for the duplication you are reporting. If you see, then ...
Your sitemap example looks to be correct. I would make sure that your whole sitemap is correct before taking any further steps. Otherwise, it has to be something on your website. But there is not enough information here to determine what exactly is going on. Check your header and footer includes if the pages listed in Google Webmaster Tools appear to be ...
If you are getting crawl errors, then yes it is affecting crawling. I'm guessing how you have your page files and your include files organized on your server is incorrect. Do you have your header.html in a separate directory than the whateveryouwant.php file?
I once had the same problem, which I solved by adding the following lines to my .htaccess file: php_flag display_startup_errors off php_flag display_errors off php_flag html_errors off Also check that your php.ini is fine.
Top 50 recent answers are included