The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
0answers
6 views

I get 404 error in google webmaster from unknown php page

In my wallpaper website that i code myself in php.There i get 404 error in google crawling.These errors are from unknow page like ...
1
vote
0answers
31 views

Google crawling pages with “/mydomain.com” after the page url [duplicate]

Google is crawling and indexing my site without any issues. Each post I create I'm fetching in webmaster tools. I have looked in the crawl errors and for every post I submit for indexing Google is ...
1
vote
0answers
17 views

How to fix “Soft 404" in GWT even though the page is ok

Why does Google Search Console report that this page is a soft 404, even though it's OK? https://www.tsikot.com/forums/showthread.php/72558-Mitsubishi-Pajero-Fieldmaster-(Gen-2.5)-continued/page55
2
votes
2answers
27 views

Google crawler accessing non existing pages

I am looking Search Console and found Crawl errors for following URLs on my site: example.com/mobile example.com/m I never mentioned these pages anywhere but why Google is accessing it and what ...
1
vote
3answers
4k views

How to fix robots.txt file error in my GWT?

In my blog’s Webmaster Tools, there is a notification in Crawl Errors section, that is Google couldn't crawl your site because we were unable to access the robots.txt file. My blog’s robots.txt file ...
3
votes
2answers
67 views

Increase in 5XX errors and 404 errors on GWT, are we under attack?

A lot of URLs are suddenly giving us 404s and 500s. On closer inspection, these URLs do not exist on our website and are being linked from random sources. As more URLs were inspected on GWT, a ...
2
votes
2answers
1k views

Google webmaster Tool showing : 170 not found 404 errors!

I have a website which is 2 years old and it is simple PHP pages. I had set up Google Analytics and Google Webmaster Tools for it. Just last week I removed that PHP website and installed a new ...
4
votes
1answer
62 views

How to tell Googlebot to crawl just URLs ending in .html

I have a big problem in Google Webmaster Tools. The number of 404 pages in the error report increases so fast that now I have over 1000. When I check for errors, I see that for every page Googlebot ...
8
votes
6answers
13k views

Massive 404 attack with non existent URLs. How to prevent this?

The problem is a whole load of 404 errors, as reported by Google Webmaster Tools, with pages and queries that have never been there. One of them is viewtopic.php, and I've also noticed a scary number ...
2
votes
1answer
186 views

How do I fix the crawl errors from Google Search Console where all my URLs end with htmlprint instead of html?

I moved from Blogger to Wordpress. I set my prefered domain to non-www in webmaster tools. I submitted a sitemap. My website is OK when I browse it. Links from other sites to my pages are well ...
3
votes
1answer
43 views

Fetch as Google says my page is “Temporary Unreachable”

When looking into it in WebmasterTools, I saw that there is a "Fetch as Google - Temporarily Unreachable Issue". It is for an image, and font. How do I resolve this issue?
0
votes
0answers
20 views

Google webmaster crawling pages that are not in my domain why? [duplicate]

Webmaster tools showing crawl errors (404). 1.From those crawl errors many of the not found urls are not in my domain eg. Best-online-bingo-usa-bzvg/ (this is not my domain or page) and they even ...
0
votes
0answers
35 views

Indexed URL is very low comparing submitted URL in google

I have 84 URL in my website. Till 2 weeks back all the URL is indexed in Google. I have verified it in Google webmaster tools. But it was slightly decreased day by day. Now Google webmaster tools ...
0
votes
2answers
20 views

magento local store deactivated, still getting GET requests from web crawlers

Many months ago I deactivated one store (localised to a language) within a Magento site, leaving the english store the only store live. Looking in my Apache access logs, and also summarised in ...
3
votes
1answer
259 views

Resetting sitemap warnings in Webmaster Tools

Back in the day when I was updating my website and had errors, Google Webmaster Tools took note of it and gave my sitemap files warnings. Now I decided to start over new again by uploading brand new ...
2
votes
2answers
746 views

Google Webmaster Tools reporting non-existent links

GWT is reporting 404 crawl errors on pages that have never been part of the website. For example, it's reporting crawl errors on several non-existent pages such as ...
0
votes
0answers
103 views

Google Bot Crawler Issue with Codeigniter URLS

I received 6000+ crawler errors in my webmaster tools account. following is the one of the URL that identified as problematic URL. ...
0
votes
1answer
131 views

404 crawl errors in google webmaster tools - odd url's that don't belong to us

If anyone can help, I'd be very grateful! We're getting strange domains coming up in Google webmaster tools. When I look where the links are coming from, it's either: non-existent pages on our ...
1
vote
1answer
205 views

Google Webmaster Tools reported crawl errors due to DNS, server connectivity, and robots.txt unavailable

I am experiencing the following site errors on Google Webmaster Tools. DNS: couldn’t communicate with the DNS server. Server connectivity: request timed out or site is blocking Google. Robots.txt ...
0
votes
2answers
82 views

Soft 404 for smartphones

We have redirected all non-existing pages to home page. It was fine for some days. Few days back i saw increase in the number of soft 404 errors for desktop. And the errors were the page urls that ...
1
vote
1answer
115 views

Can't find 404's that are listed

I've been asked to look at the "Not Found" tab in Google Webmaster Tools, to try and eliminate as many of the thousands of 404's not listed. There are several reasons for these, but this post will ...
3
votes
2answers
81 views

How to set crawl rate in Google Webmaster Tools for seven days or a month?

My web host is blocking IPs which make many requests. This includes Googlebot. I found this by checking my webmaster tools account. There it said "network unreachable" for all the URLs which are ...
2
votes
2answers
176 views

Will setting a custom crawl rate in Google Webmaster Tools affects index or have other negative consequences?

My site was running well for the past three years. Recently Googlebot's request my server got increased. and at one time I got network unreachable error. When I contacted my hosting company they asked ...
1
vote
0answers
92 views

I still get “Googlebot can't access your site” messages after removing a site from Google Webmaster Tools

I had a client who moved their site a while back to another developer. When they moved it they took down the site and put up a coming soon page ( which is currently what's there). Googlebot warned me ...
1
vote
2answers
450 views

Crawler errors for unused URLs containing “mozekcdn-a.akamaihd.net”

In the AdSense dashboard, Google is reporting crawl errors for unexpected URLs. It shows that Google crawler was unable to access some of my 87 pages. When I checked those pages I found that I haven't ...
1
vote
0answers
63 views

Bing is not crawling and indexing my mobile subdomain

BACKGROUND I have a mobile site located at a sub-domain of m.hydro-cleansing.com. The site is working fine and can be accessed. I am using a search API provided by Bing that should perform a site ...
1
vote
1answer
195 views

How to fix Adsense error: “Our crawler was unable to access the pages” when those pages had been removed and are 404 not found?

I have a website and we recently changed content management systems. With the new system came new URLs/hierarchy. Google Webmaster Tools doesn't have any issues with the site and I get no crawler ...
2
votes
2answers
560 views

Google Webmaster Tools “increase in not found errors” is wrong

I got a ton of not found errors in Google Webmaster Tools, but the weird thing is, all of the pages ARE found. There is absolutely no error in the URLs they list that supposedly don't exist. Why is ...
1
vote
3answers
1k views

“High response time” warnings in Google Webmaster Tools

In my Google Webmaster Tools account, there are warnings about my site. Some URLs listed in this sitemap have a high response time. This may indicate a problem with your server or with the content ...
2
votes
1answer
424 views

Website not fetched by Bingbot: Unexpected Error

My website has been online for a couple years. It's on the first result for Google but it doesn't seem to be indexed by Bing. I tried to fetch it with bing in their webmaster tools and it always ...
2
votes
1answer
670 views

How to Keep “Good” Bots That Ignore Robots & Nofollow From Getting Into Honeypots?

We have a self generating honeypot that is designed to fill crawlers with junk data (among other things). Its protected with the right "treaties" and headers so 99% of good bots stay away. Today ...
1
vote
3answers
5k views

Google Webmaster Tools - Crawl errors with 500 status code

I will try to explain the situation: In December 2012 I deployed a website with a sitemap.xml, etc... there were circa 2000 URLs. After a while I changed something on my website, upgrading my pages ...
1
vote
2answers
81 views

What to do about crawler errors after removing non-essential parts of my website?

So, recently I was re-building my website, putting on another CMS, optimizing and so on. Now I visited Google Webmaster tools and it tells I have a lot of Web crawler 404 not found errors. I am ...
0
votes
2answers
293 views

Google Webmaster Tools crawl errors due to Google decoding links that were urlencoded by Codeigniter

In our pages we have internal links that are urlencoded because the URL may sometime contain special characters such as () or ! So in our source code we have a link: ...
0
votes
1answer
27 views

Comment Out Link Shows in Webmaster

I had "Privacy Policy" link on my old website. When I launched my new website, I put the link in footer but disallowed that to robots.txt by adding this code: <?php /*?><div ...
0
votes
1answer
81 views

Reset Connection causing multiple errors after hack

We use webmaster tools to monitor our websites, and in the past couple of months some of our sites have been compromised and had various pages inserted. These pages created URLs that Google would ...
1
vote
1answer
81 views

Crawl errors appearing in Google Webmaster Tools with suspicious URLs cached

I am receiving Crawl Errors in my Google Webmaster Tools reports with some unique URLs that I am not understanding. For Example: http://www.example.com/portfolio/?cat_url=custom-cms This page ...
1
vote
1answer
43 views

How to avoid google from indexing like example.com/post/post/post/1-foobar.html?

I have a weird anomaly with one project. Where Google is indexing sites like: example.com/post/post/post/1-foobar.html While it should do it like: example.com/post/1-foobar.html I just ...
0
votes
4answers
119 views

Crawl errors and duplicate URL

I am getting lots of crawl errors, Google is adding main domain to the URL: sitemapxml: ...
0
votes
2answers
202 views

Google Webmaster Tools crawl error with 'function.session-start' URLs

I've got following error URLs from the Google Webmaster Tools crawl errors. http://www.mydomain.com/mydomain/shirts/function.session-start I've checked the those pages that links from but I didn't ...
1
vote
1answer
598 views

Google WebMaster Tools Reports a Significant Increase in 500 Response Code Errors

Google's Webmaster tools shows lots of Crawl Errors. They are reported as 500 response code. How can I go about diagnosing this issue? The website is eCommerce business using the Magento ...
1
vote
1answer
50 views

Trendmicro clones authenticated requests - showing up in my error logs

I'm having various errors, from unauthenticated requests for using some AJAX requests (which need authentication). While I have clients from Belgium, the IP addresses match a IP in the form of ...
2
votes
1answer
124 views

The previous owner of my domain hosted pirated content, what is the best course of action?

Judging by my error logs, the Google craler errors, and the massive amount of DCMA takedown notices I get it has become apparent that the previous owner of my domain name (ianspence.com) used to host ...
0
votes
2answers
315 views

Redirect pages to fix crawl errors

Google is giving me a crawl error for pages that I have removed like www.mysite.com/mypage.html. I want to redirect this pages to the new page www.mysite.com/mysite/mypage. I tried to do that by ...
2
votes
3answers
6k views

How to resolve “Google can't find your site's robots.txt” error?

I've recently found that "Google can't find your site's robots.txt" in crawl errors. When I tried Fetching as Google, I got result "SUCCESS", then I tried looking at crawl errors and it still shows ...
0
votes
1answer
81 views

What is the difference between not found and not followed in Google Webmaster Tools?

In Google Webmaster Tools under Crawl Errors I found 18 Not Found and 16 Not Followed errors. What does this mean, and what is the difference between them?
2
votes
2answers
359 views

Googlebot requesting invalid URL

I have a web app which emails me exceptions automatically. This morning there was an error relating to a url: /Catalog/LiveCatalog?id=ylwpfqzts id is invalid (should be a guid) and caused an error ...
1
vote
1answer
110 views

Has Microsoft introduced a bug in Bingbot such that it crawls non-existent images?

I've started receiving requests for paths such as /scale/jackets/00000086/80x80_P2_G1715325W.JPG several times a day from the Bingbot. This started a couple of days ago. Anybody know why this is?
1
vote
2answers
171 views

How do I diagnose 408 crawl errors?

Somebody sent me a message about my website: "I'm getting a 408 error when I try to crawl it." How do I resolve the 408 errors that are causing problems for this crawler?
1
vote
1answer
171 views

“Access denied” error in Google Webmaster tools

I have an access denied problem in my webmaster tools. It says 404 errors. How can I solve this? I have already fixed the errors, but they are not removed from Google Webmaster Tools.