Questions tagged [crawl-errors]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
15 views

Remove large amounts of pages from Bing Index Explorer

I have a website that I took over in my business. We redid the whole website (which was previously a mix of ASP and HTML) and is now a WordPress site running on nginx. I submitted the sitemap to ...
2
votes
0answers
14 views

Disallow Image Loading to Reduce Number of “Other Error” in Crawled Page Resources?

We have a hotel search website. Many landing pages of our site load resources asynchrously (e.g. Ajax), but very often (about 25% of the time) when we click "View Crawled Page" in Google Search ...
0
votes
1answer
9 views

Google Search Console: issues detected “Top Errors” Server Error (5xx). BUG?

Just got this email from Google Search Console: This were the issues: But when I inspected those live URL's (using Google Search Console tool) they came back as "available to Google" and one of them ...
2
votes
1answer
26 views

Google Search Console Warning: “ Indexed, though blocked by robots.txt ” (BUG)

Two days ago I've got an email with a warning from Google Search Console, telling me that 3 URLs from my site where indexed, but were blocked by robots.txt. Since I first deployed my website, I haven'...
1
vote
0answers
9 views

When setting up a campaign, Facebook is crawling my website using an Iphone user agent

Whenever I'm I'm setting up a campaing on Facebook, I get two visits from Facebook's auto crawlers. The first one I can identify as a robot and serve the SSR (HTML) version to it. The user agent is: ...
2
votes
1answer
71 views

Why is Google making up pages to crawl on my site?

For some reason Google is listing a series of pages that do not exist on my website such as: https://www.my_domain.com/index.php/about_us.php It lists them as 'Duplicate, Google chose different ...
0
votes
0answers
18 views

bing doesn't index my site.why? [duplicate]

i have been indexed my site to bing webmaster ,i submitted urls manually for many times .everything is fine but i don't know why it doesn't appear in search anything form my site. These two picture ...
0
votes
0answers
22 views

URLs appearing in Google Search Console that don't exist in our site [duplicate]

I have a domain name like xyz.com with many other URLs, but we see in Google Search Console other types of URLs that do not exist in our site. For example: xyz.com/xyz?fb_xd_fragment/celebrity/adah-...
2
votes
1answer
29 views

Page cannot be reached in Google Rich snippet test

When i test my webpage in google rich test, it say page cannot be reached. My website is on shopify so i guess there should be no issue from server side. I need your help please... I cannot figure out ...
2
votes
2answers
46 views

Recover from an SEO report with lots of issues or start over with a site that hasn't yet been found by search engines?

I am hosting an unhealthy WP site from which I was only supposed to receive the theme. Instead it includes content that I foolishly corrected rather than restructuring the site for SEO and friendly UI....
2
votes
0answers
27 views

URL crawlable in old Google search console, but blocked in new

Google stopped crawling images for our site, when we moved images to cdn subdomain. Old search console states image is crawlable, but new one states it is blocked by robots.txt (for same link). our ...
1
vote
0answers
213 views

How to allow only admin-ajax.php to be crawled? [closed]

My robots.txt looks as follows: User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Google Webmaster Tool recently raised a warning saying: Indexed, though blocked by robots.txt I ...
2
votes
1answer
302 views

Google Search Console still reporting 5xx errors even when my server has been running flawlessly for 7 days

For the past few days, I see that I have the following index coverage issue: Last month I was working on my production server and during this time the production server threw some errors (this ...
2
votes
1answer
58 views

Getting usability issues in Google Search Console for the responses of API calls

Today I found an error that appeared in GSC recently. The URL of the affected page is not a page actually. That’s a example.com/api/v2/getcurrentuser API call that the JS is requesting to retrieve ...
0
votes
0answers
44 views

Googlebot crawl anomaly due to blocked resources by Zopim

I am using Zopim live chat to enable chat support in my website, but Googlebot is showing error due to some unreachable resources from zopim service. I have attached a screen capture of the error. ...
1
vote
1answer
89 views

Yoast purge plugin caused crawl errors, getting more even after removing it

I'm using the Yoast SEO plugin on my WordPress site, and when you upload media to WordPress media library, it makes a copy of the image or file and creates a file path (this is normal). However, all ...
1
vote
1answer
140 views

Google can't access my page due to robots.txt but the testing tool says it's OK

My robots.txt is the typical that allows all bots everywhere User-agent: * Disallow: / When I test it with Google tool everything is OK. But in Google Search Console I get an error that my site can'...
0
votes
1answer
134 views

Why are bots or servers crawling non- (NEVER) existent URLs and how can I stop this?

Through Google Analytics I started noticing hits in the dozens via a source page named as "free-seo-help.org" that redirects to http://seo2.agri-co-jsy.com/?site=http:// It does not go to my actual ...
1
vote
1answer
131 views

404 on google cached version pages [duplicate]

When I am searching my website on Google cache version is showing 404 errors. I tested same for some other competitors also and the same problem is there. Reviewed on Google Search Console, all good ...
4
votes
1answer
972 views

How can I “mark as fixed” in Google's new Search Console

In the "old" Google Search Console (and Google Webmaster Tools) there was an option to Mark as fixed to clear errors once fixed. This allowed us to keep the error list clean and only show errors that ...
1
vote
2answers
1k views

How to fix 302 errors in my Google Search Console?

I have so many 302 error in my Google Search Console. I changed HTTP to HTTPS recently and confusing part in Google Search Console is when I check there's /search.php on the end of every URL. It ...
0
votes
1answer
304 views

Google Search Console Crawl 404 linked Error from strange Website [duplicate]

Image: The error is displayed because the URL has added the symbol ; at the end. /wp-content/uploads/2018/06/iuiuiuiuiuiui.pdf; (incorrect) If we remove the symbol ; the URL it works normally. /...
1
vote
0answers
992 views

JavaScript console errors in Google Search Console - is it still mobile-friendly?

I am seeing mobile usability issues in my Google Search Console report. When I tested the pages they were 'Mobile Friendly' but there were some page loading issues: page resources couldn’t be ...
2
votes
1answer
427 views

404 Crawl Error to almost all pdf files

The website is built in wordpress. I do not have than much experience, so I need your help. Once I entered at “Search Console” at “Crawl Errors” tab I saw that all “404 errors” are in “wp-content/...
5
votes
3answers
2k views

Google Search Console reports blocked resources from DoubleClick while rendering my pages, where do these calls come from?

I'm seeing errors when rendering pages: Googlebot couldn't get all resources for this page. Here's a list: url: https://static.doubleclick.net/instream/ad_status.js type: Script reason: Blocked ...
1
vote
1answer
44 views

After changing WordPress themes, search console reports 404s for existing URLs that can be rendered as well as many images

The site is now showing increasing numbers of 404s for the URL that are there - both in the URL and can be fetched and rendered. The problems started about two weeks ago with the Divi theme - it wasn'...
1
vote
1answer
142 views

Google Search Console is reporting an hAtom error for every page on my site

Whenever I publish a new article to my site, Google reports a new error by default in Search Console. I don't see what the issue is. How do I fix this?
10
votes
3answers
21k views

What is the solution for “Submitted URL not selected as canonical” in Google Search Console beta?

Google's new webmaster tools has a section 'Index coverage'>'Excluded'>'Submitted URL not selected as canonical'. I am getting 3 internal links in the section "Submitted URL not selected as ...
3
votes
1answer
252 views

How do I do an htaccess rewrite on an internal URL without Google crawl giving me a soft 404 error?

Here is my issue. I have a rewrite rule in my htaccess like this: RewriteRule ^(news|review|feature|editorial|podcast)/([0-9]+)/(.*)$ /article.php?id=$2 [L] Basically what it does is take in a URL ...
1
vote
1answer
80 views

Outdated 404 errors that are linked to from the pages themselves

I have a lot of 404 errors in my Google search console and have been researching this a bit. I understand they are generally not going to impact anything, but I did read that if they are internally ...
1
vote
0answers
19 views

Google Search Console reports error pages when URL paths from one site are requested from another

I have two e-commerce websites. Both are built on Magento. In Google Webmasters Tools for one website it is showing an error with part of the URL from one website and the domain of the other. If my ...
5
votes
0answers
1k views

Search Console: Server Connectivity Error - Connect Timeout

Over the last 4 days server connectivity errors have started to pop up in my Search Console. Specifically, it is the connection timeout error. I have been talking to my hosting provider and they ...
1
vote
1answer
474 views

Google crawler 520 error

Google Crawler generates 520 errors daily. I will get about 50-100 of these errors in a 60.000 internal links website. The thing is though, that my links don't have any issues that I can dig into ...
2
votes
1answer
876 views

Why is Google crawling non-existant URLs?

I can see in live traffic of my wordpress website that goggle bot crawl non existing pages. www.example.gr/search/search-results/password-reset%252Fpassword-reset/password-reset%252Fpassword-reset%...
2
votes
1answer
76 views

Old category pages with URL parameters

I have a problem with already indexed URLs (100k URLs). I have correct the pages with noindex and canonical tags over a month but old indexed pages aren’t removed from results. The problem is the URL ...
0
votes
1answer
33 views

Google Search Console displays errors with “:fast_forward” added to URLs

I have two webpages and their URLs are like: https://example.com/videoCenter https:/example.com/register But today I found that indexing errors show that Google had crawled URLs like: https://...
2
votes
0answers
828 views

Wrong domain in google results [closed]

Google search results show wrong domain (that is on the same web server), i.e. site:rose.spb.ru shows pages from site:xn--h1adaodgdoce7g.xn--p1ai which result in 404 when clicked. Any help is ...
0
votes
1answer
92 views

Can 301 redirects to homepage solve 404 errors in Google Search Console?

I have a site with a few hundred 404s. I am sure there are no relevant pages to redirect users to so I want to redirect users to homepage. Will redirecting to homepage be a good strategy compared to ...
2
votes
0answers
162 views

Sudden Spike in mobile app crawl errors - Search console [closed]

We are seeing something weird in our mobile app crawl dashboard on the search console. Up until 3rd Feb, we had only 3 crawl errors but suddenly that number is now 107k and it went up between 3rd ...
3
votes
2answers
423 views

Google Search Console: 404 errors on existing pages

There is a few years old small website with very few pages (~5), which were indexed and ranked by Google. A few days ago 4 of those pages disappeared from SERPs and Search Console gives me 404 Not ...
3
votes
0answers
80 views

Google Search Console: existing sitemap not found [duplicate]

Google search console (at Crawl -> Sitemaps) gives me General HTTP error: 404 not found errors after I upload the sitemap.xml to my website. When I click the link generated in the search console, it ...
2
votes
0answers
41 views

Do crawl errors in Google Search Console have an expiration time

BACKGROUND In November, a former student contacted me that he had about 258 search errors in his Google Search Console. There were 352 pages on his WordPress site, so that is significant. As can be ...
1
vote
1answer
503 views

404 attack with non existent URLs

Today I checked my google search console and found few interesting 404. All those pages never existed on my site. Funny thing is that it didn't scan for some vulnerable php files. It looked like some ...
1
vote
1answer
37 views

Google search console is reporting site errors where the “linking page” has never linked to that ever

There are many annoying Site Errors when I'm checking my Search Console at "Crawl > Crawl Errors". Here is a screenshot: Those links are totally made up and I am never including them in my sitemap, ...
2
votes
2answers
442 views

Bing webmaster indicating crawl errors on http to https 301 redirect

I moved my site form http to https, now sitemap contains https urls, but Bing webmaster indicates increased "crawl errors" and my indexed pages have decreased to 0. The list of errors says http pages ...
0
votes
1answer
60 views

Google notified me that I have a sudden spike in 404's, but they are pages that don't exist

I'm pretty puzzled by this, so any direction would be helpful. The only thing hosted on this server is basically two word press instances with my personal site and another. Everything's been great, ...
0
votes
2answers
248 views

Google crawl errors after deleting old site

I deleted my old site entirely and made a new site 8 months ago. But still in the crawl errors section of Google Search Console, a lot of 404 and not found errors appear. All the URLs are for the ...
1
vote
1answer
77 views

Will Google remove links restricted by the robots.txt from the soft 404 list?

I have updated a shop system to a newer version. I now get huge number of soft 404 errors in the Webmaster Tools because of links that have been indexed in the old version of that shop. I could lock ...
0
votes
2answers
84 views

Error HTTP 404 can eliminate indexing of a page?

In recent weeks I'm recording a decrease of indexing my site: In 10/09/2016: Submitted => 921 Indexed => 654 Yesterday 23/09/2016: Submitted => 1129 Indexed => 598 Two months ago I created a ...
5
votes
1answer
166 views

Can Googlebot discover URLs that are not in an anchor?

In my Search Console I had a sudden increase in 404's. They were linked from a webpage that listed files from the site in a table but none of these URLs were nested inside an <a> tag. This was ...