Questions tagged [crawl-errors]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
20 views

should I set images to no index to avoid crawl budget limit

Most of my posts in search console are showing URL is on Google, but has issues I checked Crawl Page more info section and found out the blog post with many images show other error and the image ...
1
vote
0answers
38 views

Google won't index my newly created home page after I had used a removal request for the default WordPress site on my domain

I have a site built with WordPress. Initially, because the default content of the template was indexed in Google, I decided to remove those URLs through the removals section in the Google console ...
1
vote
0answers
21 views

Google say URL is blocked by robots.txt but it isn't

My Google search console says that my submitted URL is blocked by robots.txt, but I checked header, tags and robots.txt it isn't. My URL was on #1 for my target keyword and daily get 1000 clicks ...
2
votes
1answer
36 views

Remove large amounts of pages from Bing Index Explorer

I have a website that I took over in my business. We redid the whole website (which was previously a mix of ASP and HTML) and is now a WordPress site running on nginx. I submitted the sitemap to ...
2
votes
0answers
29 views

Disallow Image Loading to Reduce Number of “Other Error” in Crawled Page Resources?

We have a hotel search website. Many landing pages of our site load resources asynchrously (e.g. Ajax), but very often (about 25% of the time) when we click "View Crawled Page" in Google Search ...
0
votes
1answer
95 views

Google Search Console: issues detected “Top Errors” Server Error (5xx). BUG?

Just got this email from Google Search Console: This were the issues: But when I inspected those live URL's (using Google Search Console tool) they came back as "available to Google" and one of them ...
2
votes
1answer
59 views

Google Search Console Warning: “ Indexed, though blocked by robots.txt ” (BUG)

Two days ago I've got an email with a warning from Google Search Console, telling me that 3 URLs from my site where indexed, but were blocked by robots.txt. Since I first deployed my website, I haven'...
1
vote
0answers
16 views

When setting up a campaign, Facebook is crawling my website using an Iphone user agent

Whenever I'm I'm setting up a campaing on Facebook, I get two visits from Facebook's auto crawlers. The first one I can identify as a robot and serve the SSR (HTML) version to it. The user agent is: ...
2
votes
1answer
73 views

Why is Google making up pages to crawl on my site?

For some reason Google is listing a series of pages that do not exist on my website such as: https://www.my_domain.com/index.php/about_us.php It lists them as 'Duplicate, Google chose different ...
0
votes
0answers
18 views

bing doesn't index my site.why? [duplicate]

i have been indexed my site to bing webmaster ,i submitted urls manually for many times .everything is fine but i don't know why it doesn't appear in search anything form my site. These two picture ...
0
votes
0answers
23 views

URLs appearing in Google Search Console that don't exist in our site [duplicate]

I have a domain name like xyz.com with many other URLs, but we see in Google Search Console other types of URLs that do not exist in our site. For example: xyz.com/xyz?fb_xd_fragment/celebrity/adah-...
2
votes
1answer
53 views

Page cannot be reached in Google Rich snippet test

When i test my webpage in google rich test, it say page cannot be reached. My website is on shopify so i guess there should be no issue from server side. I need your help please... I cannot figure out ...
2
votes
0answers
29 views

URL crawlable in old Google search console, but blocked in new

Google stopped crawling images for our site, when we moved images to cdn subdomain. Old search console states image is crawlable, but new one states it is blocked by robots.txt (for same link). our ...
1
vote
0answers
300 views

How to allow only admin-ajax.php to be crawled? [closed]

My robots.txt looks as follows: User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Google Webmaster Tool recently raised a warning saying: Indexed, though blocked by robots.txt I ...
2
votes
1answer
485 views

Google Search Console still reporting 5xx errors even when my server has been running flawlessly for 7 days

For the past few days, I see that I have the following index coverage issue: Last month I was working on my production server and during this time the production server threw some errors (this ...
2
votes
1answer
59 views

Getting usability issues in Google Search Console for the responses of API calls

Today I found an error that appeared in GSC recently. The URL of the affected page is not a page actually. That’s a example.com/api/v2/getcurrentuser API call that the JS is requesting to retrieve ...
0
votes
0answers
48 views

Googlebot crawl anomaly due to blocked resources by Zopim

I am using Zopim live chat to enable chat support in my website, but Googlebot is showing error due to some unreachable resources from zopim service. I have attached a screen capture of the error. ...
1
vote
1answer
104 views

Yoast purge plugin caused crawl errors, getting more even after removing it

I'm using the Yoast SEO plugin on my WordPress site, and when you upload media to WordPress media library, it makes a copy of the image or file and creates a file path (this is normal). However, all ...
1
vote
1answer
148 views

Google can't access my page due to robots.txt but the testing tool says it's OK

My robots.txt is the typical that allows all bots everywhere User-agent: * Disallow: / When I test it with Google tool everything is OK. But in Google Search Console I get an error that my site can'...
0
votes
1answer
159 views

Why are bots or servers crawling non- (NEVER) existent URLs and how can I stop this?

Through Google Analytics I started noticing hits in the dozens via a source page named as "free-seo-help.org" that redirects to http://seo2.agri-co-jsy.com/?site=http:// It does not go to my actual ...
1
vote
1answer
141 views

404 on google cached version pages [duplicate]

When I am searching my website on Google cache version is showing 404 errors. I tested same for some other competitors also and the same problem is there. Reviewed on Google Search Console, all good ...
4
votes
1answer
1k views

How can I “mark as fixed” in Google's new Search Console

In the "old" Google Search Console (and Google Webmaster Tools) there was an option to Mark as fixed to clear errors once fixed. This allowed us to keep the error list clean and only show errors that ...
1
vote
2answers
1k views

How to fix 302 errors in my Google Search Console?

I have so many 302 error in my Google Search Console. I changed HTTP to HTTPS recently and confusing part in Google Search Console is when I check there's /search.php on the end of every URL. It ...
0
votes
1answer
307 views

Google Search Console Crawl 404 linked Error from strange Website [duplicate]

Image: The error is displayed because the URL has added the symbol ; at the end. /wp-content/uploads/2018/06/iuiuiuiuiuiui.pdf; (incorrect) If we remove the symbol ; the URL it works normally. /...
1
vote
0answers
1k views

JavaScript console errors in Google Search Console - is it still mobile-friendly?

I am seeing mobile usability issues in my Google Search Console report. When I tested the pages they were 'Mobile Friendly' but there were some page loading issues: page resources couldn’t be ...
2
votes
1answer
484 views

404 Crawl Error to almost all pdf files

The website is built in wordpress. I do not have than much experience, so I need your help. Once I entered at “Search Console” at “Crawl Errors” tab I saw that all “404 errors” are in “wp-content/...
5
votes
3answers
2k views

Google Search Console reports blocked resources from DoubleClick while rendering my pages, where do these calls come from?

I'm seeing errors when rendering pages: Googlebot couldn't get all resources for this page. Here's a list: url: https://static.doubleclick.net/instream/ad_status.js type: Script reason: Blocked ...
1
vote
1answer
44 views

After changing WordPress themes, search console reports 404s for existing URLs that can be rendered as well as many images

The site is now showing increasing numbers of 404s for the URL that are there - both in the URL and can be fetched and rendered. The problems started about two weeks ago with the Divi theme - it wasn'...
1
vote
1answer
142 views

Google Search Console is reporting an hAtom error for every page on my site

Whenever I publish a new article to my site, Google reports a new error by default in Search Console. I don't see what the issue is. How do I fix this?
11
votes
3answers
24k views

What is the solution for “Submitted URL not selected as canonical” in Google Search Console beta?

Google's new webmaster tools has a section 'Index coverage'>'Excluded'>'Submitted URL not selected as canonical'. I am getting 3 internal links in the section "Submitted URL not selected as ...
3
votes
1answer
256 views

How do I do an htaccess rewrite on an internal URL without Google crawl giving me a soft 404 error?

Here is my issue. I have a rewrite rule in my htaccess like this: RewriteRule ^(news|review|feature|editorial|podcast)/([0-9]+)/(.*)$ /article.php?id=$2 [L] Basically what it does is take in a URL ...
1
vote
1answer
80 views

Outdated 404 errors that are linked to from the pages themselves

I have a lot of 404 errors in my Google search console and have been researching this a bit. I understand they are generally not going to impact anything, but I did read that if they are internally ...
1
vote
0answers
19 views

Google Search Console reports error pages when URL paths from one site are requested from another

I have two e-commerce websites. Both are built on Magento. In Google Webmasters Tools for one website it is showing an error with part of the URL from one website and the domain of the other. If my ...
5
votes
0answers
1k views

Search Console: Server Connectivity Error - Connect Timeout

Over the last 4 days server connectivity errors have started to pop up in my Search Console. Specifically, it is the connection timeout error. I have been talking to my hosting provider and they ...
1
vote
1answer
494 views

Google crawler 520 error

Google Crawler generates 520 errors daily. I will get about 50-100 of these errors in a 60.000 internal links website. The thing is though, that my links don't have any issues that I can dig into ...
2
votes
1answer
945 views

Why is Google crawling non-existant URLs?

I can see in live traffic of my wordpress website that goggle bot crawl non existing pages. www.example.gr/search/search-results/password-reset%252Fpassword-reset/password-reset%252Fpassword-reset%...
2
votes
1answer
76 views

Old category pages with URL parameters

I have a problem with already indexed URLs (100k URLs). I have correct the pages with noindex and canonical tags over a month but old indexed pages aren’t removed from results. The problem is the URL ...
0
votes
1answer
33 views

Google Search Console displays errors with “:fast_forward” added to URLs

I have two webpages and their URLs are like: https://example.com/videoCenter https:/example.com/register But today I found that indexing errors show that Google had crawled URLs like: https://...
2
votes
0answers
872 views

Wrong domain in google results [closed]

Google search results show wrong domain (that is on the same web server), i.e. site:rose.spb.ru shows pages from site:xn--h1adaodgdoce7g.xn--p1ai which result in 404 when clicked. Any help is ...
0
votes
1answer
92 views

Can 301 redirects to homepage solve 404 errors in Google Search Console?

I have a site with a few hundred 404s. I am sure there are no relevant pages to redirect users to so I want to redirect users to homepage. Will redirecting to homepage be a good strategy compared to ...
2
votes
0answers
162 views

Sudden Spike in mobile app crawl errors - Search console [closed]

We are seeing something weird in our mobile app crawl dashboard on the search console. Up until 3rd Feb, we had only 3 crawl errors but suddenly that number is now 107k and it went up between 3rd ...
3
votes
2answers
435 views

Google Search Console: 404 errors on existing pages

There is a few years old small website with very few pages (~5), which were indexed and ranked by Google. A few days ago 4 of those pages disappeared from SERPs and Search Console gives me 404 Not ...
3
votes
0answers
80 views

Google Search Console: existing sitemap not found [duplicate]

Google search console (at Crawl -> Sitemaps) gives me General HTTP error: 404 not found errors after I upload the sitemap.xml to my website. When I click the link generated in the search console, it ...
2
votes
0answers
41 views

Do crawl errors in Google Search Console have an expiration time

BACKGROUND In November, a former student contacted me that he had about 258 search errors in his Google Search Console. There were 352 pages on his WordPress site, so that is significant. As can be ...
1
vote
1answer
517 views

404 attack with non existent URLs

Today I checked my google search console and found few interesting 404. All those pages never existed on my site. Funny thing is that it didn't scan for some vulnerable php files. It looked like some ...
1
vote
1answer
37 views

Google search console is reporting site errors where the “linking page” has never linked to that ever

There are many annoying Site Errors when I'm checking my Search Console at "Crawl > Crawl Errors". Here is a screenshot: Those links are totally made up and I am never including them in my sitemap, ...
2
votes
2answers
461 views

Bing webmaster indicating crawl errors on http to https 301 redirect

I moved my site form http to https, now sitemap contains https urls, but Bing webmaster indicates increased "crawl errors" and my indexed pages have decreased to 0. The list of errors says http pages ...
0
votes
1answer
60 views

Google notified me that I have a sudden spike in 404's, but they are pages that don't exist

I'm pretty puzzled by this, so any direction would be helpful. The only thing hosted on this server is basically two word press instances with my personal site and another. Everything's been great, ...
0
votes
2answers
249 views

Google crawl errors after deleting old site

I deleted my old site entirely and made a new site 8 months ago. But still in the crawl errors section of Google Search Console, a lot of 404 and not found errors appear. All the URLs are for the ...
1
vote
1answer
77 views

Will Google remove links restricted by the robots.txt from the soft 404 list?

I have updated a shop system to a newer version. I now get huge number of soft 404 errors in the Webmaster Tools because of links that have been indexed in the old version of that shop. I could lock ...