All Questions

Tagged with
Filter by
Sorted by
Tagged with
1
vote
1answer
61 views

Is crawl budget and link juice being wasted to URLs with hashes?

On my site I have internal links to URLs with hashes in them, like this one: https://example.com/page.html#music https://example.com/page.html#music has canonical tag with URL pointing to https://...
2
votes
2answers
49 views

Do non-existent 'category' pages in URLs present a problem for search engines?

Say for example if I have a news site and my URL structure is: example.com/news/random-article If there is no page at example.com/news/, in other words it results in a 404 error, is that problematic ...
2
votes
2answers
372 views

What is the way to prevent Google from scraping and crawling a URL in plain text on a page?

Problem I have a website with documentation that includes examples with plain text URLs. The other day, I noticed that Google Webmaster was telling me that one of those URLs generated a Page Not ...
0
votes
1answer
89 views

How can I prevent the Googlebot from indexing duplicate URLs?

I have duplicate URLs for each ad page. For example: https://example.com/ads/2161/%D9%84%D9%83%D8%B2%D8%B3_GS350.html https://example.com/2161/ I used the second URL for Twitter and Instagram posts....
1
vote
1answer
341 views

Google is unable to crawl both my UK and USA sites that use IP detection redirects

The URL's of my website open as per IP detection. That is, for UK it is example.com and for USA it is example.com/usa. But Google is unable to crawl example.com/usa. It is crawling just example.com. ...
1
vote
1answer
11k views

I get General HTTP error: 404 not found when submiting sitemap?

I just bought 2 domain from domaindiscount24.com. I get an error: "General HTTP error: 404 not found" when submitting sitemap. Then, I use "fetch as googlebot" and my website URL, it showed "not found"...
1
vote
2answers
476 views

Crawler errors for unused URLs containing “mozekcdn-a.akamaihd.net”

In the AdSense dashboard, Google is reporting crawl errors for unexpected URLs. It shows that Google crawler was unable to access some of my 87 pages. When I checked those pages I found that I haven't ...
0
votes
1answer
24 views

google webmaster is crawling both file urls

webmaster is crawling both the urls, one which is SEO friendly and the one .php urls for the same page thus showing duplicate title and description for those pages. urls of .php were changed through ....
2
votes
1answer
75 views

Google isn't indexing AJAX URLs even after fetching them with _escaped_fragment

I'm still in the process of making my site crawlable through Google even though it's all AJAX content. I got it where if the URL contains escaped_fragment_ it retrieves the right information form the ...
1
vote
2answers
848 views

SEO penalty for 301 redirecting googlebot only?

I have a website that is splitting into two. For the sake of easily describing the what and why, let's say I run a classifieds site and I want to move all the adult content to its own domain. (very ...
1
vote
1answer
1k views

Can Google bots interpret hyphen separated words as a single keyword?

I have a french website which frequently includes the word rendez-vous. But, Google Webmaster Tools content keywords tells me the #1 keyword is rendez which is not what I want. Even worse, the word ...
4
votes
1answer
1k views

Relative URLs confuse Google crawler

I'm having some odd problems that are apparently being generated by Google crawler. Bing isn't these errors, so it's kind of confusing. The problem seems to be because of relative links. Google ...
0
votes
1answer
129 views

Why did the Googlebot add “sp=1” to my URL's?

Googlebot crawled my site for the first time today, and added something strange. It appended &sp=1 to my URL's. It seems like it's trying to gain authorized access? Normally I have http://domain....
2
votes
1answer
258 views

Can bots crawl through “checkbox” form elements which act as a filter for products?

For example, my site has a list of products, with a filter box which allows you to narrow by price, features, etc. My question is, can google crawl this form, see the url results (which is a bunch of ...
2
votes
2answers
223 views

Get google to index JavaScript pages as separate pages

I have a product page with say 10 products, that loads up all the content when the page loads. Then JavaScript hides content till a product is selected. Then JavaScript hides and unhides information. ...
2
votes
1answer
192 views

How to remove Ever crawled web Pages by Google

I know that we can use noindex, nofollow and robots for excluding the pages from Google Index. This process takes a long long time to clean up website from Google Index. In Webmaster Tools => Index ...
2
votes
1answer
3k views

Google on capital letters in url

I created one of my websites with the following url structure: http://domain.com/Animal/Pig http://domain.com/Pigs If I change the url map to lower case letters instead, will google reindex those ...
1
vote
1answer
489 views

Is Googlebot case sensitive? Should I use a 301 redirect to choose a preferred URL case?

The Googlebot reports the following: Pages with duplicate meta descriptions /Default.aspx?p=2 /default.aspx?p=2 Should I use a 301 redirect from Default to default or vice versa? Is Googlebot case ...
2
votes
2answers
430 views

Googlebot requesting invalid URL

I have a web app which emails me exceptions automatically. This morning there was an error relating to a url: /Catalog/LiveCatalog?id=ylwpfqzts id is invalid (should be a guid) and caused an error ...