All Questions
Tagged with web-crawlers google-index
26 questions
0
votes
0
answers
21
views
Exceed crawl limits for a website [duplicate]
In previous month i created a lot of pages (> 200K), and google indexed it. After some time a relized that i don't need some of these pages and created a new ones, but google don't indexing it. I ...
- 23
1
vote
1
answer
3k
views
How long it takes for new images to get indexed by Google in general? (now i'm on a Squarespace site if it makes any difference)
i'm wondering, if there is some benchmark out there on this info? I see many sources say
it's about 4 days to 4 weeks to get new sites indexed
But it's about general web crawling and not ...
- 215
3
votes
1
answer
6k
views
URL will be indexed only if certain conditions are met
I've got a few pages of my site that are coming up in G Webmaster Tools with errors. The pages are fully working, not restricted by noindex or robots.txt file. The pages don'r have a lot of content, ...
- 397
1
vote
2
answers
344
views
Deleted tags & categories from my blog still come up in Google search results
I am a newbie in blogging. I've deleted some of the unwanted tags and categories from my wordpress blog but they kinda still come put in the search results when I search my website on Google.
How do ...
- 133
5
votes
2
answers
11k
views
Ampersand (&) in actual URL and sitemap
I have a sitemap (which is submitted to Google for indexing) in which I am adding URLs which have an ampersand (&) in it. Since in sitemap & has to be escaped I replaced & with & ...
- 153
0
votes
2
answers
110
views
How to say, "Google, index my web site only during specific times?"
Is it possible tell Google to only index my site between certain hours?
If it is, how can I manage it?
- 11
3
votes
1
answer
843
views
How to prevent Googlebot from doing API requests?
I have a currency converter site around 32k pages. Every pair for each page.
And every page has 2 API requests.
I started to see huge number of API requests. From users I have only few page views ...
- 31
1
vote
0
answers
9
views
Wordpress Website not indexing in google, no error on google webmaster [duplicate]
I just recognized my SEO Score is 0 and that my wordpress website is not indexed on google search engine, no automatic filling as well. I am not an expert, I never used a sitemap, nor htaccess but it ...
- 11
2
votes
0
answers
374
views
Google is adding "Archive" to the title of tag and category pages and not using the meta description
I am wondering why Google is indexing my tags and categories as archives. Is that OK to be like that or I should change them?
How to change them? Actually it looks so awkward!
I have configured my ...
- 63
3
votes
3
answers
132
views
How long before Google indexes a new (to me) domain that previously had spam and virus problems?
I registered a new ".com" domain, but when I added it to the Google Search Console I saw that there were problems with viruses and spam problems. I submitted a request for reconsideration. Google ...
- 131
2
votes
1
answer
586
views
Google is indexing pages as HTTP despite 301 redirects from HTTP to HTTPS
on 9/23 we migrated our entire site to HTTPS. Almost 3 months later and Google has recently cached versions of http:// URLs in the index.
We have an http:// sitemap that is live with 100% 301 ...
1
vote
0
answers
50
views
Google doesn't index my pages managed by session
My website has an architecture like this:
em1
sub1
sub2
...
em2
sub1
sub2
...
em3
...
...
All elements "em" has the same "sub" associated. The difference only resides on the content in the "...
- 147
1
vote
1
answer
547
views
Trick to index infinite scroll content on Google?
I have a Question & Answer website, sort of like stackoverflow.
When you open it, it displays 20 latest questions.
When scroll to bottom of page, and it fetches 20 more, and so on, infinitely.
...
- 111
1
vote
0
answers
29
views
URL Dynamically changes after first edit
We are developing a magento eCommerce website with main category pages, sub-category pages and details page along with other static pages.
Our condition is if any miss-spelled URLs entered directly ...
- 142
3
votes
3
answers
2k
views
can google index/crawl random subdomains that aren't linked to from anywhere
Me and a friend are having a debate where she claims that every and all subdomains will get crawled/indexed by google unless you specifically tell it not to, and I'm saying that if a page isn't linked ...
- 131
1
vote
1
answer
797
views
Google's cache (text version) does not show hyperlinks
I have list of product links on one of our website's page. For some reason when I view the google's cached version of this page, google strips out all the product links.
Links in the header and footer ...
- 113
2
votes
3
answers
157
views
Having issues getting new pages indexed in Google
We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
- 21
1
vote
3
answers
219
views
How do I remove a LOT of indexed pages from Google?
A few weeks ago we have figured out that Google has indexed some information we would rather keep in some confidentiality, in the format of individual PDF files. Our assumption was that this was a ...
- 11
0
votes
2
answers
93
views
Why URL and linked pages submissions for Google?
Why Google Webmaster Tools have limitation on URL and linked pages submissions?
Is there any solution to submit more than 10 URL?
- 139
0
votes
2
answers
139
views
Google not crawling my website [duplicate]
I own a website http://citrusbug.com.
We did not have proper content before so to prevent search engine from crawling our site
we added a robots.txt with code to prevent crawling.
Now we had ...
5
votes
4
answers
359
views
Total Indexed 0, 99 not selected in webmaster tools
I recently changed domain names from xxx.com to xxx.ca I created all the 301's submitted sitemaps and submitted a change of address to google webmaster tools on Dec 16th. I've since seen urls change ...
- 263
3
votes
1
answer
336
views
Are the following assumptions about indexing and ranking correct?
Are the following statements true or false:
If a page is crawled by Google, it automatically gets into the index (unless explicitly blocked by robots.txt)
An indexed page always gets a ranking (high ...
- 4,625
2
votes
2
answers
227
views
Can Google stop crawling/indexing your site because you are working a lot on it?
I think I read somewhere that Google could stop crawling/indexing a site/blog if there was a lot of work performed on it (like many pages are modified, deleted or loaded daily). It would wait until ...
- 4,625
2
votes
2
answers
87
views
Is there a weight for html link?
I would like to know if there is any weight associated with a html link (its backlink) when google does crawling/indexing. Will 1,2 & 3 be ever considered as a backlink by Google?
1. <a href="...
- 23
2
votes
2
answers
994
views
SEO: disallowing Google from indexing forms?
From a SEO point of view, would you exclude forms from being indexed/crawled by Google or not?
I mean my forms hardly ever contains keyword/keyphrases.
So I'm wondering what's the point of letting ...
- 6,500
2
votes
3
answers
209
views
Why isn't Google crawling on my blog? [duplicate]
I have a blog. I made it in August, 2010. It has been awhile, but I am unable to make Google crawl on my site. I have requested Google to crawl but there is still no response. Are there any reasons of ...
user2930