The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

4
votes
3answers
138 views

What is 'lack of original content'?

It is written everywhere that lack of original content is has a negative impact on ranking. But what is lack of original content? (I am not talking about duplicate content) I guess if you copy other ...
1
vote
1answer
55 views

Should webmasters “index” dashboard and edit account page

New here, I did my research and found nothing, but sorry if it has already been asked. As webmasters should be let google and other search engine INDEX our member's dashboard and edit account page. ...
1
vote
1answer
102 views

Is this a proper way to deal with near duplicate content?

I have a website which used to have 22.000 pages with near duplicate content. Of course, this has become a Panda issue. These pages are now gone from my site and the Google index. I have decided to ...
0
votes
1answer
59 views

SEO: why this site won't index? [duplicate]

I recently built a one-page-site, All main pages are loaded via ajax, so they exist as standalone too versions as well in HTML format through jQuery, only pages' content is loaded in the ...
1
vote
0answers
20 views

Adding http:// in internal links [duplicate]

I was wondering if adding http:// into my links was a bad thing for SEO optimization. I know that is unnecessary but I have several links that are displayed in multiple subdomains. I try to explain ...
2
votes
4answers
533 views

Google crawl speed — how fast can it go?

I have a huge website with 5 million pages. Currently Google indexes about 10,000 pages per day. This is very slow, I still have lots of pages that I can't get indexed. Does anyone know what is the ...
0
votes
1answer
114 views

Need Google to recrawl the pages

I've changed the meta description tag in many of my site pages. Should I select Fetch as Google->Fetch->Add to Index->URL and all linked pages in GWT? Will Google recrawl the whole site faster than ...
0
votes
3answers
67 views

Is there a way to obtain a list of the links that Google has crawled?

I was concerned that Google was not obtaining all the links on my site during their crawl, but after going into Google Tools it seems I have a few hundred URL's indexed every week (approximately), ...
1
vote
1answer
158 views

Will Google index a PHP header redirect?

I have a new domain which has an index.php file. Inside this file, I get user's IP, save it and redirect to another page on another domain. So there is no output, only header info. Will Google index ...
0
votes
2answers
128 views

Opening forum for search engine bots and SEO

We develop and sell components for other software developers through our website. The main products are ActiveX and WinFroms.NET grid controls. Some years ago we established a forum dedicated to our ...
1
vote
1answer
238 views

Google Webmaster Tools not showing index pages

I have submitted sitemap and also fetched pages of my sites but still its showing error like "domain with protocol https://www.domain-name is not available try with http://www.domain-name.html". ...
0
votes
3answers
123 views

How to exclude certain images on web page from spiders?

I have a page with a main image on it that I want to be indexed. I also have a list of other images (thumbnails) on the same web page that should not be indexed or associated with the current ...
1
vote
0answers
70 views

SEO strategy for multiple pages per entity [closed]

I'm trying to decide a good SEO strategy for a web-site with multiple pages per entity. For example, there are main pages for companies which summarize the main information and each sub-page and ...
0
votes
1answer
183 views

How to prevent webpages translated with Google Translate Plugin from being indexed?

I've been reading the information here https://support.google.com/translate/#2534535 about the Google Translate plugin. At first I thought that if I used the plugin my site wouldn't be indexed, but ...
4
votes
5answers
385 views

With Robots.txt disallow all, why was my site still getting traffic?

In failing to check my robots.txt on a community site, it had: User-agent: * Disallow: / I only clued into this because of a message in my AdSense account saying that five URL's couldn't be ...
0
votes
1answer
51 views

Is it possible to have Google index one page with one URL and have it link to another URL?

We want to tell Google to crawl a content heavy page but list a link to a much more performant JavaScript version of the page. Is this possible? I.e. Give Google a sitemap, then put canonical tags ...
4
votes
1answer
112 views

Will switching from home grown news page to a Facebook feed hurt SEO?

We are thinking of dumping our home curated news page and going to an embedded Facebook feed instead. One of the purposes of the news page is to boost SEO. The intention is that keywords will occur ...
1
vote
1answer
150 views

How do I prevent search engines from indexing a website duplicated on a second domain?

Let's say I run a website example.com with a dedicated IP A.B.C.D. Then I find out doing a search on Google, that my website is also being indexed through a domain A-B-C-D.example.com (where the ...
3
votes
4answers
3k views

How can I get a list of all indexed pages for my domain?

We're in the process of migrating an outdated e-commerce cart to Magento. Part of this process will entail configuring proper 301 redirects. I'm aiming to get a list of all indexed pages to throw ...
2
votes
3answers
332 views

“X-Robots-Tag: noindex” on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
1
vote
2answers
108 views

Is it possible for Google to discover a website that is not linked to anywhere? [duplicate]

My colleague claims that he has seen cases where websites were "discovered" by Google without having a link to them anywhere on the web. For him, this means that the only way to not being indexed ...
2
votes
1answer
56 views

Is this considered to be “Internal Near-Duplicates”?

Some people generate the same pages with a slight variation in keywords, title, country name, region name, etc... This is typically considered to be "Internal Near-Duplicates." I have seen a website ...
0
votes
0answers
17 views

Debugging reason for specific site sections with significantly low appearance in SERP [duplicate]

I'm experiencing very little exposure for specific sections in my site compared to different sections. Most of my traffic is long-tail queries, in the popular SERP, and non-popular SERP sections. I ...
2
votes
2answers
69 views

Should I have link rel=next & prev on URLs which have query variables?

For example, I have link rel prev & next set up on these pages of products: site.com?page=2 site.com?page=3 (this is my preferred structure by the way and I'm trying to get all the ugly URLs ...
4
votes
1answer
228 views

Why does Google index pages of my blog in seconds, while pages on the rest of the website take longer to get indexed

I have a questions and answers website in Portuguese about a specific subject. My Q&A website also have a blog, on a sub-directory like www.site.com/articles. I had not written on the blog for ...
1
vote
3answers
98 views

Using Ajax #! for Google but site is not being crawled any more

We used to have all links in a normal way (thus with parameters?), we changed to AJAX loading cause we installed a music player. Here's an example: Old link: ...
2
votes
1answer
174 views

Will Google index images from HTML select tag

If i have code like this: <select> <option value="path/to/image1.jpg">Image 1</option> <option value="path/to/image2.jpg">Image 2</option> <option ...
0
votes
1answer
143 views

New Facebook page not indexed, old one still is

We migrated our client's old Facebook page to a new Facebook page several months ago. When I search for "(Client's Name) Facebook" in Google, the old Facebook page appears, but not the new one. When ...
2
votes
1answer
139 views

JavaScript loaded external content SEO

I wonder what is the best way to have Javascript loaded content indexed by search engines. I know that search engines don't execute Javascript, but I am thinking more of an progressive enchantment. I ...
4
votes
2answers
273 views

Google Webmaster Tools reports fake 404 errors

I have a website where Google Webmaster Tools reports 15,000 links as 404 errors. However, all links return a 200 when I visit them. The problem is, that eventhough I can visit these pages and return ...
1
vote
2answers
154 views

Does Google search URLs in different languages

I am building a multilingual website (from Spanish origins) however there will be English, Chinese, Spanish, and French users. We are about to buy a domain however I am confused as to what language I ...
2
votes
1answer
806 views

What does “all” mean in meta robots tag?

Several websites have the following meta tag aimed at search engines like Google, Bing, etc.: <meta name="robots" content="all" /> What does it do?
5
votes
3answers
979 views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
3
votes
2answers
213 views

Using .htaccess for proper indexing/SEO of timthumb images

I don't know a whole lot about the intricacies of SEO so I was wondering if someone here could provide some insight to this problem. When you use the php script timthumb on a website, it means images ...
1
vote
2answers
150 views

Google references subfolders

Last week I launched a website and created a robots.txt: User-agent: * Disallow: Sitemap: http://mywebsite.tld/sitemap_robots.xml Now I've checked the indexed pages (Google -> ...
3
votes
1answer
996 views

Google Webmaster Tools Index Status 0 for one year

I've read this topic with answers but they do not address why zero for one year? but other areas in Google Webmaster Tools report 400 URL indexed. Google Webmaster Tools Index Status Only 2 Indexed. ...
1
vote
1answer
38 views

Prohibit search engines before going live

I want to prohibit search engines to index my web site before going live with it. If I simple do a robots.txt with: User-agent: * Disallow: / Would that cause any issues later when I decide to ...
1
vote
1answer
60 views

www.*.us.com not being indexed, but *.us.com is on Google Webmasters

I've read the FAQ and searched the help center. My URL is http://www.etechsupport.us.com. I have also done 301 redirect of no-www to www. But www is not being indexed by Google and no-www is. My SEO ...
1
vote
1answer
41 views

What's the best way to handle multiple sites on a shared server?

I'm on a shared server (via LunarPages), and I also host a few low-impact sites for a few small businesses. I recently had a problem (blocked crawlers by messing with the internal settings) that made ...
0
votes
2answers
117 views

Google Webmaster Tools Index Status is 0 [duplicate]

Statistics show all entries of my wordpress blog have been tracked, but none have been indexed. I thought it would be just a matter of indexing delay, but it has been 3 weeks already, and I can find ...
1
vote
1answer
183 views

How to make Google index files retrieved from database?

We use Joomla with Remository to store and manage publications (don't ask me why). Files (PDF) are stored in a database and can be accessed via dynamic, rewritten links of the form ...
1
vote
1answer
139 views

Block search engines from the main domain while allowing add-on domains to rank well

I have a shared hosting account with a main domain and many add-on domains. I don't actually use the main domain, it just has a landing page. Can I tell bots not to index the main domain WITHOUT ...
0
votes
1answer
40 views

If my index page has no textual content, should it be present in sitemap?

My index page contains no textual content at all (except some footer links, copyright notice and some stuff in tag). It has, however, big Google's map with some pins attached which lead to articles. ...
3
votes
2answers
1k views

Can I force Bing to reindex our site?

Our website is ranking quite well (first page) on Google for quite a lot of keywords. However, our website is not on the first 10 pages of Bing for most of these keywords. I notice our Google ...
2
votes
1answer
104 views

google removed links from the index [duplicate]

I asked google to crawl a site through webmaster tool and include it to the index. How actually it was done: Firstly, i picked some urls manually. Approx. after half of a day those pages were ...
2
votes
2answers
996 views

Difference between canonical and base tag

I am a little bit confused regarding the usage of canonical tags and base tags. I have placed canonical tag (rel="canonical") on my website because of my website opening with no-www. I have reviewed ...
1
vote
1answer
192 views

Index manager in cpanel. Do contents still get indexed with “No Indexing”?

Simple question. A folder, lets say for example abc.com/images/ Is being displayed on google as "index of", which I don't like. The contents of this folder are important, and it is important that ...
4
votes
1answer
551 views

Google's microdata for product images which aren't displayed in the page?

My internet shop displays thumbnails of products' images, and I see that these thumbnail are (slowly) being indexed by Google. I want also full images to be indexed. (I've seen some other questions on ...
1
vote
1answer
346 views

How to make image only website friendly to googlebot? [duplicate]

so I making this portfolio site for some artist. She draw all the menus and texts manually(on paper), then scanned, some "post processing" in photoshop and that's how the whole layout was created. ...
4
votes
2answers
124 views

Seo Fake backlinking from other sites

The title might be a little bit confusing. Well, I noticed that someone had used a page's URL for backlinking or indexing his keywords. This is what he did: The normal url: http:// ...