Tag Info

New answers tagged

0

rel="nofollow" is the best & recommended way to stop any search engine from indexing any particular page. Hence use it as <a rel="nofollow" data-toggle="modal" href="/detail-12.html" data-target="#myModal">Detail of this comment 12</a>


0

There are several tools that you could use to prevent Googlebot from crawling and indexing the content. robots.txt You could list all the files as disallowed in a robots.txt file. Then Google would not crawl them and would be very unlikely to index them. Your robots.txt file might look like: User-agent: * Disallow: /detail-12.html Disallow: ...


1

Google spider check every site depending of many parameters as you know. The better practices are: Put Google Webmster Tools and check sitemap and visibility Avoid errors like 404 or code errors Check your MetaTags as Google recommend: Metadata Google Needed robots.txt with map to visit (have in webtools a Robot checker) Actually is important to supply ...


0

I am assuming that because you said your site is "beta" that it is a new site. You have several things working against you for a period. Without knowing your domain name, I cannot fully asses your site, however, here is a short list. New site. Site age is a significant trust factor. New registration. Registrant contacts, addresses, phone numbers, and ...


0

You will need a higher PR rating and a high SEO rating before the bot will consider visiting your site everyday. Read over this support article by Google there are over 200 factors that the bot takes into account for page relevancy; most factors have been kept secret so people will not try to manipulate the bot.


1

The official way of letting Google know of your updates is your sitemap. Submitting your Google Site's sitemap to Google Webmaster Tools On your Webmaster Tools home page, select your site. In the left sidebar, click Site configuration and then Sitemaps. Click the Add/Test Sitemap button in the top right. Enter /system/feeds/sitemap into the text box ...


0

A really simple way to get them indexed would be to create a google webmaster tools account, claim your domain and then submit a complete sitemap. Depending on the authority of your site, Google is going to make resource decisions about how much effort to put into spidering your site.


0

Googlebot is getting better and better at crawling and indexing data that is loaded via JavaScript and AJAX. In most cases however, Googlebot can't access that data and rank your site for the keywords contained in it. Google's recommended solution for the problem is crawlable AJAX. You include a meta tag in your page http://example.com/map.html: ...


6

You have nothing to worry about. You can use display: none; to switch menus. Search engines are much better at understanding JS and CSS. As long as you are not intentionally trying to manipulate things to get a better ranking. Using display: none; to hide big blocks of text will get you penalized. So if you are only using to hide your desktop menu on ...


1

Mediapartners-Google (the AdSense bot) will crawl any page where you serve their ads. It is likely crawling these pages because you have ads on them. When you say "with invalid, yet with a valid format, token" could they be expired tokens? That would make sense. The user uses these tokens (which invalidates them) and then later the bot comes to check the ...


-1

Google will not crawl any doc with the robots.txt disallowed. Not ordinarily, anyway...site maps included.


2

Okay. I looked at one of the reports available. Here is what I can tell you. Nibbler is only looking at 5 pages and gathers much of it's information from other sites. In fact, when you look at the various data blocks, you can see where the data comes from. Also, please know that it is not always possible to get an accurate last modified date depending upon ...



Top 50 recent answers are included