Skip to main content
Share Your Experience: Take the 2024 Developer Survey
10 votes
Accepted

How to allow Googlebot unlimited crawling but to have a limit on individual users?

Googlebot will be able to crawl your site fully because it never sends any cookies. There is, however, something else you need to do. Google expects sites to implement limits on the amount of content ...
Stephen Ostermiller's user avatar
9 votes

What is an API key?

The best description of an API key I can find comes from this article from Apipheny: When dealing with APIs, you may encounter something called an API key. They’re sort of like passwords which let ...
Maximillian Laumeister's user avatar
8 votes

More Secure NGINX Authentication than auth_basic

Although the question is 2 years old, I would like to keep on answering to it. The page linked by the accepted answer (https://www.nginx.com/resources/wiki/modules/auth_digest/) is 11 years old and ...
Moi Jaiunvelo's user avatar
5 votes
Accepted

More Secure NGINX Authentication than auth_basic

NGINX has a digest authentication module: https://www.nginx.com/resources/wiki/modules/auth_digest/ Unlike basic authentication, digest authentication does not send user names and passwords in plain ...
Stephen Ostermiller's user avatar
5 votes

What is an API key?

API keys are a lot like passwords: They are secrets that allow access. There are however a few differences: Passwords are for humans, API keys are for automated access with programs or scripts. ...
Stephen Ostermiller's user avatar
4 votes

Googlebot not respecting HTTP basic auth

Google has a feature in webmaster tools where you can add login information if you want Google to crawl content behind a user login form. If you have provided Google this information in the past and ...
Chris Rutherfurd's user avatar
4 votes
Accepted

Does requiring login to access content hinder SEO?

In Google, you can have the best of both worlds by using First Click Free. In short, this means that: [the] article can be seen without subscribing, [and] any further clicks on the article page ...
GDVS's user avatar
  • 7,795
4 votes

SEO Impact on presenting User details without login

In short: it's very unlikely you'd see a negative SEO impact, but it still might not be a good idea. Google doesn't currently impose penalties, manual or algorithmic, for showing user details without ...
GDVS's user avatar
  • 7,795
4 votes
Accepted

Does the presence of a flash banner on a site inherently create a vulnerability on the site?

As an end user, the simple answer to this is "just don't allow the banner to run." The term "banner" suggests to me that the applet is nonessential, i.e. blocking it wouldn't prevent the page from ...
Maximillian Laumeister's user avatar
4 votes

How to allow Googlebot unlimited crawling but to have a limit on individual users?

I will use cookie to track this... If you are using cookies to track whether unsigned-in users have reached their page-view limit then there is nothing extra you need to do to allow Googlebot ...
MrWhite's user avatar
  • 42.8k
4 votes

What is an API key?

The term "API key" is overloaded for two very different meanings. In your case, it's not entirely clear, but from when one website's API logins to another website's API automatically (...
R.. GitHub STOP HELPING ICE's user avatar
3 votes
Accepted

How do I log in into Apache web server on Ubuntu from Windows?

You need one additional thing to connect: the address of the server. It can be either an IP address or a host name. After you have the address you can log into the machine through secure shell (SSH)...
Stephen Ostermiller's user avatar
3 votes

Still prompted for a password after adding SSH public key to a server

TL;DR On Client side: open configuration file /etc/ssh/ssh_config; here look for PreferredAuthentications; make sure password comes after publickey and not viceversa In my case password was written ...
StefTN's user avatar
  • 131
3 votes
Accepted

How to log-in with more rights than Admin or Bureaucrat?

There are privileges which bureaucrats do not have by default, and it is possible to give those to them (or some other group or a specific user if you prefer), e.g. $wgGroupPermissions['bureaucrat'] +...
Tgr's user avatar
  • 1,289
3 votes

How to allow Google to index protected content?

What you do is not a good idea and can be penalized as cloaking. Till 1st October 2017 the best practice was the First Click Free as mentioned in a previous answer. However since October 2017 this ...
IXN's user avatar
  • 322
3 votes

How to allow Google to index protected content?

If you want to give Google access to restricted content, you can use First Click Free by Google. First Click Free is designed to protect your content while allowing you to include it Google's ...
Nat Ryall's user avatar
  • 1,364
2 votes

Is it reliable to rely on external authentication providers in the long run?

If you're a small or medium team, then it's certainly worth it in the long run. It's much easier to store credentials in third-party specialized servers, and (most important for me) if something goes ...
aaaltnate's user avatar
2 votes

Verifying that a user is from a certain country

Here is a simple thought, when signing up have a field that that forces them to pick from one of the selected countries you speak of. The reality is, anyone that is criminal minded will have no ...
norcal johnny's user avatar
2 votes

Is it possible to create a full SEO website with Firebase?

You can absolutely create web pages with firebase. Check out Firebase Hosting, it lets you serve up static websites HTML, CSS, and JS, which are inherently SEO-friendly. You can couple this JAMstack ...
Maximillian Laumeister's user avatar
2 votes

Webmin: Cannot login through nginx reverse proxy

Try this solution, it works for me well: /etc/webmin/config: webprefix=/webmin webprefixnoredir=1 relative_redir=0 # pay attention on this referer=www.examle.com /etc/webmin/miniserv.conf: ...
Oleksandr Shmyrko's user avatar
2 votes
Accepted

Do most websites not use HTTP authentication header but something else for authentication?

Using an authentication header usually pops up a modal dialog box on top of your browser like: That type of authentication is not very popular. It has several drawbacks: The login box looks ugly. ...
Stephen Ostermiller's user avatar
2 votes
Accepted

increasing number of malicious login attempts- what to do?

These are 2 methods I use. There may be other better ones but these are 2 quick ones that I've used successfully. Method 1 You could enable 2 Factor Authentication. This is a quick solution for ...
Ed Shway's user avatar
  • 136
2 votes

In Apache make subdirectory require basic authentication while parent directory is open to the public

It turned out that I needed to put a matching FilesMatch element in the subdirectory configuration section: # We require Basic Auth (username and password) for this sub-directory ...
rlandster's user avatar
  • 151
2 votes
Accepted

why I can't login to cPanel, shows error Maximum Users Exceeded?

That error means that the cPanel license has been suspended because the server has too many users. You can find out what kind of license you have by putting your server's IP into the following form: ...
thahostingadmin's user avatar
2 votes
Accepted

Should I automatically delete accounts if they have not verified their email address?

To add to Stephen's comment, it's unlikely that absolutely nothing goes into any database at the point of unverified account creation. Therefore, the question is what you want to do with the ...
Henry Visotski's user avatar
2 votes

What is an API key?

One important thing to understand is, that there is a difference between authorization (you are allowed to do this thing) and authentication (you really are who you say you are). They are not ...
Fabian Sievert's user avatar
2 votes

How to exclude bounces from users just clicking "Sign In App" to navigate to a subdomain in Google Analytics?

In this case, the simplest way to fix this issue is to leave the login URL from the "app" subdomain in the Analytics "Website" view. Update your view level filter, change it to ...
GeoffAtkins's user avatar
  • 2,277
2 votes
Accepted

Password protect specific files on root of website

I read that the htaccess/AuthName text does not get displayed on the login popup on chrome so I need an alternative. The "alternative" is to role your own authentication system (which could ...
MrWhite's user avatar
  • 42.8k
2 votes

Why do I have to enter basic authentication credentials twice for WordPress with .htaccess?

I think the reason can be much simpler than in the discussion and comments: Check that the URL is exactly correct and the same. Sometimes, if you have set a non-www URL in WP but open it with a www, ...
Thomas's user avatar
  • 69
2 votes

Using dynamic content in Wordpress by decoding and using a JWT passed on the URL, without logging in any user

I came to the solution by myself. I'm sharing it here just in case it helps others. First of all I installed 2 plugins: Plugin 1 is Block Visibility, by Nick Diego. This will allow me to very easily ...
Xavi Montero's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible