rel="noreferrer" doesn't affect security.
It is for your own privacy (or for being secretive).
If your page has a link to a page on site-X, when someone clicks on it, the log file on site-X will record the fact that your site provided the link.
Generally this could be considered a good thing.
For instance they might notice that they are getting many ...