My Google search traffic has been growing consistently for months without any hiccups. Then a few days ago, Google dropped my traffic by about 80% in one day. The traffic would then later rebound several hours later or the next day, only to drop again for a little while, then come back.
This of course concerns me, and I couldn't figure out what the issue was at first.
I implemented another subdirectory on the site with a lot of new content a few weeks ago.
After running some tests, I realized that many of the links in the new subdirectory have foreign characters. Google then URLencodes them.
So for instance, I link to:
And then Google URLencodes it as:
The problem is that the second URL is too long and is causing server errors from too many redirects. When I fetch these URLs in search console, Google cannot render them.
Search console began reporting these errors about a week ago, which went unnoticed and so I think it's possible that this is what has caused the Google flux traffic drop.
There are millions of links on the site like this, and so to save the website I removed the new content directory, removed all of the links, and am 302 redirecting all pages in that directory to the homepage. Google is now able to fetch these URLs and is showing that they 302 redirect to the homepage.
I could shorten the links of URLencoded URLs and this should fix it as there are less redirects, but I'm afraid of putting the directory back. Because if Google has a bunch of these longtail URLs queued up, they'll continue to report these errors and I risk another traffic drop.
Are there any good solutions to this problem? I would like to be able to put the content back up and remove the 302s, but I don't know how to fix the server errors of too many redirects. I tried the URLs on two different servers and both had the same errors.
Can I change LimitRequestLine in httpd.conf to allow for longer URLs? The httpd.conf file says "Direct modifications to the Apache configuration file WILL be lost upon subsequent regeneration of this configuration file, or an Apache update." If the configuration file regenerates/updates then these errors will keep happening. Httpd.conf says "To have your modifications retained, you should create/edit administrator-specific include files:". But I don't really know how to do that and am afraid I could ruin the server by messing it up.
Is it possible to remove URLencoding characters in htaccess before the server redirects? Or do the server URLencoded redirects happen before htaccess mod-rewrites?