Here's the thing:
More compression of a page means more work of the server CPU. 99% of my website for most visitors is gzip compressed.
I have made error pages which are not compressed. They use 2 KB. At first I thought about compressing them so they're 1 KB or less while maintaining HTML structure but I'm not sure if this is a good idea.
I'm actually not sure what approach to take with compressing very small documents because if I compress them then the server might be spending too much CPU power on script kiddies and this can increase the time to first byte for loading new pages. If I don't use compression, then I'll be using more bandwidth. All in all, I'm trying to make my site faster for everyone.
So my question then is What is the smallest size my HTML document can be before compression becomes overkill?