In US I use this: http://www.qualityhostonline.com
Dependending on the sofwtare you need to install you better evaluate the advantages to get a normal webhosting service rather than a VPS. See your previous question.
If your software is PHP script, PERL script written by you or third parties scripts/web apps (i.e. Wordpress, phpmail, swift mail, ...) you can do this perfectly buying a normal web hosting plan (and it's also cheaper).
ps1: YES FULL CONTROL! But many Apache/PHP configurations can be also changed as well with a normal web hosting plan. On cPanel (or other control panels) for instance you have many features that let you modify Apache handlers, MIME types, redirects, subdomain, etc. Moreover via FTP you can modify as you like the Apache .htaccess files in any one of your folders rewriting the Apache config with your rewrite rules. But true on web hosting you can NOT access the main Apache configuration, on a VPS you can, but think also that if you don't know what to do, it might be better you are not able to change the root Apache config. :)
ps2: only LINUX. :)