We are considering upgrading to either a dedicated or cloud server.

What I would really like is for the hosting account to have SVN installed on it. With a UI that I can use. So when I make a change, I can create a branch on the hosting and develop on the private branch. Then when I get everything right, migrate that branch to the main site that everyone sees. And also be able to role back if I need to. I would like to have a UI in the site admin for this.

Is there a hosting service that provides this?

If it matters we were looking at rackspacecloud and we will definitely be using a LAMP (linux, apache, mysql, php) stack.