Getting a Virtual Private Server (VPS) seems to be very popular. They are actually fun to play around with. I’m currently using two Amazon Web Services EC2 instances but there are heaps of options out there.
Here are some links to VPS offerings which I have investigated:
DigitalOcean
Linode
Binary Lane
Amazon Web Services EC2
1984 Hosting
List of VPS providers