I would normally look for in below order:
Support (Technical support is very important), Value for Price (you will get what you pay for), Uptime, Reliability!
I Saved Big on HostingSource.com Web Hosting - 50% off 1st month on all Servers/VPS plans. The tutorials are helpful. It's a great service.