I always look for a few things: Reliability, Support/Knowledge, Price - you get what you pay for really.
Like hostingsource.com SSDVPS hosting. Their website is convenient, user friendly and most of all they will get you setup up in a web site hosting package that's both affordable and reliable.