Can we suggest you look at some of the companies we've used?
Simple web hosting with the best incoming spam filtering we've ever experienced.
Virtual private servers from only $5/month. Good for serious web apps. Can also be rented by the hour to test out your ideas.
Note: the above are affiliate links to companies we've used. Signing up using these links helps pay for the cost of this page.