Can we suggest you look at some of the companies we use?
Virtual private servers from only $5/month. Good for serious web apps as well as simple sites. You can also rent a server for cents an hour to test your ideas.
Note: the above are affiliate links to companies we use. Signing up using these links helps pay for the cost of this page.