For years VPS has been a great middle-of-the-road server option and will continue to have a place for years to come. You get the best of both worlds as far as performance and price is concerned.
The picture below is an excellent visual showing the differences between Type 1 & 2 hypervisors (VPS) and the newer Docker containers people are steadily going for. If you’re a newb then basically the fewer layers on the stack is better when it comes to using less resources. So the Docker container on the right is clearly the direction to go.
However, that does not necessarily mean a docker will be the best choice for you. Both VMs/VPS and Dockers have their trade-offs. Whatever you’ll be using it for, then learning all the pros and cons will help you determine which works best for you.