The backend is build using Django. I don't have a fancy CMS or anything similar, just the good old Django admin interface.
I have exacly three Django models. One for the posts, one for the comments and one for the categories. So the backend is also really simple for now. I will probably keep building on this and possible build a very simple CMS to make the publishing even easier.
I have used Digital Ocean for years and I really love it. They are really cheap, the customer service is great and you can choose the location of your data center.
If you want to try Digital Ocean for free, click this link. This is a referral link. If you click it and sign up, you will get $10 to use. This will last you two months on their cheapest servers.