To make the site a bit faster I've downloaded and installed wp-cache. It's supposed to cache frequently accessed pages (like the front page) and potentially speed up the site a lot. Hope it works, you can comment below if you think the site is slower or faster than before.
This seems like something so central to wordpress that it should come with the default install?