I've published 3 simple steps you should try out to really boost your blog's speed :
http://blogosquare.com/2007/07/04/3-really-simple-ways-to-speed-up-your-blog/
I really think there are lots of tips to gain in speed but the ones I mentioned are the first, one should consider before optimising further more.
Feel free to leave your feedbacks.