Just to say I think I finally solved my issue today.
I followed this tutorial
http://www.prelovac.com/vladimir/wordpress-optimization-guide which knocked about 3 seconds off. Then I went through my plugins again, and found that UAM was responsible for a 4-5 second delay on loading times because of how it protected the content.
I installed an alternative and down to a max of 2 seconds per page.
Massive thanks to Jason, Sarah and Dave for their help