The UK wouldn't just be harmed if it lost full access to the EU's single market after an "Out" vote in a referendum. The divorce process would cause further damage because it wouldn't be clear what the people actually wanted and negotiations with the EU could turn acrimonious.