EU vote is no ‘parlour game’, UK finance minister warns