Row over future use of former bank