Calm words won’t stop bankers leaving London