@neil HSBC requires the app for me to login on their website, although it's possible that I opted in into that and there is no way back.
They were happy to send me a new security key today, and that entailed deactivating the mobile app provisioning, so hopefully the combination of the two will let me log in using the key they will send me :)