If you want security, you should stick to mainstream, high street banks and building societies that are covered by the FSCS and keep balances below £50k.
The FSCS only covers UK banks and building societies. There is a depositor protection scheme on the Isle of Man but there are none yet on the Channel Islands.