The Financial Services Compensation Scheme only applies to UK banks, UK building societies and some UK operations of foreign banks. It does not cover offshore accounts. It is also possible that it wont cover a UK account that is not opened in the correct name.
If you are concerned about the guarantees, you should avoid the Channel Islands where there is none and the Isle of Man where it is limited to 75% up to £15k.
In my opinion, you should be 100% certain that there is a tax advantage for going offshore and, presumably, using a bank that you have not dealt with before. All UK banks and building societies will pay interest gross if you are entitled and if you fill in the right form. Fixed term bonds tend to offer the best rates.