Unless you are aware of a cancellation fee on your policy then go ahead.
Premium have reduced over current years so you can probs get it cheaper or re-advised to suit your circumstances giving you a more affordable premium. you are not tied in to life insurance. get on the internet and start searching for a good INDEPENDENT company to advise you or speak to your IFA just encase he can find something cheaper.