Dont use a broker with a limited panel although it is better than talking to just one lender.  Make sure the broker is Whole of Market and does not charge you a fee. If they do find someone else.