From the banks point of view as things currently stand, they won't be too concerned as they cannot really be accused of any wrong doing providing your genuine signature is present..... as the accounts are held in your name and providing you signed, then the bank would be totally vindicated.
However, the money belongs to the organisation which could quite easily be proven and you are legally in charge as things currently stand, if you sign documents that allow other people to withdraw cash or direct funds...then you are still legally liable and accountable should things go wrong.
You need to address this situation as above, to discharge your legal responsibility for your own protection, should the money be improperly used or withdrawn for others personal use......otherwise you could become this firms fall guy.!
I hasten to add, should any discrepancy occur or come to light, you will be the prime suspect and the first door the Police will come knocking on asking for an interview.
It is a highly unusual situation for any organisation to terminate someone's position, yet still leave them in control of the finances that they used to manage as part of that same role. I don't want you to become paranoid.....but do you not smell a Rat ?
You must have misgivings otherwise you probably would not have posted your question........I certainly would, and would never in a month of Sundays have allowed myself be placed in such a compromising position.