Can someone withdraw money from my PosoMoney account?

No. The money cannot be withdrawn on your behalf as the withdrawal process is initiated by you on your handset using your PIN.