My brother and I were named POA for our Mom.
My brother and wife complain that they need help, but will not use her money to hire providers to help them.
They also will not allow me to take her to my house.
He says we both must agree because both are POAs.
It sounds as if his goal is not your moms care but protecting his inheritance.
I almost think I would back off and sent a letter to the lawyer and to your brother that you are withdrawing from POA.
If you can not provide what you think is the best care for your mom, the safest care then you are not doing your "job" as POA.