Elderly Protective Services wants to take away my conservatorship. What can I do?

My dad was being neglected for almost a month at the nursing home. Finally, on Saturday, they failed to set the alarm on his bed and he got up, fell and hurt his face/ head. He has had a stroke, previous head trauma and seizures. He was discharged on Sunday and I decided not to send him back, especially because they claim they were going to discharge him by Tuesday, anyways. I did ask the hospital doctor if he felt he was safe to go home and he said he did. Now Elderly Protective Services wants to revoke my conservatorship for taking him home AMA from the nursing home. Help!