If i were in your position, I’d find new counsel.
Give him custody ? Then she can have a schedule with him