If it bothers you, then tell him you are leaving and you will give him a call when you when you see if divorce is final.