Open relationship change of heart!

I told my husband he could sleep with another women. I told him I didn’t want to know anything about it. When I saw a text from her it got the best of me and I looked at them. I was hurt that he was flirting with another women. I told him I couldn’t handle it and asked him to stop. He now insisting that he just wants to be friends with her and wants to be able to text her. He says he wouldn’t have tried to sleep with her if I hadn’t given the okay and now has lost a friendship. He works with her. I told him I’m not okay with him being friends with her. I understand it was my fault for telling him we could have an open relationship and then changing my mind , but am I wrong for not wanting him to be friends with her?