How do you know it's time to end a relationship?

My bf and I have been together two almost three years; I have always been very upfront about wanting another child (I have two from a previous, he has one from previous). I told him it was a deal-breaker for me. I had my two very young and did not get to enjoy my pregnancies. My kids are now 10 and 11, he is 7, and I keep bringing up wanting another. He has always said later when the time is right. Well, we no longer have the roadblocks that have been in our way, and now he tells me he doesn’t want kids. I am hurt; I feel betrayed as he lied to me to keep me around. I already know the struggle of having kids with the wrong person; my question is…do I stay or do I leave? Is this something worth hashing out? Part of me feels like I can’t trust him anymore.