Yes.....Worry about him cheating on you again. You know & you understand what he's doing & on so many levels it's wrong.Don't allow him to do these things to you, most of all don't take yourself throught the drama. I'm sure he's not worth it. I've been in a situation almost like this and i still seek answers from him about it, but when you do get those answers you have to be able to deal with them. The complaints about the other women are in his eyes to make you feel better. The key is for you to know what you have to do & worry about your what's good for you.