Breathe ... been almost a month, maybe too late for me to respond to try to help? Come back and update us if not too late and/or to let us know how it worked out.
One thing really stood out in your good summary: you did not give a single statement or fact that indicated you had ANY FACTS or ANY BASIS that you think he cheated on you. In fact, you did not even imply that you think he has.
That leads me to think that this fear of yours was unwarranted and excessive and reflective of your insecurities, fears and perhaps your own prior life experiences (about things/people you lost in past).
I know you say he cheated on others, but we don't know (and you might not know the details on that or how he looked at those ladies compared to how he looks at you ... those could have been not so serious or not seen as possible "forever" type relationships and it might have seen you as possible long term and for that he might have been successful.
You also did not say his age and young boys tend to want to experiment and try out as much as they can ... part of learning and maturing. Cheating on g/fs in those young years might be atypical of what he would MATURE to be in a serious relationship that he might want to be marriage and children possibilites in his adult life.
I can tell you from personal experience, an overly jealous women can drive a man crazy. I had a wife who would freak out just because I would look at the girls in bikinis (just look for a distance, nothing more) on Daytona Beach. Personally, I think she should have taken me to see a doctor had I not looked like almost every other man on the beach (or why else do they wear those and sell them?). She completely ruined a vacation with the kids to Daytona over that and it made me furious. That never ceased and it ended the marriage. I would NEVER want to have any relationship with a women with a jealously issue again. So, I can see why he might have walked off, especially if he had been loyal to you and got his past thrown in his face or suspicions raised frequently.
JEALOUSY is one of the nastiest and most destructive of all human emotions.
I suggest you get some counseling on it with a profession (psychologist), its not overly complex, not requiring a psychiatrist or medications or expert. Just talk it out and see what "seeds" you might find in your own background that is causing you some possible subconscious issues and then deal with how to view realities vs mere speculation and how not to obsess over speculation and what to do to fight off jealously from wrecking you or your relationships.
Rob