I think that you should tell him and at the same time ask him why he saved all her emails but do not save yours, I also think that there also other things that he is hiding or keeping from you.
I would let him know that you know about this person and let him tell you if he will.
good luck in what ever you do