I understand your anger. Your husband should have come clean before your engagement, not just before your wedding. Does it seem like he held on to her as long as he could? Do you know when it actually ended? I would perhaps believe it has ended when those clothes of hers are handed over for you to get rid of and her pictures the same. What do you think??? I suspect he hasn't emotionally let go until he does just what I said above.
I'm not doubting his love for you or his wanting to be faithful to you, but he still shows an emotional attachment until he turns the above over to you his wife as a sign that he is through with the past relationship. Ask him for any negatives also. This PAST must be totally put behind both of you before you have a ghost of a chance to have a real marriage. No wonder you can't accept this and you feel like you are going mad. Things must change. You have a right to tell him this. Tell him how you feel and this is if you want this marriage to go on.
It is never a good thing to make an important decision of any kind, especially such as spliting up a marariage in a time of high emotion. My first suggestion is for you to go somewhere and talk this out with a good counselor (best) or at least with someone with whom you can vent all this anger you have over this situation and allow yourself you cool off and to think through what you want to do. You still may want to end this marriagae. But you may realize how much you love him and if he really comes through in the right way, you may give him a chance to show how much he loves you. Only you know if he is worth it. Surely your marriage is worth some time to think it over. Maybe the two of you could go for marriage counseling counseling; if he is what you wanted to marry he may be worth a fight to keep him.
You need some kind of help; don't let yourself go mad over this. There is help out there. Find some and made intelligent decisions. Best wishes Funguy.