You have been bad and you deserve to be anxious about it. I suppose you can justify snooping in your boyfriend's private mail because you obviously don't trust him. Whether that lack of trust is in itself justified, I can't say, and I doubt that you can either, or you wouldn't have been snooping into things that happened before he met you.
Deleting his old e-mails was a very wrong thing to do. You can probably escape the blame if you keep your mouth shut about it and possibly tell a few lies if he mentions it. But is this how you want to manage your relationship?
You have to confess to your misdeed and take your lumps. You have betrayed his trust and shown disloyalty, and he will have to make an effort to forgive that. You have destroyed something that was his that you can not replace. The reason he kept those e-mails is a separate issue that should have been resolved in a vastly different way. There are good and bad reasons for saving those e-mails, and your pre-judgement of his reasons without knowing them shows us much more about you than it does him.
He is very lucky to find these things out about you before you two got married. I see very little hope for your relationship if you are so insecure and jealous, and that you are willing to show so little respect for him. You have a lot of personal issues to work on if you ever hope to be happy. I hope that you do work on improving yourself as you deserve the same chances for happiness as everyone else.