When you say 'left me with all...', do you mean divorce? If so, you need to draw up an agreement, equally dividing the outstanding debts accumulated during your marriage, both of you refinance these amounts into your own names (taking the other off the debt in doing so), and then closing the old accounts with zero balances. Have this arrangement written into the divorce agreement, so that if your spouse (or you!) do not follow through with the agreement, that person will be held in contempt of court and face severe charges for defying the judges order. Sadly, the debts incurred during your marriage, and especially the ones held jointly in both names, are the responsibility of the both of you, no matter that he is the one making the bulk of the charges. Now, if you are NOT getting a divorce, you need to urge him to pay off the debts so the cards can be cancelled and he can then get new ones in his name only. However, you are still married to the guy.... I would just destroy the cards.