No, the only things that hurt your credit are:
Late or non-payment of bills that report to Transunion, Equifax, and I cant remember the other one, high debt to income ratio (DTI), foreclosure, bankruptcy, and even too many requests on your credit can bring it down.
I'm surprised they haven't closed your account already due to inactivity.