He will never change. His ideals are more important to him than you or your feelings, or even his grandson. It is sad that it has to be that way, but it is a choice that he is making. You gave him plenty of time. It is time to be a real married couple. Go places together, and those people that cannot accept you obviously don't treasure your company the way they should. It is so hard to love someone that doesn't love the real you back.
I am so very sorry that he is hurting you this way, but you really have no alternatives. Holidays are celebrations, and we celebrate with the people we love. You moving 16 hours away has made it easier. Now you can tell your son that his grandfather just lives too far away to see. And I would NEVER have him spend time alone with your dad. Your father will try to make him feel bad about the two of you, and that is just too destructive. I would be willing to bet that your dad asks if your son could spend a few weeks at his house without you. Please don't do it. Tell your father, the next time you see him will be when he comes to visit you and your partner in your home.
Good luck, and I'm sorry. This must hurt so much.