First, you having your baby with him is not the reason these problems are prevalent. Just being young and being away- especially within the first years of marriage is going to be trying for anyone! Those years are going to be filled with arguements and tears! If you love him and he loves you (and make sure you both feel the same) then it is possible to make it through this.
Secondly, you have to ask yourself and he needs to think also about whether you both are the kind of people who can make a long distance love strong? I am not that person. Sometimes being honest with yourself is important. If you can and if he can then you both need to focus and try harder. If you feel ignored by him or that he wont listen to your concerns then maybe he doesnt love you to the same degree at which you do.
Marriage is sacrifice and if one is willing to go to counceling and the other isnt, then its not meant to be. Thats tough! no one wants to "give up". But my momma always told me, "Girl, you have to learn how to pick your battles, fold your cards, and swallow that lump of pride thats sitting at the top of your throat."
Good luck!