Has this always been the case? Or has he changed. If he has changed, then something is going on with him, and I would sit down and have a talk. If this is how he has always been, than you should already known this. Some people cannot give affection, nor do they want it. I feel alot of it has to do with the way they grew up. Some people grow up in familys where they hug and say I love you, alot, than theres some that never show there affections at all. It may be from that. If is upsetting you, you need to talk, because no one likes to be rejected, and how long can you put up with that? You probably will get tired and move on to someone else. So the best thing is to talk, and maybe get help with your relationship. Good Luck