It has little to do with being horny :-)
Cats tend to groom other members of the group, particularly in places where it is difficult to groom oneself, like the throat or behind the ears (even cats can't get their tongues there...).
Your cat is showing you he's a part of your family and that you're a part of his. You can reciprocate by scratching behind the ears or tickling wherever his favorite spot is.
I don't like it when they groom me, because their tongue is really coarse and it can be quite painful sometimes.