I think that what this story teaches you (and me and everyone else who read this) is that in most cases, seeking reassurance in other people doesn't help. We all make conversations in our heads that sometimes makes us feel bad about ourselves, and having people sometimes saying something very small effects us in a very profound manner, not because what was said was so horrible, but because it somehow strengthen our fears about ourselves.
I think that this is a good time to not relay on your emotions but to try and see this logically.
The conclusion is this - a bunch of people told you this is not a big deal, both your friend, the person who made the remark, people on this site. So trusting the vote of the public. I guess it's not a big deal.
Yes, move on.