Well, if you fancy (fancy, fancy, I wonder if we're British) the guy, and he fancies you, maybe he isn't in a happy marriage after all. As I've read on your other posts... a truly happy person in a marriage has no interest in anyone but his/her partner.
So get in there and be somebody!