Firstly when you're married it's a different story so no matter what urges you had, you should remember the vows to your husband and most importantly to God. I think he's kinda wrong to avoid you like that I think you guys should have talked about it and come to a decision about all this. However, he may be feeling guilty about being your boss and seeing you everything and all that so maybe thats why he's distancing himself