You need a new partner. Sex should be mutal and loving. The only way he might be justified in complaining would be if he were buying a hooker. You can do better for yourself.
