Tricky...
It makes sense, but some might take offense. Then again, it's probably too much to expect you or you and a couple other friends to pay for everyone...
I would go with simple honesty as the best policy, and explain clearly on the invitations that it's a pay per person kind of affair.