If you want to permanently lose weight, you have to exercise. There's no two ways about it.
I would not bother counting calories; instead I would concentrate on eating the right foods. If you need some help in that area, check out: www.thepaleodiet.com
As for exercise, start with some walking and a bit of weight training and take it slow at first.
