I am not sure what you can do since you allowed this arrangement to continue for so long. Is he the father of your son? Doesn't he feel a commitment or at least responsibility for your son? About the best thing you can do is to go for counselling.