Honey,
This man, whoever he is, does not seem like someone you want to be with. To me, your words tell me that he's violent, and is apparently not sober to often. He is obviously not the best person to be a father figure in your children's lives. You are not at fault. Getting back together with this man is basically giving him the premission to throw you around. Stand up for yourself, I'm sure your a strong woman. If you need to, stay living with your mom till you can get a job and your own place, and STAY strong.
If I were you, I wouldn't give him the time of day. Don't let yourself get all confused and messed up on the first person that has ever loved you. There are better out there.
Good luck honey!
-Elizabeth