So I was having your exact same problem but with my boyfriend.  I guess eventually I realized if I'm not always rushing out the door, and I take a few minutes to say bye in the morning, let him know when I will be home for the day, and give him a big hug when i do get home he felt a little less neglected.  It doesn't take a whole night out of your work week.  It just takes a quick second to show that you wish you could be with them more.