From what you say it seems your relationship with your boyfriend is still at the beginning stages, and it sounds a bit early to be upset about the parents' reaction just yet. Give it a little more time, especially as you mention that your boyfriend doesn't like to talk about his parents too much. Maybe he has issues with them you are not aware of, maybe they are angry at him for reasons you do not know.
After a few months, maybe you should all go out to a nice dinner out, and start a relationship with his parents. It might be easier than going to their house or inviting them to yours.