It does seem a little soon, but the best way to get through this spot is to talk to him and tell him that it wasn't your intent to scare him. While you may love him, understand his side that it may not come as quickly to him. Some people have been hurt and are gaurded, you have to give room for that.
I think that maybe until you both have resolved your feelings of love together, it may be time to place the I love you's on the back burner for a while. The ball is kind of in his court now, so it will be up to him to let you know when he feels the same. Make sure not to push the issue and enjoy your relationship and have fun, this is just a bump in the road.
best wishes.