I'm no expert, but I think no. As far as I know the semen goes through an improving process anyway to increase chances of conception, and if the last count wasn't particularly low, I tend to think it will not greatly influence your chances of conceiving.
And anyway, it is what it is, there's little point in stressing about it. He is after all human :-P
Good luck! May you have a nice, long, boring pregnancy beginning today