I'm an evening/night shaver. Around my place, that it the time when I can relax and go for something between a DFS and BBS. It isn't as smooth in the morning as it was the night before, but it is still better than any electric can deliver (and my beard grows FAST). Is it a case of you actually seeing stubble in the morning or just that it isn't the fine smooth skin of the night before. Look at those around you. I'll bet that until midafternoon you're still the smoothest guy around. Put away the carts and relax.
I feel this way, too. I am not a morning person and would have to share the bathroom with SWMBO so shaving would not be the relaxing, quiet time that I relish.
While I may have a little bit of stubble in the morning when I go to work it isn't anything that others would notice unless they were totally invading my personal space. However by mid-afternoon I notice the shadow coming back.