Believe me, if it bothered anyone I happened to be working with I would refrain. That being said, most enjoy partaking in some form of our beloved brown leaf!
Then there is always the outstanding joke when someone is asked if the smoke bothers them and they answer yes they are told to find a new line of work!
That is an excellent point... and when I was smoking 2 packs of Camels a day, I was far more tolerant of campfire smoke than I am now.
I can see how being a non-smoker could present issues, no matter how good your PPE is.