I only had it happen once.... but my skin didn't recover fully for three weeks.. and I'm not exaggerating. It sent me to my dermatologist..... and I've been using unscented soaps since.
Yikes. I don't blame you for being paranoid then. Luckily I can use scented products but I have to be careful about them. There are loads I just avoid. Not just because they aren't my thing but because they seem more risky to me based on past experiences.