OK ... I admit that's a potential problem. The dice are somewhat loaded against you given the modern climate in these matters.both my supervisor and manager are both female
This could even be some kind of scam to make out you were harassing the customer. (Unlikely, but why take a chance?)
Time to pass the buck. Calmly report the facts to them and ask for instruction on how to behave.