Oddly, most of the "shoe fanatics" I know would consider AE shoes the "bottom end" of "good shoes", so not something that particularly commands a premium.
This is my first thought when I saw the title. "AE premium?" I'm not even remotely a shoe fanatic either. I actually have some AE loafers myself, generally becuase they weren't overly expensive.