I can smell phantom smells through my nose directly it seems, like I feel the sensation of detecting some smell directly in the neurons connected to my nose. Not sure if that's the same for you or others. It's not in my mind per se, at least not initially.
So it's easy for me to imagine people who don't have other "mental senses", maybe that works to explain it to other people.