It would generally be during some sexy talk leading up to a first encounter.

I think it's the opposite of telegraph it for me: they think a small guy might be bashful and nervous around sex or nudity, so when I don't display those traits, they assume the opposite.