I think the point is that one can be attracted to someone without them having an attraction for that person, but simply a means to have a pleasurable sensation.
I've heard of all kinds of things men use to have a pleasurable sensation on their doohicky.
blow up dolls
barnyard animals
their own hands
The funniest one I heard was using a watermelon ----- cut off a small hole in the rind at the end and go to town on it!
I don't think any of them had an "attraction" towards those things, but were simply using them to scratch an itch, so to speak, in lieu of having what they really wanted readily available.
And has nothing to do with them preferring those things over a woman.