Why is hearing the only sense that deserves mention when acting on impulse or without plan? "Play it by ear." Don't carpenters or safe-crackers ever say "Fiddle it by fingertip"? Don't cooks ever say "Cook it by tongue"?
Apart from the potential sexual confusion, of course.