How can I get more comfortable with men?

You have what is normally referred to as intimacy issues. You want to be close to people but don't know how. You really need to speak to a therapist that can help you learn.