Does your past influence you? Hm, stupid question. Of course it does. But where is the line between real influence and using your past as an excuse?
If your childhood was let's say .. not good and you feel bad because of it. Can you blame it for being a not normal person? No, not a psycho or some mad killer. Just not normal in society, not being good in communicating with people, making friends etc.. When a normal person finds it natural to speak to people or chat you have something inside that block this natural feeling, you are always afraid to say smth wrong..like you're afraid of making some stupid mistake. Maybe the fear that people will think about you smth wrong (like as they don't :)) is too strong in you.

About relationships with men.
If you didn't have a father would it put you in an awkward position in them? If mother's boyfriends were not so interested in having parental relationships with her child? And let's say mother wasn't interested in having parental relationships with her child either? Maybe it has an influence on a person's opinion on how much do other people need him? And in this case I'm afraid it is zero need. Perhaps a person doesn't think he'll be needed by anyone, both female and male.

But with male the situation is more difficult as the person doesn't have much experience in communicating with them.

So where is the line?