Hello mate, I can relate to being told 'i am like my father' and, it was a cruel insult from angry mother to, absent father vs child of father.
I have gotten a lot out of treating abandonment, depression and low self worth through finding ways to form a positive self image inside my mind, and to truly investigate, understand and explore how my mother rejected me so that I could find acceptance in other places. Peace and healing in my own heart. Rejection and sadness still arises, but I know WHY it is there now.
I hope you can find some men you can see as friends or role models, there's heaps of men doing social things like table games for indoor people or sport for outdoor people.
Reparenting and self love can be a very nice way to fill in the gaps of yourself where parents did not love and nurture. And in my saddest days I look into myself and think, YOU never gave up on YOU and YOU turned your life around from 'deleted by parents' into 'a person who turned their life around from horrible to ok'. It is a pretty good feeling and my old feeling inside was "bad kid who deserves a bad life" because thats what my parents indoctrinated into me.
Good luck friend and be kind to yourself every day.