I spent all my 20s trying to fit in, and I have been even quite successful despite something that was heavily holding me back.
Turned out that out, for me, that I was pushing myself to interacting in habitats and crowds I did not like at all. In some way, when you don't fit in a social group, it's also the social group that doesn't fit with you.
But if you keep going against yourself, you're probably searching the kind of comfort zone in which you can tell to yourself "hey, I'm fitting in, or at least I'm trying.. someday I'll be a part of this game and I'll get pussy and shit".
You have to find the lifestile that suits you the better. And if it is a more lonely lifestyle, it's not a great deal, it is the opposite, actually. It's hard at beginning because knowing yourself better IS going far away from your comfort zone made by "hey, am I looking good? Am I interesting? Am I well integrated?".
Took mushrooms too, I was 25yo, after a period of great self enquiry. Did it just one time, I'm not into drugs of any type.
There isn't any "wasted time" more wasted than the time that you invest trying to be someone else.
Talking about girls and hook ups: I honestly reached a state of mind where I'm not horny if I don't meet a girl that I like and with whom I would like to have sex. And I didn't find a girl like this since 3 years ago. Do I suffer solitude? Meh... It would be great to have a parter or a hook up, but my dick isn't signaling me anything worth the effort. The thirst has gone.
Self help rat race is the heaviest proof you don't have self-worth.