Hi @SevS, welcome to the forum.
I've been dealing with a lot of guys thepast couple of years who had a lot of trouble with GPs resistant (or refusing) to test them for prostate cancer saying that in their 40s and 50s, they were too young to worry about it. Only to find out later that they had it. GP's aren't perfect and can make assumptions so if you feel like a doctor (even if it a specialist rather then a GP) then continue asking for some tests. If they don't, get a 2nd opinion. You have every right to know for sure.
Do you feel comfortable saying what it is that makes you think there's more to it? It's no problem if you don't. I think moving constantly when you're growing up, making it difficult to form connections with friends for very long can easily lead to issues as an adult. I'm in my 50s and still suffer from problems related to not being able to form connections with anyone growing up. Mine had nothing to do with constantly moving but there's possibly some similarities with attachment issues.