If you're right, you've identified something that explains part of what makes you who you are. If you're not, at least you'll have some extra information and the pros can point you toward other possibilities worth investigating. Easy for me to say not to worry about it from this side of the keyboard but in my opinion, there aren't many bad outcomes here. You'll probably come away with a better idea of what's going on and, if this is your goal, treatment options.
People can make mistakes and misinterpret things too (even if they have fancy diplomas and letters after their names). Not suggesting going doctor-shopping for the answer you expect but there's nothing wrong with getting another opinion.