Some doctors and specialists are just awful. Others can be very supportive, it's luck of the draw. I've had some "deal with it" ones and others that are wonderful and reassuring. Keep changing till you find a good one.
Having a little bit of control over your thought process is a great improvement, well done. You're now tackling this with a wisdom that will help you in the long run. Keep going with the introspection around your triggers, and the knowledge that anxiety will pass if you are patient. I also find the 4-7-8 breathing technique is excellent for anxiety. Look for some guided meditations that use it, remembering meditation guides are luck of the draw too.. find one you resonate with.
SSRI's, when they work, just give you that bit of breathing space to work on yourself. They don't fix everything on their own but they make it easier for you to help yourself. You'll still have ups and downs in life but hopefully the average level is higher. If you're averaging 4 then you're having some pretty terrible days. If you're averaging 6, then you're in a pretty good place and can deal with the occasional crappy day a LOT easier too. It'll take some time, and some work, but your long term average should start improving.