I have sort of experienced it.
Scenario 1:
I don't have agoraphobia, but I have social anxiety. When I visited a country where the primary language wasn't English, I had a hard time going to places that required me to try and speak (and inevitably have to tell them that I can't speak their language the moment it went beyond "hello please thank you"). Unless I had strictly planned something and scheduled it, I would spend my time in the hotel stressing out about how I'd probably have to talk to someone so I wasted days of my trip trying to get up the courage to go out. Skipped meals because I couldn't bring myself to face the interaction of buying food.
Despite the issues and regret about not making the most of it, I'm still pleased that I went and proud of myself for the things I did manage to do. I was hugely stressed out a lot of the time but it ended up being heaps worth it in the long run. And I got a bunch of stories out of it by reframing the problems as funny misadventures which is something that comes naturally to me.
Scenario 2:
Over xmas/NYE I always visit my family who live interstate. I typically regret the way I spend my time over these holidays and regret choosing to spend that long with my family when we inevitably start to rub each other the wrong way. This year I have a plan on how I'm going to spend the time there in a way that feels good to me, so hopefully I've learned from the mistakes of the past (I'm a bit thick so it took me over 5 years). It will mean doing more things out of my comfort zone but that's how we grow so I'm nervous but pretty hopeful about it.