Hello @Carlachris 
I am sorry to hear how hopeless you are feeling around the situation with your partner.
From what I gather, he has Aspergers and other MH Issues? Despite his developmental and/or mental health difficulties, being subject to verbal abuse is not okay. If you or anyone else he interacts with are ever feeling unsafe, I would strongly suggest for you to reach out to Crisis Services (i.e., 000 or 13 11 14).
I can hear that your partner has some level of MH supports in place - this is a good start. However, I am uncertain as to whether you have any supports for yourself? If you feel you need extra MH support it may be worth giving our help centre a call (1800 18 72 63) or using our webchat. We are open 10AM - 10PM, Monday to Friday EST. You could also contact 1800 Respect given your partner's stated anger problems and verbally abusive behaviours. I'm positive both of these services could be useful to you.
I am glad that you have been getting community support from @Mrsjones and @Former-Member. Please feel more than free to continue to reaching out for support on the SANE Forums as no-one deserves to go through what you are alone.
Kindest,
Amour_Et_Psyché