Microgestin 1/20 and panic attacks

I have been on Microgestin for 6 years now. I had slight anxiety before I started taking it, now my panic attacks are out of control, I have no sex drive, and I am completely exhausted all of the time. I am only 24! While speaking to another woman at work, she informed me that once she stopped the Microgestin her panic attacks almost diminished completely. Do to my family history, I know that I am prone to have anxiety, but I was diagnosed with Agoraphobia a year ago,I have to drag myself out of bed, and try to work through my panic. I am stopping the pill. It is good to clean your body out for 3 months after being on any birth control pill for that long anyways. Wish me luck!