I haven't been on any type of birth control in 9 years. I stopped...

I haven't been on any type of birth control in 9 years. I stopped because after a year of oral contraceptives I was keeping a yeast infection. Since I wasn't sexually active (I was using the pill for cramps), I discontinued the oral contraceptive and the infections went away. I am getting married in November and need to start on some form of birth control. I tried the NR on a recommendation from a friend. In less than 24 hours I had a raging yeast infection (swelling, discoloration, itching, burning and some mild pain). Taking diflucan has helped, but not made the infection go away completely. Should I take out the NR / will it mess up my cycle if I take it out now??? I don't know if I can stand it much longer!