Had Mirena put in 10/2007. I had mild side effects cramping, blee...

Had Mirena put in 10/2007. I had mild side effects cramping, bleeding etc.. they went away and everything was okay for a couple months. Recently, I started having issues, I haven't had my period for 2.5 months which is okay, except that I feel like I still have an 'emotional' period, and I constantly feel bloated. Mostly the problem is I keep getting yeast infections, and have an odor that won't go away no matter what I do. I have slight skin irritation- which I NEVER had before. My husband also thinks it has affected my moods drastically, made me depressed. I am thinking about having it taken out but don't want to give up having reliable birth control- plus my period is gone and I don't have cramps anymore!