What about a diaphragm with spermicide? You could use condoms as well; it would provide some extra protection and help to ease your worries. I used a diaphragm as backup for a while because I was paranoid and didn't trust the bcp
I did have some problems with uti's and an occasional yeast infection while I used the diaphragm, but that may have just been me. I got mine at Planned Parenthood; you have to make an appointment to be fitted for it since they come in different types and sizes. I don't remember how much the diaphragm cost; it's been a several years since I got mine. But it might be worth checking into if you can't take the pill and just need something temporary.