You might want to get that checked out, it could be a number of things..,
Why do they not want to be how they are? I am bi and I still go to church because I believe in God and the heavens. I don't believe that because I find a woman attractive I'm going to hell.
I am the same way as you. I have a bf, but i find women extremely attractive. There are more bi women then there are straight.