My husband and I have been married for 13 years and we have two great children, 12 and 10. Compared to a lot of other husbands, my husband is wonderful and our marriage has hope but I feel as if I can't go on for another day.  
 
I have a lot of emotional baggage from the earlier part of our marriage:  
 
1. I found out that a mutual female friend was an ex-girlfriend by reading his diary. When I had asked about her while we were dating, he had claimed that she was just a friend. But it turns out, everyone knew except for me. I found out by reading his diary.  
 
2. We also had to live with his parents for financial reasons in the first five years of our marriage. Initially, the promise was six months but we ended up staying there for a very long time before moving out. In some ways, it wasn't his fault but I still felt that he had let me down.  
 
3. He doesn't provide me with a sense of security, both financial and emotional. He doesn't seem very responsible and seems to make decisions that threaten our well being like quitting a job without a financially viable option. Although I worked, I still felt burdened and insecure about our future. 
 
4. I resent him because he has put me in a position where I had to shoulder financial responsibility for our family. I believe this has made me more aggressive and concerned about money which I dislike.  
 
5. We've had problems with sex in the past and he has refused to seek help. The problem recurrs often and it looks like it will continue to plague our marriage in the future.  
 
But despite all this, he is a wonderful person and very caring. He also listens and tries to make me happy but I find it hard to be happy because of these underlying issues. I really don't think it's a matter of letting go of emotional baggage but I have given up trying to work out the problems because when we try to talk, I end up hurting him and making him feel like a loser. So I have decided it's better not to deal with our problems. And even if we do talk it over and feel better, the same issues come up again and again.
I have tried to work things out on my own and read Relationship Rescue twice but it only convinces me that we probably won't be able to have a healthy, loving relationship again.  
Where do I go from here?