Since you are so attached to your feelings, don't divorce. In your relationship, there is always one person who wants to compromise and make concessions. If your husband refuses, you can give him a step down. A man has good face, you give him face. If he is sensible, he will step by step and let you two make up.