Don't accuse him, pretend to be the little woman behind him, pretend to be at a loss, and tell him that he doesn't know how to associate with others. Men generally like to be big heads in front of women. He will show great ability to tell you not to worry so much, and then summon up courage to set an example for you.
Give encouragement and recognition to your husband's progress, and tell him that your husband's words are really good, and you should handle them properly. Don't complain The more you complain, the more you shrink back, the more you fear.
If your husband can't do these methods, then you can only accept them.