I’m so sorry for the late reply. No one has been tending to this website for awhile. All worthy members of The Church of Jesus Christ of Latter-day Saints receive the benefits of the priesthood. Many families have members that are more or less active at any given time. The Church asks wives with inactive husbands to be sensitive to the mood in the marriage and wives are counseled to gauge their activity and participation to how much they can do and still keep peace in the home. It can take time for an inactive husband to accept his wife’s temple attendance and the wearing of the holy garment, too. Your worthiness is within your own control, but go by the promptings of the Spirit as to whether this is a good time to attend, and how often to attend. Many of these things are worked out after this mortal life is over, and all injustices will be healed.