I think that can also be the spouse is like a second conscience. You may be willing to eat that second doughnut, buy that thing, waste that time, but the spouse amplifies what your conscience is probably already whispering to you.
I say spouse because I think it goes both ways, guys just make a joke about it because of the culture around authority in the home. (Which is never 100% one side in charge)