Freud had something to say about this and Marcuse dwelt on it in Eros and Civilization. I especially like Marcuse's line that, "Civilization has to defend itself against the spectre of a world which could be free." That is to say free in the sense of working time becoming marginal and free time becoming central but also free time in the sense of non-working time being rid of its manipulative, domination-enforcing character.
The consequences of this desperate "defense of civilization" are immense. "Concentration camps, mass exterminations, world wars, and atom bombs are no 'relapse into barbarism,' but the unrepressed implementation of the achievements of modern science, technology, and domination." It is well to pay close attention to the word 'unrepressed' in the previous sentence. Freedom can't consist of merely throwing off restraints. Rather, humanity faces the more difficult task of finding or inventing new forms of sublimation to replace the repressive ones that prevail in industrial society. It is no accident that a profligate gets 'born again' in the guise of stern enforcer of the traditional morality.
Totalitarianism has a masterful grasp of the shame about ambivalence.