Watching the Colbert Christmas special was like finding out Santa isn’t real and then being punished for thinking he was.