The fact Joker set all the emotional tone of what's happening in TDKR is scary, Joker really did destroys Batman as a character inside out. The lies of Dent, Rachel's death, and the whole city and cops hated him. He is supposedly left to death.
He can lose his money, his strength, his company and watch his city be overrun by a madman but you know Batman's really in trouble when he loses Alfred.
"Maybe it's time we all stopped trying to outsmart the truth and let it have it's day"
That's the line that gets me every time. So much of the build up to this film was based on lies, Batman and Gordon covering up Harvey's crimes, Alfred sparing Bruce's feelings.