"That's kind of backwards," David Letterman quipped. "First you get elected, then you have the sex scandal!"