“If only I had known how many of these dinners I'd have to address," he said at a California bar association event, "I would've developed some sort of vaccine against them”