The thing is: he published that joke in a book he wrote. It is not just something stated in a moment of weakness or carnality - he chose what to print in his books. And he is accountable for every word he prints.