“It would be very unjust to say that you deserted me, but that I was deserted, and sometimes terribly so, is true.”