Paul Pelosi has been going out in public occasionally, as a doctor suggested he needed "something to look forward to," according to the former House speaker.