Johnson, who was ousted in July amid ethics scandals, was widely expected to run to replace Liz Truss, who quit last week.