“I wouldn’t presume to tell a Supreme Court justice to retire but he more than anyone knows the political reality.”