“If he wants to call me face to face, man to man, I’ll talk to him," the Georgia secretary of state said.