Trump's former campaign manager said the ex-president is now surrounded by people trying to take advantage of him