A judge reminded everyone that Steve Bannon was accused of taking $1 million from a border wall fundraising scheme while approving Trump's pardon