The actor said he and Aniston “remained friends" and "it would be a loss if we weren’t in contact, for me personally."