Britney Spears' son says he missed her wedding because no other family was invited and he didn't think it 'would have ended on good terms'