Jamie Spears now says he wanted to end the conservatorship because of 'a self-interested entourage of handlers'