Kanye West's controversial comments on slavery were a 'turning point' in his failed marriage to Kim Kardashian, report says