Sen. Whitehouse defends family’s membership in ‘all white’ club