Interaction and Independence: Getting the Mixture Right