Advancing Mixture Models for Least Squares Optimization