Sparsity-Aware Learning: Algorithms and Applications

This chapter is the follow-up to the previous one concerning sparsity-aware learning. The emphasis now is on the algorithmic front. Greedy, iterative thresholding and convex optimization algorithms are presented and discussed, both for batch as well as online learning. Extensions of the l 1 norm regularization are introduced, such as group sparse modeling, structured sparsity, total variation. The issue of analysis versus synthesis sparse modeling is presented together with the notion of co-sparsity. Finally, a case study of sparse modeling for time-frequency analysis in the context of Gabor frames is demonstrated.