Assignment 2 - Deep Learning with Sparse Coding

In sparse coding and sparse modeling, the n-diensional input x is assumed to be linearly reconstructable by computing the product of a sparse m-dimensional vector z with an n ×m dictionary matrix W , whose columns are sometimes called basis functions, basis vectors, or atoms. The sparse code z for a given input vector x is often obtained by minimizing the energy function: E(W,x, z) = ‖x−Wz‖2 + λ‖z‖1,