Model-based deep learning (MoDL) algorithms that rely on unrolling are emerging as powerful tools for image recovery. In this work, we introduce a novel monotone operator learning framework to overcome some of the challenges associated with current unrolled frameworks, including high memory cost, lack of guarantees on robustness to perturbations, and low interpretability. Unlike current unrolled architectures that use finite number of iterations, we use the deep equilibrium (DEQ) framework to iterate the algorithm to convergence and to evaluate the gradient of the convolutional neural network blocks using Jacobian iterations. This approach significantly reduces the memory demand, facilitating the extension of MoDL algorithms to high dimensional problems. We constrain the CNN to be a monotone operator, which allows us to introduce algorithms with guaranteed convergence properties and robustness guarantees. We demonstrate the utility of the proposed scheme in the context of parallel MRI.
[1]
Rebecca Willett,et al.
Deep Equilibrium Architectures for Inverse Problems in Imaging
,
2021,
IEEE Transactions on Computational Imaging.
[2]
J. Zico Kolter,et al.
Monotone operator equilibrium networks
,
2020,
NeurIPS.
[3]
Yann LeCun,et al.
Learning Fast Approximations of Sparse Coding
,
2010,
ICML.
[4]
Vladlen Koltun,et al.
Deep Equilibrium Models
,
2019,
NeurIPS.
[5]
Xiaohan Chen,et al.
Plug-and-Play Methods Provably Converge with Properly Trained Denoisers
,
2019,
ICML.
[6]
Mathews Jacob,et al.
MoDL: Model-Based Deep Learning Architecture for Inverse Problems
,
2017,
IEEE Transactions on Medical Imaging.