Fast Direct Solvers for Integral Equations at Low-Frequency Based on Operator Filtering