Solving sparse linear systems resulting from discretized PDEs has been challenging. Direct solvers has quadratic/cubic complexity, while iterative solvers require problem dependent preconditioners in order to be robust. We propose hierarchical solvers that have tunable accuracy and improved robustness with respect to the conditioning of linear systems. This solver is designed to have different accuracy on errors of different frequencies.