Algebraic aspects of general non-twisting and shear-free spacetimes