Flow in AA and pA as an interplay of fluid-like and non-fluid like excitations