Using the Fundamental Plane of black hole activity to distinguish X-ray processes from weakly accreting black holes