Deeply X-raying the high-energy sky