Quantum graphs with singular two-particle interactions