Point-coupling Hamiltonian for frequency-independent linear optical devices