Harmonic balance modeling for photodetector nonlinearity