A deep survey of heavy element lines in planetary nebulae – I. Observations and forbidden-line densities, temperatures and abundances