General duality and magnet-free passive phononic Chern insulators