This paper discusses the basic scheme for establishing advanced metering infrastructure (AMI) by applying a high-voltage electric energy on-site calibration apparatus. The apparatus can work as an on-site working standard for implementing on-site calibration or verification to kinds of meters, electric energy metering cabinet and electric energy device in AMI. Furthermore, this paper provides a technical mean for calculating parameters of power grid, such as transformer loss and wire loss, in accordance with the principle of energy conservation. 10kV high voltage on-site calibration apparatus had been developed successfully and has been running in the power grid, on-site test results can prove that the scheme is feasible. Establishing a complete AMI system is of great significance for building a strong smart grid.