High Speed Simulation and Freeform Optimization of Nanophotonic Devices with Physics-Augmented Deep Learning