Second Order Perturbations During Inflation Beyond Slow-roll