N-Body Simulations of Late Stage Planetary Formation with a Simple Fragmentation Model