This paper studies the chatter stability of the intermittent cutting in view of the energy loss that caused by the collision which happens in the tooth enters the workpiece. As one of the important factors, the energy loss is integrated into the analysis process. As the cutting system behaves differently under the circumstances of being cutting or uncut, the temporal finite element method is chosen to solve this problem. It derived functions of the displacement and the velocity at the beginning and end of each element. The complete solution is obtained by combining these functions with the collision coefficient which is the mathematical expression of the energy loss. Then, the global transition matrix is formed and used to determine stability. The influences of other four parameters are considered. Comparison of the results from the theoretical analysis and the simulations are made to validate the accuracy of the proposed method.