Abstract The instantaneous uncut chip thickness and specific cutting forces have a significant effect on predictions of cutting force. This paper presents a systematic method for determining the coefficients in a three-dimensional mechanistic cutting force model—the cutting force coefficients (two specific cutting forces, chip flow angle) and runout parameters. Some existing models have taken the approach that the cutting force coefficients vary as a function of cutting conditions or cutter rotation angle. This paper, however, considers that the coefficients are affected only by the uncut chip thickness. The instantaneous uncut chip thickness is estimated by following the movement of the position of the center of a cutter. To consider the size effect, the present method derives the relationship between the re-scaled uncut chip thickness and the normal specific cutting force, Kn with respect to the cutter rotation angle, while the other two coefficients—frictional specific cutting force, Kf and chip flow angle, θc—remain constant. Subsequently, all the coefficients can be obtained, irrespective of cutting conditions. The proposed method was verified experimentally for a wide range of cutting conditions, and gave significantly better predictions of cutting forces.