A study of a modified nonlinear dynamical system with fractal-fractional derivative