Delta family approach for the stochastic control problems of utility maximization