Towards the solution to the giant graviton puzzle