A comparative study of relative entropy of entanglement, concurrence and negativity