In this paper, we propose a simple evolving network model with link and node removals as well as additions and show that this evolving network is scale free with a degree exponent varying in (1,4] depending on the network parameter values. By establishing a relation between the network evolution and a set of non-homogeneous birth-and-death processes, we develop an efficient algorithm to compute the network degree distribution. Our numerical results match simulation well and show how the network evolves into the scale-free state.