Low-dose computed tomography (LDCT) examinations are of essential usages in clinical applications due to the lower radiation-associated cancer risks in CT imaging. Reductions in radiation dose can produce severe noise and artifacts that can affect the diagnostic accuracy of radiologists. Although deep learning networks have been widely proposed, most of these networks rely on a large number of annotated CT image pairs (LDCT images/high-dose CT (HDCT) images). Moreover, it is challenging for these networks to cope with the growing amount of CT images, especially large amount of medium-dose CT (MDCT) images that are easily to collect and have lower radiation dose than the HDCT images and higher radiation dose than the LDCT images. Therefore, in this work, we propose a progressive transfer-learning network (PETNet) for low-dose CT image reconstruction with limited annotated CT data and abundant corrupted CT data. The presented PETNet consists of two phases. In the first phase, a network is trained on a large amount of LDCT/MDCT image pairs, similar to the Noise2Noise network that has shown potential in yielding promising results with corrupted data for network training. It should be noted that this network would inevitably introduce undesired bias in the results due to the complex noise distribution in CT images. Then, in the second phase, we combined the pre-trained network and another simple network to construct the presented PETNet. In particular, the parameters of the pre-trained network are frozen and transferred directly to the presented PETNet, and the presented PETNet is trained on a small amount of LDCT/HDCT image pairs. Experimental results on Mayo clinic data demonstrate the superiority of the presented PETNet method both qualitatively and quantitatively compared with the network trained on LDCT/HDCT images pairs, and Noise2Noise method trained on LDCT/MDCT image pairs.