Considering that synthetic aperture radar (SAR) images obtained directly after signal processing are in the form of complex matrices, we propose a complex convolutional network for SAR target recognition. In this article, we give a brief introduction to complex convolutional networks and compare them with the real counterpart. A complex activation function is applied to analyze the influence of phase information in complex neural networks. Inspired by the theory of network visualization, a special kind of transfer learning based on the electromagnetic property from the attributed scattering center model is applied in our networks to modulate the first convolutional layer. The experiment shows a better performance in terms of classification accuracy compared to random weight initialization.