Stroke is one of the leading causes of disability and incidence. For the treatment of prognosis of stroke patients, Motor imagery (MI) as a novel experimental paradigm, clinically it is effective because MI based Brain-Computer interface system can promote rehabilitation of stroke patients. There is being a hot and challenging topic to recognize multi-class motor imagery action classification accurately based on electroencephalograph (EEG) signals. In this work, we propose a novel framework named MRC-MLP. Multiple Riemannian covariance is used for EEG feature extraction. We make a multi-scale spectral division to filter EEG signals. They consist of different frequency bandwidths name sub-band. We concatenate and vectorize features extracted by Riemannian covariance on each sub-band. We design a fully connected MLP model with an improved loss function for motor imagery EEG classification. Furthermore, our proposed method MRC-MLP outperforms state-of-the-art methods and achieves approximately mean accuracy with 76%.