In this paper, an interacting multiple models (IMM) motion filter based local graph matching method is proposed to track the plant cells, by exploiting the tight spatial topology of neighboring cells in a multicellular field as contextual information. The IMM filter is used to predict the movement of the cells, and then the local graph matching approach is used to search the target cells in the local neighborhood of the predicted position. The combination of the IMM filter and local graph matching greatly reduces the size of the searching region in the matching process and enhances the tracking stability as well. Furthermore, the cells' lineages are generated by using a maximum-a-posteriori (MAP) lineage association method. The effectiveness and efficiency of the proposed tracking method are validated by experiments on real plant cell datasets.