Structural correlation with the Griffiths phase in disordered magnetic systems