Charge ordering and ferrimagnetism in the strongly correlated $\beta$-V$_2$PO$_5$ single crystal