Long-term optical variations of 20 violently variable extragalactic radio sources