Universality in p-spin glasses with correlated disorder