Minor deviations from randomness have huge repercussions on the functional structuring of sequence space