The frustration of being odd: how boundary conditions can destroy local order