Cullet use in the production of building materials