Exploring new structures and natural constructions in mathematical physics