Evaluation of Diagrams Produced by Text-to-Graphic Conversion Systems

A piece of text that basically describes a graphic (or diagram) often appears in many branches of science and engineering. Researchers have attempted to involve machine in drawing the underlying graphics after automatically understanding the text but automatic evaluation of the accuracy of such drawing remained unexplored. This paper aims at measuring the accuracy of the graphic which comes from a text-to-graphic conversion process. Experiments show that this evaluation problem poses several challenges which have not been addressed before and hence calls for new initiatives. School level geometry problems have been taken as reference to demonstrate the underlying challenges and related issues.