Re-Thinking Inverse Graphics With Large Language Models