Towards overcoming data scarcity in materials science: unifying models and datasets with a mixture of experts framework