The holographic quantum effective potential at finite temperature and density