Robust Data-Driven Inference for Density-Weighted Average Derivatives