A Direct Probe of Mass Density near Inspiraling Binary Black Holes