Interpreting the Relationship between Galaxy Luminosity, Color, and Environment