An Adaptive Model Management Strategy: Balancing Exploration and Exploitation