Workshop Understanding Exploration-Exploitation Trade-offs