The 1st International EvalUMAP Workshop brings together researchers from every facet of the User Modelling, Adaptation and Personalization community to explore new approaches to comparative evaluation. This area of research is inherently complex, not only because of its focus on the user, but also because the domains in which it is applied tend to be highly dynamic and diverse. To date this has presented significant barriers to how research outcomes can be compared. This workshop seeks to solicit input from the community to facilitate the shared development of evaluation tasks or competitions. The ADAPT Centre (www.adaptcentre.ie) is committed to supporting this community-wide activity as it will, hopefully, strengthen the research of all involved.