Artificial Intelligence for HCI: A Modern Approach

Artificial intelligence (AI) and Human Computer Interaction (HCI) share common roots and early work on conversational agents has laid the foundation for both fields. However, in subsequent decades the initial tight connection between the fields has become less pronounced. The recent rise of deep learning has revolutionized AI and has led to a raft of practical methods and tools that significantly impact areas outside of core-AI. In particular, modern AI techniques now power new ways for machines and humans to interact. Thus it is timely to investigate how modern AI can propel HCI research in new ways and how HCI research can help direct AI developments. This workshop offers a forum for researchers to discuss new opportunities that lie in bringing modern AI methods into HCI research, identifying important problems to investigate, showcasing computational and scientific methods that can be applied, and sharing datasets and tools that are already available or proposing those that should be further developed. The topics we are interested in including deep learning methods for understanding and modeling human behaviors and enabling new interaction modalities, hybrid intelligence that combine human and machine intelligence to solve difficult tasks, and tools and methods for interaction data curation and large-scale data-driven design. At the core of these topics, we want to start the conversation on how data-driven and data-centric approaches of modern AI can impact HCI.

[1]  W. E. Hick Quarterly Journal of Experimental Psychology , 1948, Nature.

[2]  Otmar Hilliges,et al.  Learning to find eye region landmarks for remote gaze estimation in unconstrained settings , 2018, ETRA.

[3]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[4]  Carl Gutwin,et al.  A predictive model of menu performance , 2007, CHI.

[5]  Shumin Zhai,et al.  FFitts law: modeling finger touch with fitts' law , 2013, CHI.

[6]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[7]  Otmar Hilliges,et al.  In-air gestures around unmodified mobile devices , 2014, UIST.

[8]  Otmar Hilliges,et al.  Learning Cooperative Personalized Policies from Gaze Data , 2019, UIST.

[9]  Ranjitha Kumar,et al.  An Experimentation Engine for Data-Driven Fashion Systems , 2017, AAAI Spring Symposia.

[10]  Otmar Hilliges,et al.  DeepWriting: Making Digital Ink Editable via Deep Generative Modeling , 2018, CHI.

[11]  Yang Li,et al.  Analysis and Modeling of Grid Performance on Touchscreen Mobile Devices , 2018, CHI.

[12]  Yang Li,et al.  Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning , 2019, CHI.

[13]  Olga Sorkine-Hornung,et al.  Interactive hand pose estimation using a stretch-sensing soft glove , 2019, ACM Trans. Graph..

[14]  Walter S. Lasecki,et al.  1 On Facilitating Human-Computer Interaction via Hybrid Intelligence Systems , 2019 .

[15]  Ranjitha Kumar,et al.  Designing the Future of Personal Fashion , 2018, CHI.

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  Yang Li,et al.  Predicting Human Performance in Vertical Menu Selection Using Deep Learning , 2018, CHI.

[18]  Ranjitha Kumar,et al.  Webzeitgeist: design mining the web , 2013, CHI.

[19]  Jeffrey Nichols,et al.  Rico: A Mobile App Dataset for Building Data-Driven Design Applications , 2017, UIST.

[20]  Zhe He,et al.  Photo-Realistic Monocular Gaze Redirection Using Generative Adversarial Networks , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[21]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.