In case of emergency, order pizza: an urgent case of action formation and recognition

The biggest challenge for voice technologies is action recognition. This is partly because current approaches prioritize abstract context over practical action, and tend to ignore the detailed, sequential structure of talk by emulating scripted, often stereotypical dialogue. This provocation paper analyzes an urgent case of how a caller and a 911 dispatcher work together to achieve action recognition. We outline their 'seen but unnoticed' interactional methods and suggest how computational systems can learn from conversation analysis and use micro-analytic detail to recognize social actions.

[1]  S. Levinson.  Action formation and ascription , 2013 .

[2]  H. Garfinkel.  Studies in Ethnomethodology , 1968 .

[3]  John Local,et al.  Projection and ‘silences’: Notes on phonetic and conversational structure , 1986 .

[4]  Manuela Herman,et al.  Rethinking Context Language As An Interactive Phenomenon , 2016 .

[5]  Gary Roberts,et al.  Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer , 2008 .

[6]  Eric Hauser,et al.  Conversation Analysis: Studies from the First Generation , 2006 .

[7]  C. Goodwin,et al.  Rethinking Context: An Introduction , 1992 .

[8]  J. Potter,et al.  Talking cognition: mapping and making the terrain , 2004 .

[9]  Chris Cummins,et al.  Computational Approaches to the Pragmatics Problem , 2014, Lang. Linguistics Compass.

[10]  E. Schegloff.  Sequence Organization In Interaction , 2007 .

[11]  Guang-Jie Ren,et al.  Studies in Conversational UX Design , 2018, Human–Computer Interaction Series.

[12]  G. Jefferson.  Glossary of transcript symbols with an introduction , 2004 .

[13]  J. Sidnell,et al.  The Handbook of Conversation Analysis: Sidnell/The Handbook of Conversation Analysis , 2012 .

[14]  Martin Havlík,et al.  Emanuel A. Schegloff: Sequence Organization in Interaction. Volume 1. A Primer in Conversation Analysis , 2010 .

[15]  Peter Auer,et al.  The temporality of language in interaction projection and latency , 2015 .

[16]  Mitchell Kapor,et al.  A Wager on the Turing Test , 2009 .

[17]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[18]  Paul Drew,et al.  Quit talking while I'm interrupting: a comparison between positions of overlap onset in conversation , 2009 .

[19]  Yijin Wu,et al.  The Handbook of Conversation Analysis , 2015 .

[20]  Wes Sharrock,et al.  Ethnomethodology and the human sciences: The social actor: social action in real time , 1991 .

[21]  Sarah Sharples,et al.  Voice Interfaces in Everyday Life , 2018, CHI.

[22]  Matthew Purver,et al.  Computational Models of Miscommunication Phenomena , 2018, Top. Cogn. Sci..

[23]  J. S. Philipsen,et al.  Co-Operative Action , 2018, Journal of Pragmatics.

[24]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[25]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[26]  E. Schegloff.  Sequence Organization in Interaction: Contents , 2007 .