What does it mean to be good at using a mobile device? An investigation of three levels of experience and skill

An increasing number of computer users lack formal training in operating their devices. These daily users cannot be described as novices or experts within the predominant view of expertise. In order to describe and better understand this type of self-taught intermediate level of skill, 10 casual users of a high-end smartphone series were compared to 10 novices and 4 professionals (help desk personnel) in their learning histories, task performance, and cognitive outcomes. Our study suggests that this type of self-taught intermediate level of skill is device-specific. Experienced users (casual users and experts) exhibited superior performance for representative tasks. This is mainly attributable to faster navigation and better knowledge of interface terminology, not to deeper conceptual representation of the problems. Interviews suggest that this skill is the consequence of routine use and three recurring learning events: familiarization, following of media, and ad hoc problem-solving situations. We conclude by discussing why intermediate levels of skill deserve more attention in HCI research.

[1]  K. A. Ericsson,et al.  Toward a general theory of expertise : prospects and limits , 1991 .

[2]  Paul A. Kirschner,et al.  Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design , 2007 .

[3]  Carl Gutwin,et al.  A predictive model of menu performance , 2007, CHI.

[4]  Kim Halskov,et al.  The usability of everyday technology: emerging and fading opportunities , 2002, TCHI.

[5]  Bonnie E. John,et al.  The Strategic Use of Complex Computer Systems , 2000, Hum. Comput. Interact..

[6]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[7]  Johan van Braak,et al.  Domains and determinants of university students' self-perceived computer competence , 2004, Comput. Educ..

[8]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[9]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[10]  A. Battersby.  Plans and the Structure of Behavior , 1968 .

[11]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[12]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[13]  L. Michele Miller,et al.  Using learning styles to evaluate computer-based instruction , 2005, Comput. Hum. Behav..

[14]  Judith S. Olson,et al.  The growth of software skill: a longitudinal look at learning & performance , 1993, INTERCHI.

[15]  Steven C. Seow.  Information Theoretic Models of HCI: A Comparison of the Hick-Hyman Law and Fitts' Law , 2005, Hum. Comput. Interact..

[16]  Saskia Brand-Gruwel,et al.  Information problem solving by experts and novices: analysis of a complex cognitive skill , 2005, Comput. Hum. Behav..

[17]  Tina M. Loraas,et al.  Learning new uses of technology: Situational goal orientation matters , 2009, Int. J. Hum. Comput. Stud..

[18]  Thomas S. Tullis,et al.  Older adults and web usability: is web experience the same as web expertise? , 2004, CHI EA '04.

[19]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[20]  John R. Wilson,et al.  The nature of expertise: a review. , 2006, Applied ergonomics.

[21]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[22]  John M. Carroll.  Human-computer interaction: psychology as a science of design. , 1997 .

[23]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[24]  K. Anders Ericsson,et al.  Towards a procedure for eliciting verbal expression of non-verbal experience without reactivity: interpreting the verbal overshadowing effect within the theoretical framework for protocol analysis , 2002 .

[25]  K. Ericsson,et al.  Prospects and limits of the empirical study of expertise: an introduction , 1991 .

[26]  Patricia M. Greenfield,et al.  Technology and Informal Education: What Is Taught, What Is Learned , 2009, Science.

[27]  Kraig Finstad,et al.  Analogical Problem Solving in Casual and Experienced Users: When Interface Consistency Leads to Inappropriate Transfer , 2008, Hum. Comput. Interact..

[28]  Maurice Merleau-Ponty.  The structure of behavior , 1963 .

[29]  M. Chi.  Two Approaches to the Study of Experts' Characteristics , 2006 .

[30]  Robin H. Kay,et al.  Exploring the relationship between emotions and the acquisition of computer knowledge , 2008, Comput. Educ..

[31]  Mary Beth Rosson,et al.  Patterns of experience in text editing , 1983, CHI '83.

[32]  Fran C. Blumberg,et al.  Impasse-driven learning in the context of video games , 2008, Comput. Hum. Behav..

[33]  Philip Sugai,et al.  Exploring the impact of handset upgrades on mobile content and service usage , 2007, Int. J. Mob. Commun..

[34]  Timo Koivumäki,et al.  The perceptions towards mobile services: an empirical analysis of the role of use facilitators , 2006, Personal and Ubiquitous Computing.

[35]  John M. Carroll,et al.  Human-computer interaction: psychology as a science of design , 1997, Int. J. Hum. Comput. Stud..

[36]  Hannu Verkasalo,et al.  Handset-based analysis of mobile service usage , 2009 .

[37]  Joan A. Ballantine,et al.  Computer usage and the validity of self-assessed computer competence among first-year business students , 2007, Comput. Educ..

[38]  Liisa Ilomäki,et al.  Intensive use of ICT in school: Developing differences in students' ICT expertise , 2007, Comput. Educ..

[39]  A. Elo.  The rating of chessplayers, past and present , 1978 .

[40]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[41]  David W. Eccles,et al.  Tracing the Development of Athletes Using Retrospective Interview Methods: A Proposed Interview and Validation Procedure for Reported Information , 2005 .

[42]  K. A. Ericsson,et al.  The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance , 2006 .

[43]  K. A. Ericsson,et al.  Protocol Analysis and Expert Thought: Concurrent Verbalizations of Thinking during Experts' Performance on Representative Tasks , 2006 .

[44]  Richard E. Mayer,et al.  From Novice to expert , 1988 .

[45]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[46]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[47]  K. A. Ericsson,et al.  Development of Professional Expertise: Enhancing the Development of Professional Performance: Implications from the Study of Deliberate Practice , 2009 .

[48]  Rosamund Sutherland,et al.  What's the Point of Using Computers? , 2001, New Media Soc..