Expressive 3D face for mobile devices

Beyond being a digital appliance, a mobile device now increases overall quality of life by providing easy access to value-adding information. We can, however, embed media customization technology into these devices to further enhance their usage. Humanoid/anthropomorphic avatars are considered a user-friendly technology for realizing a media customization environment. This research formulates a computerized and expressive 3D face, which can be utilized as a mobile avatar. Input images are obtained from a built-in mobile camera. The resulting, customized 3D face is systematically generated by the mobile device. Six facial expressions are simulated by facial muscle motions embedded in the 3D mobile face. The generated 3D mobile face and expressions can be exported to other compatible formats to increase usability. Finally, the system validation is conducted by a focus group study1.

[1]  Alessandro De Gloria,et al.  MADE: developing edutainment applications on mobile computers , 2003, Comput. Graph..

[2]  Gregory D. Abowd,et al.  Pervasive Computing and Autism: Assisting Caregivers of Children with Special Needs , 2007, IEEE Pervasive Computing.

[3]  Sanggil Kang,et al.  A channel recommendation system in mobile environment , 2006, IEEE Transactions on Consumer Electronics.

[4]  Bill Tomlinson,et al.  Embodied mobile agents , 2006, AAMAS '06.

[5]  John Yen,et al.  Emotionally expressive agents , 1999, Proceedings Computer Animation 1999.

[6]  Ernest Lepore,et al.  What is Cognitive Science , 1999 .

[7]  Alvin T. S. Chan.  WWW+smart card: towards a mobile health care management system , 2000, Int. J. Medical Informatics.

[8]  Tomi Ahonen,et al.  Communities dominate brands : business and marketing challenges for the 21st century , 2005 .

[9]  Luca Chittaro,et al.  Bringing mobile guides and fitness activities together: a solution based on an embodied virtual trainer , 2006, Mobile HCI.

[10]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[11]  Pavel Slavík,et al.  PDA based navigation system for a 3D environment , 2001, Comput. Graph..

[12]  Mike Sharples,et al.  The design of personal mobile technologies for lifelong learning , 2000, Comput. Educ..

[13]  Qusay H. Mahmoud,et al.  Havana agents for comparison shopping and location-aware advertising in wireless mobile environments , 2006, Electron. Commer. Res. Appl..

[14]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[15]  Zdenek Míkovec,et al.  Beyond traditional interaction in a mobile environment: New approach to 3D scene rendering , 2006, Comput. Graph..

[16]  Maja Matijasevic,et al.  Personalized avatars for mobile entertainment , 2006, Mob. Inf. Syst..

[17]  Henry Tirri,et al.  Transaction management for m-commerce at a mobile terminal , 2006, Electron. Commer. Res. Appl..

[18]  Arun K. Majumdar,et al.  Algorithms and heuristics for efficient medical information display in PDA , 2007, Comput. Biol. Medicine.

[19]  Toni L. Doolen,et al.  A usability comparison of PDA-based quizzes and paper-and-pencil quizzes , 2005, Comput. Educ..

[20]  Vassilis Koutkias,et al.  Home care delivery through the mobile telecommunications platform: the Citizen Health System (CHS) perspective , 2002, Int. J. Medical Informatics.

[21]  Lijun Yin,et al.  Constructing a 3D individualized head model from two orthogonal views , 1996, The Visual Computer.

[22]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1998 .

[23]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[24]  Luca Chittaro,et al.  Mobile Devices in Emergency Medical Services: User Evaluation of a PDA-Based Interface for Ambulance Run Reporting , 2007, Mobile Response.

[25]  Keith Waters,et al.  Computer facial animation , 1996 .

[26]  Luvai Motiwalla,et al.  Mobile learning: A framework and evaluation , 2007, Comput. Educ..

[27]  Rosie Kitchiner.  The role of the personal digital assistant (PDA) in chiropractic practice , 2006 .

[28]  Igor S. Pandzic,et al.  MPEG-4 Facial Animation , 2002 .