Model-Based Product Configuration in Augmented Reality Applications

Augmented Reality (AR) has recently found high attention in mobile shopping apps such as in domains like furniture or decoration. Here, the developers of the apps focus on the positioning of atomic 3D objects in the physical environment. With this focus, they neglect the configuration of multi-faceted 3D object composition according to the user needs and environmental constraints. To tackle these challenges, we present a model-based approach to support AR-assisted product configuration based on the concept of Dynamic Software Product Lines. Our approach splits products (e.g. table) into parts (eg. tabletop, table legs, funnier) with their 3D objects and additional information (e.g. name, price). The possible products, which can be configured out of these parts, are stored in a feature model. At runtime, this feature model can be used to configure 3D object compositions out of the product parts and adapt to user needs and environmental constraints. The benefits of this approach are demonstrated by a case study of configuring modular kitchens with the help of a prototypical mobile-based implementation.

[1]  Scott G. Dacko.  Enabling smart retail settings via mobile augmented reality shopping apps , 2017 .

[2]  Tai-Hsi Wu,et al.  Parallel genetic algorithms for product configuration management on PC cluster systems , 2007 .

[3]  Enes Yigitbas,et al.  Development framework for context-aware augmented reality applications , 2020, EICS.

[4]  Gregor Engels,et al.  Adapt-UI: an IDE supporting model-driven development of self-adaptive UIs , 2017, EICS.

[5]  Kiseol Yang.  Determinants of US consumer mobile shopping services adoption: implications for designing mobile shopping services , 2010 .

[6]  Enes Yigitbas,et al.  Integrated model-driven development of self-adaptive user interfaces , 2020, Software and Systems Modeling.

[7]  Nicolas Biri,et al.  Designing an Adaptive User Interface According to Software Product Line Engineering , 2015, ACHI 2015.

[8]  Ebrahim Bagheri,et al.  Dynamic Software Product Line Engineering: A Reference Framework , 2017, Int. J. Softw. Eng. Knowl. Eng..

[9]  Antonio Ruiz Cortés,et al.  Article in Press G Model the Journal of Systems and Software an Overview of Dynamic Software Product Line Architectures and Techniques: Observations from Research and Industry , 2022 .

[10]  Svein O. Hallsteinsen,et al.  Using product line techniques to build adaptive systems , 2006, 10th International Software Product Line Conference (SPLC'06).

[11]  Ladan Tahvildari,et al.  Self-adaptive software: Landscape and research challenges , 2009, TAAS.

[12]  Sergio Segura,et al.  Automated analysis of feature models 20 years later: A literature review , 2010, Inf. Syst..

[13]  Adel M. Alimi,et al.  A UI-DSPL Approach for the Development of Context-Adaptable User Interfaces , 2018, IEEE Access.

[14]  E. Y. Kim,et al.  Modeling consumer adoption of mobile shopping for fashion products in Korea , 2009 .

[15]  Gregor Engels,et al.  Intertwined Development of Business Model and Product Functions for Mobile Applications: A Twin Peak Feature Modeling Approach , 2019, ICSOB.

[16]  Pan Hui,et al.  Mobile Augmented Reality Survey: From Where We Are to Where We Go , 2017, IEEE Access.

[17]  Florian Rittmeier,et al.  Hypothesis-driven Adaptation of Business Models based on Product Line Engineering , 2020, 2020 IEEE 22nd Conference on Business Informatics (CBI).

[18]  Yijun Yu,et al.  Adaptive Model-Driven User Interface Development Systems , 2014, ACM Comput. Surv..

[19]  Johannes Schöning,et al.  Mobile product customization , 2010, CHI Extended Abstracts.

[20]  Arosha K. Bandara,et al.  Engineering Adaptive Model-Driven User Interfaces , 2016, IEEE Transactions on Software Engineering.

[21]  Peter Eisert,et al.  3-D Tracking of shoes for Virtual Mirror applications , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Nelly Bencomo,et al.  A View of the Dynamic Software Product Line Landscape , 2012, Computer.

[23]  Enes Yigitbas,et al.  ProConAR: A Tool Support for Model-Based AR Product Configuration , 2020, HCSE.

[24]  Paul Clements,et al.  Software product lines - practices and patterns , 2001, SEI series in software engineering.

[25]  Sven Apel,et al.  Granularity in software product lines , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[26]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[27]  Krzysztof Czarnecki,et al.  Staged configuration through specialization and multilevel configuration of feature models , 2005, Softw. Process. Improv. Pract..

[28]  Gregor Engels,et al.  A Context-aware Virtual Reality First Aid Training Application , 2019, MuC.

[29]  Gunter Saake,et al.  Feature-Oriented Software Product Lines , 2013, Springer Berlin Heidelberg.

[30]  Antonio Ruiz Cortés,et al.  Automated Reasoning on Feature Models , 2005, Seminal Contributions to Information Systems Engineering.

[31]  Miguel Toro,et al.  Automated error analysis for the agilization of feature modeling , 2008, J. Syst. Softw..