Combining User Feedback and Monitoring Data to Support Evidence-based Software Evolution

Context. Companies continuously explore their software systems to acquire evidence for software evolution, such as bugs in the system and new functional or quality requirements. So far, managers ha ...

[1]  Richard L. Daft,et al.  Organizational information requirements, media richness and structural design , 1986 .

[2]  Yijun Yu,et al.  Monitoring and diagnosing software requirements , 2009, Automated Software Engineering.

[3]  Martin S. Feather,et al.  Requirements monitoring in dynamic environments , 1995, Proceedings of 1995 IEEE International Symposium on Requirements Engineering (RE'95).

[4]  Sjaak Brinkkemper,et al.  Software product management - An industry evaluation , 2014, J. Syst. Softw..

[5]  Norbert Seyff,et al.  Ethical Considerations in Research on User Feedback , 2017, 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW).

[6]  Tore Dybå,et al.  Challenges and Recommendations When Increasing the Realism of Controlled Software Engineering Experiments , 2003, ESERNET.

[7]  Norbert Seyff,et al.  FlexiSketch: A Mobile Sketching Tool for Software Modeling , 2012, MobiCASE.

[8]  Stephan Jacobs.  Introducing measurable quality requirements: a case study , 1999, Proceedings IEEE International Symposium on Requirements Engineering (Cat. No.PR00188).

[9]  Fahri Yetim,et al.  Fostering Continuous User Participation by Embedding a Communication Support Tool in User Interfaces , 2012 .

[10]  Jan Bosch,et al.  Climbing the "Stairway to Heaven" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software , 2012, 2012 38th Euromicro Conference on Software Engineering and Advanced Applications.

[11]  Norbert Seyff,et al.  Sketching and notation creation with FlexiSketch Team: Evaluating a new means for collaborative requirements elicitation , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[12]  R. Cooper,et al.  New Product Portfolio Management : Practices and Performance , 1999 .

[13]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[14]  Brian Clifton,et al.  Advanced Web Metrics with Google Analytics , 2008 .

[15]  Dustin Wüest,et al.  Combining Monitoring and Autonomous Feedback Requests to Elicit Actionable Knowledge of System Use , 2019, REFSQ.

[16]  John Mylopoulos,et al.  MobiGoal: Flexible Achievement of Personal Goals for Mobile Users , 2018, IEEE Transactions on Services Computing.

[17]  Joseph F. Hair,et al.  When to use and how to report the results of PLS-SEM , 2019, European Business Review.

[18]  Klaus-Dieter Thoben,et al.  Qualitative Comparison of Requirements Elicitation Techniques that are Used to Collect Feedback Information about Product Use , 2014 .

[19]  M. Shubik.  Gaming , 1989 .

[20]  Mohamed Ibrahim,et al.  A Little Bird Told Me: Mining Tweets for Requirements and Software Evolution , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[21]  G. Hockey,et al.  Effects of time-pressure on decision-making under uncertainty: changes in affective state and information processing strategy. , 2000, Acta psychologica.

[22]  Christian Nielsen,et al.  Value Proposition Design: How to create products and services customers want , 2015 .

[23]  Dewayne E. Perry,et al.  Metrics and laws of software evolution-the nineties view , 1997, Proceedings Fourth International Software Metrics Symposium.

[24]  Samuel Fricker,et al.  QoE probe: A Requirement-monitoring Tool , 2016, REFSQ Workshops.

[25]  Klaus Marius Hansen,et al.  Reviewing the Health of Software Ecosystems - A Conceptual Framework Proposal , 2013, IWSECO@ICSOB.

[26]  J. Boegh,et al.  A New Standard for Quality Requirements , 2008, IEEE Software.

[27]  Luis von Ahn,et al.  Matchin: eliciting user preferences with an online game , 2009, CHI.

[28]  Jan Bosch,et al.  An Activity and Metric Model for Online Controlled Experiments , 2018, PROFES.

[29]  Premkumar T. Devanbu,et al.  Belief & Evidence in Empirical Software Engineering , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[30]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.

[31]  J. Bachman,et al.  Effects of Questionnaire Length on Response Quality , 1981 .

[32]  Norbert Seyff,et al.  Features for Mobile Feedback Tools: Applying the KANO Method , 2017, MuC.

[33]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[34]  J. Yolton.  A Theory of Knowledge , 1924, Nature.

[35]  Slinger Jansen,et al.  A sense of community: A research agenda for software ecosystems , 2009, 2009 31st International Conference on Software Engineering - Companion Volume.

[36]  Touradj Ebrahimi,et al.  Quality of Service Versus Quality of Experience , 2014, Quality of Experience.

[37]  Nirwan Ansari,et al.  On assuring end-to-end QoE in next generation networks: challenges and a possible solution , 2011, IEEE Communications Magazine.

[38]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[39]  F. Zijlstra,et al.  Temporal factors in mental work: Effects of interrupted activities , 1999 .

[40]  Walid Maalej,et al.  On user rationale in software engineering , 2018, Requirements Engineering.

[41]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[42]  Klaus Marius Hansen,et al.  Software ecosystems - A systematic literature review , 2013, J. Syst. Softw..

[43]  Helvi Kyngäs,et al.  The qualitative content analysis process. , 2008, Journal of advanced nursing.

[44]  Anna Perini,et al.  DMGame: A Gamified Collaborative Requirements Prioritisation Tool , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[45]  Manuela Pereira,et al.  Factors Influencing Quality of Experience , 2014, Quality of Experience.

[46]  Gary Lynn,et al.  Project Visioning: Its Components and Impact on New Product Success , 2012 .

[47]  Birgit Vogel-Heuser,et al.  The Nature of Software Evolution , 2019, Managed Software Evolution.

[48]  Markus Fiedler,et al.  Quality of Experience from user and network perspectives , 2010, Ann. des Télécommunications.

[49]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[50]  Leonard J. Bass,et al.  Using Business Goals to Inform a Software Architecture , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[51]  Jan Bosch,et al.  Time to Say 'Good Bye': Feature Lifecycle , 2016, 2016 42th Euromicro Conference on Software Engineering and Advanced Applications (SEAA).

[52]  Julio Cesar Sampaio do Prado Leite,et al.  On Non-Functional Requirements in Software Engineering , 2009, Conceptual Modeling: Foundations and Applications.

[53]  Thomas Zimmermann,et al.  What Makes a Good Bug Report? , 2008, IEEE Transactions on Software Engineering.

[54]  John E. Sawyer,et al.  Measuring Facts of Media Richness , 2001, J. Comput. Inf. Syst..

[55]  Martin Leucker,et al.  A brief account of runtime verification , 2009, J. Log. Algebraic Methods Program..

[56]  Alexander Raake,et al.  Quality and Quality of Experience , 2014, Quality of Experience.

[57]  Ron Kohavi,et al.  Emerging trends in business analytics , 2002, CACM.

[58]  Malcolm Munro,et al.  Understanding service-oriented software , 2004, IEEE Software.

[59]  Karlheinz Kautz,et al.  Knowledge Mapping: A Technique for Identifying Knowledge Flows in Software Organisations , 2004, EuroSPI.

[60]  Pearl Brereton,et al.  Does the technology acceptance model predict actual use? A systematic literature review , 2010, Inf. Softw. Technol..

[61]  Dongmei Zhang,et al.  Software analytics as a learning case in practice: approaches and experiences , 2011, MALETS '11.

[62]  Inge van de Weerd,et al.  A Framework for Process Improvement in Software Product Management , 2010, EuroSPI.

[63]  Luciano Baresi,et al.  A comparison framework for runtime monitoring approaches , 2017, J. Syst. Softw..

[64]  Isabelle Comyn-Wattiau,et al.  Ontologies for Security Requirements: A Literature Survey and Classification , 2012, CAiSE Workshops.

[65]  Panos Vassiliadis,et al.  An Integration-Oriented Ontology to Govern Evolution in Big Data Ecosystems , 2017, EDBT/ICDT Workshops.

[66]  Maleknaz Nayebi,et al.  Toward Data-Driven Requirements Engineering , 2016, IEEE Software.

[67]  Jan O. Borchers,et al.  Me hates this: exploring different levels of user feedback for (usability) bug reporting , 2011, CHI EA '11.

[68]  Ned Chapin,et al.  Types of software evolution and software maintenance , 2001, J. Softw. Maintenance Res. Pract..

[69]  Michael A. Cusumano,et al.  The Changing Software Business: Moving from Products to Services , 2008, Computer.

[70]  Sofware Evolution And....  Software evolution and feedback : theory and practice , 2014 .

[71]  Xavier Franch,et al.  FAME: Supporting Continuous Requirements Elicitation by Combining User Feedback and Monitoring , 2018, 2018 IEEE 26th International Requirements Engineering Conference (RE).

[72]  Thomas Zimmermann,et al.  Information needs for software development analytics , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[73]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[74]  W. Moore,et al.  The Role of Market Information in New Product Success/Failure , 1997 .

[75]  Kurt Schneider.  Focusing spontaneous feedback to support system evolution , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[76]  Daniel M. Oppenheimer,et al.  Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power , 2009 .

[77]  Olavo Barbosa,et al.  A Systematic Mapping Study on Software Ecosystems , 2011, IWSECO@ICSOB.

[78]  Peter Brusilovsky,et al.  Reinforcing Recommendation Using Implicit Negative Feedback , 2009, UMAP.

[79]  Yelena Nakhimovsky,et al.  Behind the scenes of google maps navigation: enabling actionable user feedback at scale , 2010, CHI Extended Abstracts.

[80]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[81]  Alimohammad Shahri,et al.  Crowd-centric Requirements Engineering , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[82]  Walid Maalej,et al.  When users become collaborators: towards continuous and context-aware user input , 2009, OOPSLA Companion.

[83]  Nahid Golafshani,et al.  Understanding Reliability and Validity in Qualitative Research , 2003 .

[84]  Alistair Sutcliffe,et al.  Requirements elicitation: Towards the unknown unknowns , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[85]  David M'Raïhi,et al.  Designing a Trade-Off Between Usability and Security: A Metrics Based-Model , 2007, INTERACT.

[86]  G. Haines,et al.  The Theory of Buyer Behavior. , 1970 .

[87]  Wilhelm Hasselbring,et al.  Continuous Monitoring of Software Services: Design and Application of the Kieker Framework , 2009 .

[88]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[89]  野中 郁次郎,et al.  The Knowledge-Creating Company: How , 1995 .

[90]  Kalevi Kilkki,et al.  Quality of Experience in Communications Ecosystem , 2008, J. Univers. Comput. Sci..

[91]  Annie I. Antón,et al.  The use of goals to surface requirements for evolving systems , 1998, Proceedings of the 20th International Conference on Software Engineering.

[92]  David Probert,et al.  Strategic Roadmapping: A Workshop-based Approach for Identifying and Exploring Strategic Issues and Opportunities , 2007 .

[93]  Eric Knauss,et al.  Feedback-driven requirements engineering: The Heuristic Requirements Assistant , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[94]  Brian P. Bailey,et al.  The Effects of Interruptions on Task Performance, Annoyance, and Anxiety in the User Interface , 2001, INTERACT.

[95]  Bernd Brügge,et al.  User involvement in software evolution practice: A case study , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[96]  Bernd Brügge,et al.  FAVe: Visualizing User Feedback for Software Evolution , 2014, 2014 Second IEEE Working Conference on Software Visualization.

[97]  Ilia Bider,et al.  Agile business process development: why, how and when—applying Nonaka’s theory of knowledge transformation to business process development , 2014, Information Systems and e-Business Management.

[98]  Peter Brooks,et al.  User measures of quality of experience: why being objective and quantitative is important , 2010, IEEE Network.

[99]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[100]  H. Rex Hartson,et al.  Remote evaluation for post-deployment usability improvement , 1998, AVI '98.

[101]  Walid Maalej,et al.  How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[102]  Julio Cesar Sampaio do Prado Leite,et al.  Nonfunctional requirements: from elicitation to conceptual models , 2004, IEEE Transactions on Software Engineering.

[103]  Paul Grünbacher,et al.  Requirements monitoring frameworks: A systematic review , 2016, Inf. Softw. Technol..

[104]  Colin Robson,et al.  Real World Research: A Resource for Social Scientists and Practitioner-Researchers , 1993 .

[105]  Gonzalo Navarro,et al.  Pattern Matching , 2008, Encyclopedia of Algorithms.

[106]  Jan Bosch,et al.  Climbing the "Stairway to Heaven": Evolving From Agile Development to Continuous Deployment of Software , 2014, Continuous Software Engineering.

[107]  Denisse Muñante Arzapalo,et al.  Discovering Requirements through Goal-Driven Process Mining , 2017, 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW).

[108]  Jan Wiesenberger,et al.  Bringing Developers and Users Closer Together: The OpenProposal Story , 2008, PRIMIUM.

[109]  P. French,et al.  Philosophy of emotions , 1998 .

[110]  William N. Robinson.  A Roadmap for Comprehensive Requirements Modeling , 2010, Computer.

[111]  Sebastian Möller,et al.  Brain Activity Correlates of Quality of Experience , 2014, Quality of Experience.

[112]  Roel Wieringa,et al.  Requirements engineering paper classification and evaluation criteria: a proposal and a discussion , 2005, Requirements Engineering.

[113]  Muneera Bano,et al.  Problems and challenges of user involvement in software development: an empirical study , 2015, EASE.

[114]  Leif Singer,et al.  Using popular social network sites to support requirements elicitation, prioritization and negotiation , 2015, Journal of Internet Services and Applications.

[115]  Mor Naaman,et al.  Why we tag: motivations for annotation in mobile and online media , 2007, CHI.

[116]  M.M. Lehman,et al.  Programs, life cycles, and laws of software evolution , 1980, Proceedings of the IEEE.

[117]  Hyun-Jong Kim,et al.  The QoE Evaluation Method through the QoS-QoE Correlation Model , 2008, 2008 Fourth International Conference on Networked Computing and Advanced Information Management.

[118]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[119]  Markus Fiedler,et al.  Quality requirements elicitation based on inquiry of quality-impact relationships , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[120]  Adam Cooper,et al.  Produced by Cetis for Jisc Analytics Series Definition and Essential Characteristics What Is Analytics? Definition and Essential Characteristics , 2022 .

[121]  Pablo Sotres,et al.  Smart City Services Over a Global Interoperable Internet-of-Things System:The Smart Parking Case , 2018, 2018 Global Internet of Things Summit (GIoTS).

[122]  Evangelos Theodoridis,et al.  SmartSantander: IoT experimentation over a smart city testbed , 2014, Comput. Networks.

[123]  Marc Rettig,et al.  Prototyping for tiny fingers , 1994, CACM.

[124]  Menno D.T. de Jong,et al.  Users’ Abilities to Review Web Site Pages , 2012 .

[125]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..

[126]  Calton Pu,et al.  Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[127]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[128]  Kittiya Srewuttanapitikul,et al.  Prioritizing Software Maintenance Plan by Analyzing User Feedback , 2016, 2016 International Conference on Information Science and Security (ICISS).

[129]  Sari Kujala,et al.  User involvement: A review of the benefits and challenges , 2003, Behav. Inf. Technol..

[130]  Natalia Juristo Juzgado,et al.  Systematizing requirements elicitation technique selection , 2014, Inf. Softw. Technol..

[131]  Kristina Winbladh,et al.  Analysis of user comments: An approach for software requirements evolution , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[132]  Bay Arinze,et al.  Generation Y Adoption of Instant Messaging: An Examination of the Impact of Social Usefulness and Media Richness on Use Richness , 2010, IEEE Transactions on Professional Communication.

[133]  W. James Potter,et al.  Rethinking validity and reliability in content analysis , 1999 .

[134]  Thomas R. Eisenmann,et al.  Hypothesis-Driven Entrepreneurship: The Lean Startup , 2012 .

[135]  Norbert Seyff,et al.  iRequire: Gathering end-user requirements for new apps , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[136]  Alexander Raake,et al.  Web Browsing , 2014, Quality of Experience.

[137]  Coral Calero,et al.  Quality in Use Model for Web Portals (QiUWeP) , 2010, ICWE Workshops.

[138]  Pei-Chen Sun,et al.  The design of instructional multimedia in e-Learning: A Media Richness Theory-based approach , 2007, Comput. Educ..

[139]  Benjamin W. Wah,et al.  Significance and Challenges of Big Data Research , 2015, Big Data Res..

[140]  Marianne S. Ulriksen,et al.  Single case studies and theory-testing: the knots and dots of the process-tracing method , 2016 .

[141]  Qing Zhou,et al.  Requirements cybernetics: Elicitation based on user behavioral data , 2017, J. Syst. Softw..

[142]  Thomas Olsson,et al.  Non-functional requirements in industry - three case studies adopting an experience-based NFR method , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[143]  Walid Maalej,et al.  Democratic mass participation of users in Requirements Engineering? , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[144]  Clyde W. Holsapple,et al.  A unified foundation for business analytics , 2014, Decis. Support Syst..

[145]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[146]  Alexander Raake,et al.  Audio Transmission , 2014, Quality of Experience.

[147]  Uichin Lee,et al.  How to Report App Feedback?: Analyzing Feedback Reporting Behavior , 2016, CHI Extended Abstracts.

[148]  Robert Costanza,et al.  Ecosystem Health New Goals for Environmental Management , 1992 .

[149]  Marko Sarstedt,et al.  Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research , 2014 .

[150]  F. Stuart Chapin,et al.  Principles of Ecosystem Sustainability , 1996, The American Naturalist.

[151]  Meir M. Lehman,et al.  Software evolution - Background, theory, practice , 2003, Inf. Process. Lett..

[152]  Evangelos Karapanos,et al.  User experience over time , 2008, CHI Extended Abstracts.

[153]  Martin Glinz,et al.  Rethinking the Notion of Non-Functional Requirements , 2005 .

[154]  Janet Fulk,et al.  Organizational Colleagues, Media Richness, and Electronic Mail , 1991 .

[155]  Kurt Schneider,et al.  ConTexter feedback system , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[156]  Vidyanand Choudhary,et al.  Software as a Service: Implications for Investment in Software Development , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[157]  Cynthia E. Irvine,et al.  Quality of security service , 2001, NSPW '00.

[158]  A. B.,et al.  SPEECH COMMUNICATION , 2001 .

[159]  Virpi Roto,et al.  USER EXPERIENCE WHITE PAPER Bringing clarity to the concept of user experience , 2011 .

[160]  B. Mesquita,et al.  Context in Emotion Perception , 2011 .

[161]  Thomas Zimmermann,et al.  Analytics for software development , 2010, FoSER '10.

[162]  France Bélanger,et al.  Communication Media Repertoires: Dealing with the Multiplicity of Media Choices , 2007, MIS Q..

[163]  John R. Carlson,et al.  Channel Expansion Theory and the Experiential Nature of Media Richness Perceptions , 1999 .

[164]  Walid Maalej,et al.  Bug report, feature request, or simply praise? On automatically classifying app reviews , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[165]  Mary M. Kennedy,et al.  Generalizing From Single Case Studies , 1979 .

[166]  Kenji Takahashi,et al.  Inquiry-based requirements analysis , 1994, IEEE Software.

[167]  RJ Rob Kusters,et al.  Identifying embedded software quality: two approaches , 1999 .

[168]  Kurt Schneider,et al.  Workshop videos for requirements communication , 2016, Requirements Engineering.

[169]  Björn Regnell,et al.  Supporting Roadmapping of Quality Requirements , 2008, IEEE Software.

[170]  Alistair G. Sutcliffe,et al.  Value-based requirements engineering: method and experience , 2017, Requirements Engineering.

[171]  Raian Ali,et al.  Requirements Evolution: From Assumptions to Reality , 2011, BMMDS/EMMSAD.

[172]  Kil-Soo Suh,et al.  Impact of communication medium on task performance and satisfaction: an examination of media-richness theory , 1999, Inf. Manag..

[173]  Andrea Giessmann,et al.  Leveraging the Software Ecosystem - Towards a Business Model Framework for Marketplaces , 2012, DCNET/ICE-B/OPTICS.

[174]  Samuel Fricker,et al.  Analytics for Product Planning: In-Depth Interview Study with SaaS Product Managers , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[175]  M. Ghanbari,et al.  Video streaming , .

[176]  Abigail Sellen,et al.  User sketches: a quick, inexpensive, and effective way to elicit more reflective user feedback , 2006, NordiCHI '06.

[177]  Ladan Tahvildari,et al.  Towards a goal‐driven approach to action selection in self‐adaptive software , 2012, Softw. Pract. Exp..

[178]  Lingfen Sun,et al.  Quality of experience-driven adaptation scheme for video applications over wireless networks , 2010, IET Commun..

[179]  Sjaak Brinkkemper,et al.  Method engineering: engineering of information systems development methods and tools , 1996, Inf. Softw. Technol..

[180]  Sabrina Hirsch,et al.  Requirements By Collaboration Workshops For Defining Needs , 2016 .

[181]  Cornelius Ncube,et al.  Adaptive software-based Feedback Acquisition: A Persona-based design , 2015, 2015 IEEE 9th International Conference on Research Challenges in Information Science (RCIS).

[182]  Kurt Matzler,et al.  THE KANO MODEL: HOW TO DELIGHT YOUR CUSTOMERS , 1996 .

[183]  Mark Keil,et al.  The user–developer communication process: a critical case study , 2003, Inf. Syst. J..

[184]  Claes Wohlin,et al.  Using Students as Subjects—A Comparative Study of Students and Professionals in Lead-Time Impact Assessment , 2000, Empirical Software Engineering.

[185]  Jeffrey C. Carver,et al.  Issues in using students in empirical studies in software engineering education , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[186]  Meir M. Lehman.  Feedback in the software evolution process , 1996, Inf. Softw. Technol..

[187]  David Parmenter,et al.  Key Performance Indicators: Developing, Implementing,and Using Winning KPIs , 2007 .

[188]  Radu Grosu,et al.  Cyber-physical systems: challenge of the 21st century , 2016, e & i Elektrotechnik und Informationstechnik.

[189]  Barbara Paech,et al.  MOQARE: misuse-oriented quality requirements engineering , 2008, Requirements Engineering.

[190]  Richard W. Scamell,et al.  The Effects of Information System User Expectations on Their Performance and Perceptions , 1993, MIS Q..

[191]  Keith H. Bennett,et al.  A Staged Model for the Software Life Cycle , 2000, Computer.

[192]  Jan Bosch,et al.  Building Products as Innovation Experiment Systems , 2012, ICSOB.

[193]  R. Feldt,et al.  A systematic review on strategic release planning models , 2010, Inf. Softw. Technol..

[194]  Myron B. Allen.  The Physical System , 1984 .

[195]  Christof Ebert,et al.  Software Product Management , 2014, IEEE Software.

[196]  Linda Gorchels.  The Product Manager's Handbook: The Complete Product Management Resource , 2000 .

[197]  Martin Glinz,et al.  On Non-Functional Requirements , 2007, 15th IEEE International Requirements Engineering Conference (RE 2007).

[198]  Fabiano Dalpiaz.  Social threats and the new challenges for Requirements Engineering , 2011, 2011 First International Workshop on Requirements Engineering for Social Computing.

[199]  A. McMichael,et al.  Assessing ecosystem health. , 1998, Trends in ecology & evolution.

[200]  Koo Ping Shung,et al.  APPLICATION OF ANALYTICS IN BUSINESS STRATEGY , 2012 .

[201]  Robert Phaal,et al.  Technology roadmapping—A planning framework for evolution and revolution , 2004 .

[202]  H. M. Collins,et al.  Tacit and Explicit Knowledge , 2010 .

[203]  P. Jordan.  Human factors for pleasure in product use. , 1998, Applied ergonomics.

[204]  Norbert Seyff,et al.  End-user Driven Feedback Prioritization , 2017, REFSQ Workshops.

[205]  Judy Chuan-Chuan Lin.  Mobile Human Computer Interaction , .

[206]  Walid Maalej,et al.  On the Socialness of Software , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[207]  R. Garland.  The Mid-Point on a Rating Scale: Is it Desirable? , 1991 .

[208]  Ikujiro Nonaka,et al.  The knowledge-creating theory revisited: knowledge creation as a synthesizing process , 2003 .

[209]  Stephan Krusche,et al.  Context-Aware User Feedback in Continuous Software Evolution , 2016, 2016 IEEE/ACM International Workshop on Continuous Software Evolution and Delivery (CSED).

[210]  Gregory L. Richards,et al.  The Information Technology Ecosystem: Structure, Health, and Performance , 2006 .

[211]  Maria Haigh,et al.  Software quality, non-functional software requirements and IT-business alignment , 2010, Software Quality Journal.

[212]  Eric Knauss,et al.  Structured and unobtrusive observation of anonymous users and their context for requirements elicitation , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[213]  Steve Blank.  Why the Lean Start-Up Changes Everything , 2013 .

[214]  Michael W. Godfrey,et al.  The past, present, and future of software evolution , 2008, 2008 Frontiers of Software Maintenance.

[215]  Robert Costanza,et al.  What is a healthy ecosystem? , 1999, Aquatic Ecology.

[216]  Christof Ebert,et al.  The impacts of software product management , 2007, J. Syst. Softw..

[217]  Danny Raz,et al.  Efficient reactive monitoring , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[218]  Peter Forbrig,et al.  Does Continuous Requirements Engineering need Continuous Software Engineering? , 2017, REFSQ Workshops.

[219]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[220]  Heather Goldsby,et al.  Goal-Based Modeling of Dynamically Adaptive System Requirements , 2008, 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008).

[221]  Anna Perini,et al.  An ontology of online user feedback in software engineering , 2015, Appl. Ontology.

[222]  Cornelius Ncube,et al.  The design of adaptive acquisition of users feedback: An empirical study , 2014, 2014 IEEE Eighth International Conference on Research Challenges in Information Science (RCIS).

[223]  Samuel Fricker,et al.  Release Planning with Feature Trees: Industrial Case , 2012, REFSQ.

[224]  Torgeir Dingsøyr,et al.  Knowledge management in software engineering: A systematic review of studied concepts, findings and research methods used , 2008, Inf. Softw. Technol..

[225]  Daniel A. Menascé,et al.  QoS Issues in Web Services , 2002, IEEE Internet Comput..

[226]  Sari Kujala,et al.  Emotions, experiences and usability in real-life mobile phone use , 2013, CHI.

[227]  Peter H. M. P. Roelofsma,et al.  The Effect of Dominance Manipulation on the Perception and Believability of an Emotional Expression , 2014, Emotion Modeling.

[228]  M. Fiedler,et al.  Quality of experience hourglass model , 2013, 2013 International Conference on Computing, Management and Telecommunications (ComManTel).

[229]  Jane Cleland-Huang,et al.  The incremental funding method: data-driven software development , 2004, IEEE Software.

[230]  Norbert Seyff,et al.  Feedback Gathering from an Industrial Point of View , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[231]  Volker Wulf,et al.  In-situ everywhere: a qualitative feedback infrastructure for cross platform home-IT , 2012, EuroITV.

[232]  Markus Fiedler,et al.  Quality of Experience-related differential equations and provisioning-delivery hysteresis , 2010 .

[233]  Tony Gorschek,et al.  Handshaking with Implementation Proposals: Negotiating Requirements Understanding , 2010, IEEE Software.

[234]  Martin Glinz,et al.  Comparison of Requirements Hand-off, Analysis, and Negotiation: Case Study , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[235]  Neil A. M. Maiden,et al.  Power and politics in requirements engineering: embracing the dark side? , 2012, Requirements Engineering.

[236]  Jan Bosch,et al.  From software product lines to software ecosystems , 2009, SPLC.

[237]  Zheng Yan,et al.  Factors affecting response rates of the web survey: A systematic review , 2010, Comput. Hum. Behav..

[238]  Sari Kujala,et al.  user involvement in product development by improving the analysis of user needs , 2016 .

[239]  Francisco Facchinei,et al.  User profile based Quality of Experience , 2014 .

[240]  D. Goderis,et al.  Service level agreements: a main challenge for next generation networks , 2002, 2nd European Conference on Universal Multiservice Networks. ECUMN'2001 (Cat. No.02EX563).

[241]  A. Dennis,et al.  Paradox of richness: a cognitive model of media choice , 2005, IEEE Transactions on Professional Communication.

[242]  Markus Fiedler,et al.  The effect of requests for user feedback on Quality of Experience , 2017, Software Quality Journal.

[243]  Roel Wieringa,et al.  Design Science Methodology for Information Systems and Software Engineering , 2014, Springer Berlin Heidelberg.

[244]  Selim Ickin,et al.  Factors influencing quality of experience of commonly used mobile applications , 2012, IEEE Communications Magazine.

[245]  Arkady B. Zaslavsky,et al.  A probabilistic context-aware approach for quality of experience measurement in pervasive systems , 2011, SAC.

[246]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[247]  H. Kittlaus,et al.  Software Product Management and Pricing: Key Success Factors for Software Organizations , 2009 .

[248]  Xavier Franch,et al.  How Can Quality Awareness Support Rapid Software Development? - A Research Preview , 2017, REFSQ.

[249]  Didar Zowghi,et al.  Requirements Elicitation: A Survey of Techniques, Approaches, and Tools , 2005 .

[250]  Xavier Franch,et al.  A software reference architecture for semantic-aware Big Data systems , 2017, Inf. Softw. Technol..

[251]  John Grundy,et al.  Reporting Usability Defects: Limitations of Open Source Defect Repositories and Suggestions for Improvement , 2015, ASWEC.

[252]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[253]  Aino Ahtinen,et al.  User experiences of mobile wellness applications in health promotion: User study of Wellness Diary, Mobile Coach and SelfRelax , 2009, 2009 3rd International Conference on Pervasive Computing Technologies for Healthcare.

[254]  Shari Lawrence Pfleeger,et al.  Personal Opinion Surveys , 2008, Guide to Advanced Empirical Software Engineering.