Logo PTI Logo FedCSIS

Proceedings of the 16th Conference on Computer Science and Intelligence Systems

Annals of Computer Science and Information Systems, Volume 25

The Virtual Emotion Loop: Towards Emotion-Driven Product Design via Virtual Reality

, , , ,

DOI: http://dx.doi.org/10.15439/2021F120

Citation: Proceedings of the 16th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 25, pages 371–378 ()

Full text

Abstract. Emotions play a significant role in product design for end-users. However, how to take emotions into account is not yet completely understood. We argue that this gap is due to a lack of methodological and technological frameworks for effective investigation of the elicitation conditions related to emotions and corresponding emotional responses of the users. Emotion-driven design should encompass a thorough assessment of users' emotional reactions in relation to certain elicitation conditions. By using Virtual Reality (VR) as mean to perform this investigation, we propose a novel methodological framework, referred to as the VR-Based Emotion-Elicitation-and-Recognition loop (VEE-loop), to close this gap.

References

  1. T. Alaniz and S. Biazzo, “Emotional design: the development of a process to envision emotion-centric new product ideas,” Procedia Computer Science, vol. 158, pp. 474–484, 2019.
  2. G. Zaltman, “The subconscious mind of the consumer (and how to reach it),” Harvard Business School. Working Knowledge. Obtenido de http://hbswk. hbs. edu/item/3246. html, 2003.
  3. C. Wrigley and K. Straker, Affected: Emotionally engaging customers in the digital age. John Wiley & Sons, 2019.
  4. R. Dou, Y. Zhang, and G. Nan, “Iterative product design through group opinion evolution,” International Journal of Production Research, vol. 55, no. 13, pp. 3886–3905, 2017.
  5. P. B. Luh, F. Liu, and B. Moser, “Scheduling of design projects with uncertain number of iterations,” European Journal of Operational Research, vol. 113, no. 3, pp. 575–592, 1999.
  6. G. Riva, F. Mantovani, C. S. Capideville, A. Preziosa, F. Morganti, D. Villani, A. Gaggioli, C. Botella, and M. Alcañiz, “Affective interactions using virtual reality: the link between presence and emotions,” CyberPsychology & Behavior, vol. 10, no. 1, pp. 45–56, 2007.
  7. A. Ortigosa, J. M. Martín, and R. M. Carro, “Sentiment analysis in facebook and its application to e-learning,” Computers in human behavior, vol. 31, pp. 527–541, 2014.
  8. M. Nagamachi, “Kansei engineering: a new ergonomic consumer-oriented technology for product development,” International Journal of industrial ergonomics, vol. 15, no. 1, pp. 3–11, 1995.
  9. Y. Liu, O. Sourina, and M. R. Hafiyyandi, “Eeg-based emotion-adaptive advertising,” in 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction. IEEE, 2013, pp. 843–848.
  10. P. Desmet, “Designing emotions,” 2002.
  11. S. Sinek, Start with why: How great leaders inspire everyone to take action. Penguin, 2009.
  12. N. H. Frijda et al., The emotions. Cambridge University Press, 1986.
  13. P. M. Desmet, S. F. Fokkinga, D. Ozkaramanli, and J. Yoon, “Emotion-driven product design,” in Emotion Measurement. Elsevier, 2016, pp. 405–426.
  14. C. Kim, J. Yoon, P. Desmet, and A. Pohlmeyer, “Designing for positive emotions: Issues and emerging research directions,” 2021.
  15. J. Yoon, A. E. Pohlmeyer, and P. Desmet, “When’feeling good’is not good enough: Seven key opportunities for emotional granularity in product development,” International Journal of Design, vol. 10, no. 3, pp. 1–15, 2016.
  16. E. Sauerwein, F. Bailom, K. Matzler, and H. H. Hinterhuber, “The kano model: How to delight your customers,” in International working seminar on production economics, vol. 1, no. 4, 1996, pp. 313–327.
  17. J. Diemer, G. W. Alpers, H. M. Peperkorn, Y. Shiban, and A. Mühlberger, “The impact of perception and presence on emotional reactions: a review of research in virtual reality,” Frontiers in Psychology, vol. 6, p. 26, 2015. [Online]. Available: https://www.frontiersin.org/article/10.3389/fpsyg.2015.00026
  18. J. Marín-Morales, J. L. Higuera-Trujillo, A. Greco, J. Guixeres, C. Llinares, C. Gentili, E. P. Scilingo, M. Alcañiz, and G. Valenza, “Real vs. immersive-virtual emotional experience: Analysis of psycho-physiological patterns in a free exploration of an art museum,” PLOS ONE, vol. 14, no. 10, pp. 1–24, 10 2019. [Online]. Available: https://doi.org/10.1371/journal.pone.0223881
  19. S. K. Babu, S. Krishna, U. R., and R. R. Bhavani, “Virtual reality learning environments for vocational education: A comparison study with conventional instructional media on knowledge retention.” in 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), 2018, pp. 385–389.
  20. C. Floris, S. Solbiati, F. Landreani, G. Damato, B. Lenzi, V. Megale, and E. G. Caiani, “Feasibility of heart rate and respiratory rate estimation by inertial sensors embedded in a virtual reality headset,” Sensors, vol. 20, no. 24, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/24/7168
  21. M. Buccoli, M. Zanoni, A. Sarti, S. Tubaro, and D. Andreoletti, “Unsupervised feature learning for music structural analysis,” in 2016 24th European Signal Processing Conference (EUSIPCO). IEEE, 2016, pp. 993–997.
  22. A. Mehrabian, “Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament,” Current Psychology, vol. 14, no. 4, pp. 261–292, 1996.
  23. S. B. i Badia, L. V. Quintero, M. S. Cameirão, A. Chirico, S. Triberti, P. Cipresso, and A. Gaggioli, “Toward emotionally adaptive virtual reality for mental health applications,” IEEE journal of biomedical and health informatics, vol. 23, no. 5, pp. 1877–1887, 2018.
  24. J. Marín Morales, “Modelling human emotions using immersive virtual reality, physiological signals and behavioural responses,” Ph.D. dissertation, 2020.
  25. A. Saxena, A. Khanna, and D. Gupta, “Emotion recognition and detection methods: A comprehensive survey,” Journal of Artificial Intelligence and Systems, vol. 2, no. 1, pp. 53–79, 2020.
  26. S. Susindar, M. Sadeghi, L. Huntington, A. Singer, and T. K. Ferris, “The feeling is real: Emotion elicitation in virtual reality,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 63, no. 1. SAGE Publications Sage CA: Los Angeles, CA, 2019, pp. 252–256.
  27. K. Fung, C. K. Kwong, K. W. M. Siu, and K. M. Yu, “A multi-objective genetic algorithm approach to rule mining for affective product design,” Expert Systems with Applications, vol. 39, no. 8, pp. 7411–7419, 2012.
  28. M. Polignano, F. Narducci, M. de Gemmis, and G. Semeraro, “Towards emotion-aware recommender systems: an affective coherence model based on emotion-driven behaviors,” Expert Systems with Applications, vol. 170, p. 114382, 2021.
  29. M. B. Mariappan, M. Suk, and B. Prabhakaran, “Facefetch: A user emotion driven multimedia content recommendation system based on facial expression recognition,” in 2012 IEEE International Symposium on Multimedia. IEEE, 2012, pp. 84–87.
  30. N. Sindhu, S. Jerritta, and R. Anjali, “Emotion driven mood enhancing multimedia recommendation system using physiological signal,” in IOP Conference Series: Materials Science and Engineering, vol. 1070, no. 1. IOP Publishing, 2021, p. 012070.
  31. N. Condori-Fernandez, “Happyness: an emotion-aware qos assurance framework for enhancing user experience,” in 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C). IEEE, 2017, pp. 235–237.
  32. M. S. Hossain, G. Muhammad, B. Song, M. M. Hassan, A. Alelaiwi, and A. Alamri, “Audio–visual emotion-aware cloud gaming framework,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 12, pp. 2105–2118, 2015.
  33. S. Munoz, O. Araque, J. F. Sánchez-Rada, and C. A. Iglesias, “An emotion aware task automation architecture based on semantic technologies for smart offices,” Sensors, vol. 18, no. 5, p. 1499, 2018.
  34. V. De Luca, “Emotions-based interactions: Design challenges for increasing well-being,” 2016.
  35. V. a. De Luca, “Oltre l’interfaccia: emozioni e design dell’interazione per il benessere,” MD Journal, vol. 1, no. 1, pp. 106–119, 2016.