Conceptional Framework for the Objective Work-Related Quality of Life Measurement Through Multimodal Data Integration from Wearables and Digital Interaction
Jenny Voigt, Jakob Hohn, Ekaterina Mut, Celine Schreiber, Sophia Mareike Geisler, Pauline Sophia Pinta, Alisa Hamm, Hamlet Kosakyan, Juliette-Michelle Burkhardt, Christian Hrach, Ulf-Dietrich Braumann, Franziska Stutzer, Hubert Österle, Bogdan Franczyk, Carsta Militzer-Horstmann
DOI: http://dx.doi.org/10.15439/2024F9093
Citation: Position Papers of the 19th Conference on Computer Science and Intelligence Systems, M. Bolanowski, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 40, pages 61–68 (2024)
Abstract. In the evolving domain of occupational health, assessment of Work-related Quality of Life (WrQoL) has gained critical importance, particularly with recent expedited developments of decentralized and digital work. Conventional methods relying on subjective questionnaires are limited by high drop-out rates and potential biases. This paper introduces a novel approach to evaluating WrQoL by leveraging data generated from digital office environments, wearable devices, and smartphone applications. Our methodology includes the collection of physiological data, analysis of digital interactions, and prosody analysis to construct a comprehensive model of WrQoL influences. Initial and weekly questionnaires as well as multiple daily self-reports of valence and arousal levels will serve to initially validate this model. Prospectively utilizing machine learning, we aim to predict WrQoL scores from aggregated data. This method presents a non-invasive alternative for assessing WrQoL, providing significant implications for both research and industry with the potential to enhance workplace conditions and employee well-being.
References
- J. H. Greenhaus, K. M. Collins, and J. D. Shaw, “The relation between work–family balance and quality of life,” JOURNAL OF VOCATIONAL BEHAVIOR, vol. 63, no. 3, pp. 510–531, 2003, http://dx.doi.org/10.1016/S0001-8791(02)00042-8.
- J. Goh, J. Pfeffer, and S. A. Zenios, “Workplace Stressors & Health Outcomes: Health Policy for the Workplace,” Behavioral Science & Policy, no. 1, pp. 43–52, 2015.
- WHOQOL Group, “Development of the World Health Organization WHOQOL-BREF quality of life assessment. The WHOQOL Group,” Psychological medicine, vol. 28, no. 3, pp. 551–558, 1998, http://dx.doi.org/10.1017/s0033291798006667.
- Eurostat, “Final report of the expert group on quality of life indicators,” 2017. Accessed: Mar. 1 2024. [Online]. Available: https://ec.europa.eu/eurostat/documents/7870049/7960327/KS-FT-17-004-EN-N.pdf/f29171db-e1a9-4af6-9e96-730e7e11e02f
- M. Durand, “The OECD Better Life Initiative: How's Life? and the Measurement of Well‐Being,” Review of Income and Wealth, vol. 61, no. 1, pp. 4–17, 2015, http://dx.doi.org/10.1111/roiw.12156.
- C. Mendes and H. Pereira, “Assessing the Impact of COVID-19 on Work-Related Quality of Life through the Lens of Sexual Orientation,” Behavioral sciences (Basel, Switzerland), vol. 11, no. 5, 2021, http://dx.doi.org/10.3390/bs11050058.
- A. Jaiswal and A. Mahila, “Quality of work life,” Journal of Business Management & Social Sciences Research, 02.2014, pp. 83–87, 2014. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=2cfb960da043838669f9f75bda049c193e60e3a8
- J. Leitão, D. Pereira, and Â. Gonçalves, “Quality of Work Life and Contribution to Productivity: Assessing the Moderator Effects of Burnout Syndrome,” Int. J. Environ. Res. Public Health, vol. 18, no. 5, 2021, http://dx.doi.org/10.3390/ijerph18052425.
- S. Wang, D. Kamerade, B. Burchell, A. Coutts, and S. U. Balderson, “What matters more for employees' mental health: Job quality or job quantity?,” Camb. J. Econ., vol. 46, no. 2, pp. 251–274, 2022, http://dx.doi.org/10.1093/cje/beab054.
- D. J. Horst, E. E. Broday, R. Bondarick, L. F. Serpe, and L. A. Pilatti, “Quality of Working Life and Productivity: An Overview of the Conceptual Framework,” International Journal of Managerial Studies and Research, 07.2014, pp. 87–98, 2014.
- C. Seale, Ed., Researching society and culture, 3rd ed. Los Angeles, Calif.: Sage, 2011.
- M. L. Patten, Questionnaire Research: A Practical Guide, 4th ed. Los Angeles: Taylor and Francis, 2014. [Online]. Available: http://gbv.eblib.com/patron/FullRecord.aspx?p=4710457
- A. Alberdi, A. Aztiria, and A. Basarab, “Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review,” Journal of biomedical informatics, vol. 59, pp. 49–75, 2016, http://dx.doi.org/10.1016/j.jbi.2015.11.007.
- N. Nappo, “Job stress and interpersonal relationships cross country evidence from the EU15: a correlation
- analysis,” BMC PUBLIC HEALTH, vol. 20, no. 1, p. 1143, 2020, http://dx.doi.org/10.1186/s12889-020-09253-9. T. Androutsou, S. Angelopoulos, E. Hristoforou, G. K. Matsopoulos, and D. D. Koutsouris, “Automated Multimodal Stress Detection in Computer Office Workspace,” Electronics, vol. 12, no. 11, p. 2528, 2023, http://dx.doi.org/10.3390/electronics12112528. E. Sükei, A. Norbury, M. M. Perez-Rodriguez, P. M. Olmos, and A. Artés, “Predicting Emotional States Using Behavioral Markers Derived From Passively Sensed Data: Data-Driven Machine Learning Approach,” JMIR mHealth and uHealth, vol. 9, no. 3, e24465, 2021, http://dx.doi.org/10.2196/24465. M. Naegelin et al., “An interpretable machine learning approach to multimodal stress detection in a simulated office environment,” Journal of biomedical informatics, vol. 139, p. 104299, 2023, http://dx.doi.org/10.1016/j.jbi.2023.104299. V. R. Shinde, K. R. Sonawane, A. D. Bhawar, and H. D. Walam, Eds., Real time-Employee Emotion Detection system (RTEED) using Machine Learning. Zenodo, 2023. S. Majumder, T. Mondal, and M. J. Deen, “Wearable Sensors for Remote Health Monitoring,” Sensors (Basel, Switzerland), vol. 17, no. 1, 2017, http://dx.doi.org/10.3390/s17010130. F. Shaffer and J. P. Ginsberg, “An Overview of Heart Rate Variability Metrics and Norms,” Front. Public Health, vol. 5, p. 258, 2017, http://dx.doi.org/10.3389/fpubh.2017.00258. G. Ernst, “Hidden Signals-The History and Methods of Heart Rate Variability,” Front. Public Health, vol. 5, p. 265, 2017, http://dx.doi.org/10.3389/fpubh.2017.00265. S. Saganowski, “Bringing Emotion Recognition Out of the Lab into Real Life: Recent Advances in Sensors and Machine Learning,” Electronics, vol. 11, no. 3, p. 496, 2022, http://dx.doi.org/10.3390/electronics11030496. M. N. Burns et al., “Harnessing context sensing to develop a mobile intervention for depression,” Journal of medical Internet research, vol. 13, no. 3, e55, 2011, http://dx.doi.org/10.2196/jmir.1838. A. Hart, D. Reis, E. Prestele, and N. C. Jacobson, “Using Smartphone Sensor Paradata and Personalized Machine Learning Models to Infer Participants' Well-being: Ecological Momentary Assessment,” Journal of medical Internet research, vol. 24, no. 4, e34015, 2022, http://dx.doi.org/10.2196/34015. A. Pawlicka, M. Pawlicki, R. Tomaszewska, M. Choraś, and R. Gerlach, “Innovative machine learning approach and evaluation campaign for predicting the subjective feeling of work-life balance among employees,” PloS one, vol. 15, no. 5, e0232771, 2020, http://dx.doi.org/10.1371/journal.pone.0232771. N. S. Gamage and D. P. Asanka, “Machine Learning Approach to Predict Mental Distress of IT Workforce in Remote Working Environments,” in 2022 International Research Conference on Smart Computing and Systems Engineering (SCSE), Colombo, Sri Lanka, 2022, pp. 211–216.
- S. Bromuri, A. P. Henkel, D. Iren, and V. Urovi, “Using AI to predict service agent stress from emotion patterns in service interactions,” J. Serv. Manage., vol. 32, no. 4, pp. 581–611, 2021, http://dx.doi.org/10.1108/JOSM-06-2019-0163.
- A. Baird et al., “An Evaluation of Speech-Based Recognition of Emotional and Physiological Markers of Stress,” Front. Comput. Sci., vol. 3, 2021, http://dx.doi.org/10.3389/fcomp.2021.750284.
- J. A. Russell, “A circumplex model of affect,” Journal of personality and social psychology, vol. 39, no. 6, pp. 1161–1178, 1980, http://dx.doi.org/10.1037/h0077714.
- L. Pepa, A. Sabatelli, L. Ciabattoni, A. Monteriu, F. Lamberti, and L. Morra, “Stress Detection in Computer Users From Keyboard and Mouse Dynamics,” IEEE Trans. Consumer Electron., vol. 67, no. 1, pp. 12–19, 2021, doi: 10.1109/TCE.2020.3045228.
- N. Banholzer, S. Feuerriegel, E. Fleisch, G. F. Bauer, and T. Kowatsch, “Computer Mouse Movements as an Indicator of Work Stress: Longitudinal Observational Field Study,” Journal of medical Internet research, vol. 23, no. 4, e27121, 2021, http://dx.doi.org/10.2196/27121.
- M. M. Bradley and P. J. Lang, “Measuring emotion: the Self-Assessment Manikin and the Semantic Differential,” Journal of behavior therapy and experimental psychiatry, vol. 25, no. 1, pp. 49–59, 1994, http://dx.doi.org/10.1016/0005-7916(94)90063-9.
- P. T. van Katwyk, S. Fox, P. E. Spector, and E. K. Kelloway, “Using the Job-Related Affective Well-Being Scale (JAWS) to investigate affective responses to work stressors,” J. Occup. Health Psychol., 1939-1307(Electronic),1076-8998(Print), pp. 219–230, 2000, http://dx.doi.org/10.1037/1076-8998.5.2.219.
- R. М. Baevsky and A. G. Chernikova, “Heart rate variability analysis: physiological foundations and main methods,” Cardiometry, no. 10, pp. 66–76, 2017, http://dx.doi.org/10.12710/cardiometry.2017.10.6676.
- M. A. Almazrouei, R. M. Morgan, and I. E. Dror, “A method to induce stress in human subjects in online research environments,” BEHAVIOR RESEARCH METHODS, vol. 55, no. 5, pp. 2575–2582, 2023, doi: 10.3758/s13428-022-01915-3.
- X. Li et al., “Stress and Emotion Classification using Jitter and Shimmer Features,” in 2007 IEEE International Conference on Acoustics, Speech and Signal Processing: ICASSP 2007] ; Honolulu, HI, 16 [i.e. 15] - 20 April 2007, Honolulu, HI, 2007, IV-1081-IV-1084.
- D. M. Ahmed, M. M. Hassan, and R. J. Mstafa, “A Review on Deep Sequential Models for Forecasting Time Series Data,” Applied Computational Intelligence and Soft Computing, vol. 2022, pp. 1–19, 2022, http://dx.doi.org/10.1155/2022/6596397.