Assessing operator stress in collaborative robotics: A multimodal approach

Appl Ergon. 2025 Feb:123:104418. doi: 10.1016/j.apergo.2024.104418. Epub 2024 Nov 16.

Abstract

In the era of Industry 4.0, the study of Human-Robot Collaboration (HRC) in advancing modern manufacturing and automation is paramount. An operator approaching a collaborative robot (cobot) may have feelings of distrust, and experience discomfort and stress, especially during the early stages of training. Human factors cannot be neglected: for efficient implementation, the complex psycho-physiological state and responses of the operator must be taken into consideration. In this study, volunteers were asked to carry out a set of cobot programming tasks, while several physiological signals, such as electroencephalogram (EEG), electrocardiogram (ECG), Galvanic skin response (GSR), and facial expressions were recorded. In addition, a subjective questionnaire (NASA-TLX) was administered at the end, to assess if the derived physiological parameters are related to the subjective perception of stress. Parameters exhibiting a higher degree of alignment with subjective perception are mean Theta (76.67%), Alpha (70.53%) and Beta (67.65%) power extracted from EEG, recovery time (72.86%) and rise time (71.43%) extracted from GSR and heart rate variability (HRV) metrics PNN25 (71.58%), SDNN (70.53%), PNN50 (68.95%) and RMSSD (66.84%). Parameters extracted from raw RR Intervals appear to be more variable and less accurate (42.11%) so as recorded emotions (51.43%).

Keywords: Cobot programming; Human monitoring; Human–Robot Collaboration; Psycho-physiological signals; Stress evaluation; Wearable sensors.

MeSH terms

  • Adult
  • Cooperative Behavior
  • Electrocardiography*
  • Electroencephalography*
  • Female
  • Galvanic Skin Response*
  • Heart Rate* / physiology
  • Humans
  • Male
  • Man-Machine Systems
  • Occupational Stress* / psychology
  • Robotics*
  • Surveys and Questionnaires
  • Task Performance and Analysis
  • Young Adult