Using machine learning algorithm to predict the risk of post-traumatic stress disorder among firefighters in Changsha.

OBJECTIVES

Firefighters are prone to suffer from psychological trauma and post-traumatic stress disorder (PTSD) in the workplace, and have a poor prognosis after PTSD. Reliable models for predicting PTSD allow for effective identification and intervention for patients with early PTSD. By collecting the psychological traits, psychological states and work situations of firefighters, this study aims to develop a machine learning algorithm with the aim of effectively and accurately identifying the onset of PTSD in firefighters, as well as detecting some important predictors of PTSD onset.

METHODS

This study conducted a cross-sectional survey through convenient sampling of firefighters from 20 fire brigades in Changsha, which were evenly distributed across 6 districts and Changsha County, with a total of 628 firefighters. We used the synthetic minority oversampling technique (SMOTE) to process data sets and used grid search to finish the parameter tuning. The predictive capability of several commonly used machine learning models was compared by 5-fold cross-validation and using the area under the receiver operating characteristic curve (ROC-AUC), accuracy, precision, recall, and F1 score.

RESULTS

The random forest model achieved good performance in predicting PTSD with an average AUC score at 0.790. The mean accuracy of the model was 90.1%, with an F1 score of 0.945. The three most important predictors were perseverance, forced thinking, and reflective deep thinking, with weights of 0.165, 0.158, and 0.152, respectively. The next most important predictors were employment time, psychological power, and optimism.

CONCLUSIONS

PTSD onset prediction model for Changsha firefighters constructed by random forest has strong predictive ability, and both psychological characteristics and work situation can be used as predictors of PTSD onset risk for firefighters. In the next step of the study, validation using other large datasets is needed to ensure that the predictive models can be used in clinical setting.