Who Is at Risk of Poor Mental Health Following Coronavirus Disease-19 Outpatient Management?
Katharina Hüfner1 
Piotr Tymoszuk2,3 
Dietmar Ausserhofer4 
Sabina Sahanic3 Alex Pizzini3 Verena Rass5 
Matyas Galffy1 Anna Böhm3 
Katharina Kurz3 Thomas Sonnweber3 
Ivan Tancevski3 Stefan Kiechl5 
Andreas Huber6 Barbara Plagg4 Christian J. Wiedermann4 
Rosa Bellmann-Weiler3 
Herbert Bachler7 
Günter Weiss3 Giuliano Piccoliori4 
Raimund Helbok5 Judith Loeffler-Ragg3* 
Barbara Sperner-Unterweger1
- 1Department of Psychiatry, Psychotherapy, Psychosomatics and Medical Psychology, University Hospital for Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
- 2Data Analytics as a Service Tirol, Innsbruck, Austria
- 3Department of Internal Medicine II, Medical University of Innsbruck, Innsbruck, Austria
- 4Institute of General Practice and Public Health, Claudiana Bolzano, Bolzano, Italy
- 5Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria
- 6Tyrolean Federal Institute for Integrated Care, Innsbruck, Austria
- 7Institute of General Medicine, Medical University of Innsbruck, Innsbruck, Austria
Background: Coronavirus Disease-19 (COVID-19) convalescents are at risk of developing a de novo mental health disorder or worsening of a pre-existing one. COVID-19 outpatients have been less well characterized than their hospitalized counterparts. The objectives of our study were to identify indicators for poor mental health following COVID-19 outpatient management and to identify high-risk individuals.
Methods: We conducted a binational online survey study with adult non-hospitalized COVID-19 convalescents (Austria/AT: n = 1,157, Italy/IT: n = 893). Primary endpoints were positive screening for depression and anxiety (Patient Health Questionnaire; PHQ-4) and self-perceived overall mental health (OMH) and quality of life (QoL) rated with 4 point Likert scales. Psychosocial stress was surveyed with a modified PHQ stress module. Associations of the mental health and QoL with socio-demographic, COVID-19 course, and recovery variables were assessed by multi-parameter Random Forest and Poisson modeling. Mental health risk subsets were defined by self-organizing maps (SOMs) and hierarchical clustering algorithms. The survey analyses are publicly available (https://im2-ibk.shinyapps.io/mental_health_dashboard/).
Results: Depression and/or anxiety before infection was reported by 4.6% (IT)/6% (AT) of participants. At a median of 79 days (AT)/96 days (IT) post-COVID-19 onset, 12.4% (AT)/19.3% (IT) of subjects were screened positive for anxiety and 17.3% (AT)/23.2% (IT) for depression. Over one-fifth of the respondents rated their OMH (AT: 21.8%, IT: 24.1%) or QoL (AT: 20.3%, IT: 25.9%) as fair or poor. Psychosocial stress, physical performance loss, high numbers of acute and sub-acute COVID-19 complaints, and the presence of acute and sub-acute neurocognitive symptoms (impaired concentration, confusion, and forgetfulness) were the strongest correlates of deteriorating mental health and poor QoL. In clustering analysis, these variables defined subsets with a particularly high propensity of post-COVID-19 mental health impairment and decreased QoL. Pre-existing depression or anxiety (DA) was associated with an increased symptom burden during acute COVID-19 and recovery.
Conclusion: Our study revealed a bidirectional relationship between COVID-19 symptoms and mental health. We put forward specific acute symptoms of the disease as “red flags” of mental health deterioration, which should prompt general practitioners to identify non-hospitalized COVID-19 patients who may benefit from early psychological and psychiatric intervention.
Clinical Trial Registration: [ClinicalTrials.gov], identifier [NCT04661462].
Background
Prevalence of mental health disorders rose during the Coronavirus Disease-19 (COVID-19) pandemic in the general population from 4% in 2006 (1) to 20% for depression and from 5% in 2008 (2) to 19% for anxiety as of March 2020 (3). The mental health deterioration following COVID-19 was described primarily for hospitalized subjects (4). The frequency of depression or anxiety (DA) following inpatient COVID-19 treatment was estimated at approximately 25% at 5–12 months post-infection (5–7). A real-world analysis of 62,354 COVID-19 in- and outpatients at 14–90 days follow-up revealed the overall incidence of psychiatric conditions of 18.1% [95% CI: 17.6–18.6], out of which 5.8% [5.2–6.4] comprised de novo disorders (8). In the latter study, a pre-existing mental illness was put forward as a risk factor for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection suggestive of a bi-directional relationship between psychiatric conditions and COVID-19 (8). A large, medical record-based comparison of long-term sequelae in COVID-19 and non-COVID-19 healthcare system users revealed an excess of sleep/wake- (relative risk: 14.5 [11.5–17.3]), anxiety/fear- (5.4 [3.4–7.3]), and trauma/stress-related disorders (8.9 [6.6–11.1]) in COVID-19 convalescents at 6 months after the disease onset (9). Post-acute sequelae, such as mental health symptoms, occurred in decreasing frequency in intensive care unit (ICU) patients, inpatients, and outpatients (9). However, a smaller study found that individuals treated as outpatients showed worse mental health outcomes than those treated as inpatients (10). Hence, the prevalence and especially risk factors of mental health conditions and diminished quality of life (QoL) in COVID-19 outpatients, which may be missed from large-scale medical record analyses, cross-sectional, or inpatient survivor studies, are still insufficiently characterized. Since mild ambulatory cases comprise the great majority of COVID-19 patients (11), mental health sequelae may pose a significant burden to the healthcare system. For this reason, the characteristic of risk factors and subsets of patients at particular risk of post-COVID-19 is of great importance.
Machine learning (ML) and clustering algorithms gain importance at risk profiling and patient classification in high dimensional data sets in multiple conditions, i.e., COVID-19 (7, 12–16). The Random Forest procedure employs ensembles of multiple regression or classifier tree models trained in random subsets of the data set to predict the outcome (17, 18). As such, this algorithm is resistant to over-fitting (17) and was shown to reliably deal with large, multi-parameter imbalanced medical data sets (18). It also provides variable importance measures, which allow drawing conclusions on mechanistic relationships between the outcome and specific explanatory factors (15–17, 19). Self-organizing maps (SOMs) are a class of artificial neural network algorithms that enable the reduction of dimensionality of multi-parameter data sets, classification, and clustering of observations with similar properties (20, 21).
The binational “Health after COVID-19 in Tyrol” study aimed at exploring the disease course as well as physical and mental recovery in two cohorts of non-hospitalized convalescents (12). Herein, using multi-parameter Random Forest modeling, we sought to assess the impact of demographics, socioeconomics, comorbidities, COVID-19 disease symptoms and course, and psychosocial stress on anxiety, depression, self-perceived overall mental health (OMH), and QoL. By clustering analysis with SOMs, we aimed to identify individuals at risk of worsening mental health and QoL, which may particularly benefit from early psychological and psychiatric support. Finally, we made the study results publicly available as an online dashboard1 (22).
Materials and Methods
Bioethics
The study was conducted in accordance with the Declaration of Helsinki and the European data policy. Each participant gave a digitally signed informed consent to participate. The study protocol was reviewed and approved by the institutional review boards of the Medical University of Innsbruck (AT, approval number: 1257/2020) and of the Autonomous Province of Bolzano – South Tyrol (IT: 0150701).
Study Design and Approval
The multi-center online survey study “Health after COVID-19 in Tyrol” (ClinicalTrials.gov: NCT04661462) was conducted between the September 30, 2020 and July 11, 2021 in two cohorts independently recruited in Tyrol/Austria (AT) and South Tyrol/Italy (IT) (12). The study inclusion criteria were residency in the study regions, age of ≥16 (AT) or ≥18 years (IT), and a laboratory-confirmed SARS-CoV-2 infection (PCR or seropositivity). Respondents with a minimum observation time of <28 days between the infection diagnosis and survey completion or hospitalized because of COVID-19 were excluded from the analysis (Figure 1). The participants were invited by a public media call (AT and IT) or by their general practitioners (IT).
Figure 1. Study inclusion flow diagram.
Measures, Definitions, and Data Transformation
The detailed description of the questionnaire variables is provided in Supplementary Methods, Supplementary Table 1, and by Sahanic et al. (12).
Symptoms were classified as acute complaints present during the first 2 weeks after clinical onset, sub-acute symptoms present at 2–4 weeks after clinical onset, and persistent symptoms present for ≥4 weeks (12, 15). Confusion, impaired concentration, and forgetfulness were subsumed under “neurocognitive symptoms.”
Pre-existing health conditions, such as depression/anxiety and sleep disorders, were surveyed as single items each (question: “Previous illnesses (existing or previously experienced): (1) depression/anxiety, (2) insomnia,” answers: present/absent) (12). Self-perceived OMH (question: “How do you currently estimate your mental health?”) and QoL (question: “How do you estimate your current QoL?”) were rated with a 4-point Likert scale (“excellent,” “good,” “fair,” “poor,” scored: 0, 1, 2, and 3). Anxiety and depression at the survey completion were investigated using the Patient Health Questionnaire (PHQ-4) questionnaire (anxiety: “Since the COVID 19 infection: (1) have you experienced nervousness, anxiety? (2) were you not able to stop or control worries?” depression: “Since the COVID 19 infection: (1) have you experienced little interest of satisfaction at your activities? (2) have you experienced prostration, melancholy, or hopelessness?” answers: “not at all,” “at some days,” “at more than half of the days,” “almost every day,” scored: 0, 1, 2, and 3) (12, 22, 23), with ≥3 points cutoffs for the clinical signs of depression (DPR) or anxiety (ANX). Psychosocial stress was measured with a modified 7 item PHQ stress module (questions: “How much have you felt affected since the COVID 19 infection by the following problems: (1) worries about your health? (2) Difficulties with the spouse/partner? (3) Burden of care for children parents or other relatives? (4) Stress at work or school/training? (5) Financial problems or worries? (6) Worries about your workplace? (7) Thoughts or dreams on COVID-19?”r answers: “no,” “little,” “some,” “a lot,” scored: 0, 1, 2, and 3) (22, 24), without items on weight, sexuality, and past traumatic/serious events; the item on worries/dreams was adapted to COVID-19. Substantial psychosocial stress was defined by a ≥7 points cutoff.
Statistical Analysis
Data were analyzed with R version 4.0.5 (25, 26). Statistical significance of variable median or distribution differences between groups were determined by the Mann–Whitney (effect size: r statistic), Kruskal–Wallis (effect size: η2 statistic), or χ2 test (effect size: Cramer’s V), as appropriate. The correlation of numeric variables was investigated with Spearman ρ. Categorical variable co-occurrence was assessed by Cohen’s κ and Z test. R packages, DescTools, rstatix, R Companion, and vcd, were employed in hypothesis testing and correlation analysis. Values of p were corrected for multiple comparisons with the Benjamini-Hochberg method (27).
Data pre-processing prior to Random Forest modeling and clustering included minimum/maximum normalization of numeric explanatory features (Supplementary Table 1) and mental health scores. Numeric variables were not stratified prior to modeling or clustering. Random Forest models for ANX, DPR, OMH, and QoL scoring were trained, optimized, calibrated, and cross-validated (10-fold) in the AT training cohort (packages ranger, caret, and qgam) (17, 28–30) and validated in the IT collective. To account for possible effects of diagnosis – survey time, a continuous observation time variable was included in the models (Supplementary Table 1). The importance of explanatory variables in Random Forest modeling was determined by the unbiased difference in mean squared error (ΔMSE) (19, 29). The set of common influential variables from mental health and QoL scoring was determined as a common part of the top 20 most influential factors for ANX, DPR, OMH, and QoL each. Modeling of the impact of the common influential variables on mental scoring was accomplished with uni- and multivariate, age- and sex-weighted Poisson regression (12). The effects of the survey duration and observation time on mental health and QoL scoring was investigated by GAM (generalized additive modeling, package mgcv, cubic spline transformation of the independent variable). Clusters of the training AT cohort individuals were defined with the self-organized map procedure (SOM, 13 × 13 unit hexagonal grid, Manhattan distance, package Kohonen) and subsequent hierarchical clustering (Ward D2 algorithm, Manhattan distance) (20, 21, 31). Assignment of the test IT cohort participants to the clusters was done with the k-nearest neighbor label propagation algorithm (12, 32). Details of statistical analysis are provided in Supplementary Methods.
Results
Sociodemographic and Clinical Characteristics of the Study Cohorts
In total, 1,157 questionnaires in the AT and 893 in the IT cohort were analyzed (Figure 1). The observation time defined as the time period between the survey completion and the SARS-CoV-2 infection diagnosis was 79 (median, interquartile range [IQR]: 40–180) and 96 days (median, IQR: 60–140) in the AT and IT collective, respectively (Table 1). Detailed characteristics of the cohorts were reported by Sahanic et al. (12). In brief, study participants were predominantly working-age (31–65 years: AT: 71.9%, IT: 77.8%), women (AT: 65.1%, IT: 68.3%), and actively employed (>80%). Pre-existing co-morbidities were declared by 41.2% (IT) and 49.7% (AT) of participants. DA (AT: 6%, IT: 4.6%) and sleep disorders (AT: 4.6%, IT: 4%) before COVID-19 were reported by roughly 1 of 20 respondents (Table 1). Notably, the overlap between the pre-existing depression/anxiety and sleep problems was only minute (AT: Cohen’s κ = 0.21 [95% CI: 0.1–0.31], IT: κ = 0.17 [0.048–0.3]). The collectives significantly differed in language, education, employment structure, completion time, and the time interval between the diagnosis and survey completion (Table 1).
Table 1. Baseline characteristics of the study cohorts.
The percentage of asymptomatic cases ranged between 8.3% (AT) and 12.3% (IT) (Table 2). Respondents declared a median of 13 complaints (out of 44 features queried, IQR: AT: 9–18, IT: 7–18) present in the first 2 weeks after clinical onset. Persistent symptoms lasting for ≥28 days (12, 15) were discerned in 47.6% (AT) and 49.3% (IT). Roughly half of the participants suffered from acute neurocognitive symptoms (AT: 48%, IT: 50.4%), such as memory or concentration deficits or confusion, in 18.2% (AT) and 22.6% (IT) at least one persistent neurocognitive symptom was present. Self-perceived complete convalescence was reported by 54% (AT) and 63% (IT) of the respondents. The median loss of physical performance following COVID-19 was 13% in the AT (IQR: 1–26%) and 11% in the IT collective (IQR: 0–25%) (Table 2).
Table 2. Characteristics of the course of SARS-CoV2 infection and convalescence in the study cohorts.
At the time of study completion, i.e., approximately 12 weeks post-clinical COVID-19 onset, over one-fifth of the participants rated their OMH (AT: 21.8%, IT: 24.1%) or QoL (AT: 20.3%, IT: 25.9%) as fair or poor. At this time point, anxiety (ANX) was observed in 12.4% (AT) and 19.3% (IT), DPR in 17.3% (AT) and 23.2% (IT), and substantial psychosocial stress in 21.3% (AT) and 25.6% (IT) of the respondents [Table 3 and (22)]. ANX, DPR, OMH, QoL, and stress score displayed non-normal distribution with a strong skewing toward low values (Supplementary Figure 1). Importantly, the investigated mental health and QoL rating variables were only weakly associated with the participant’s observation time (R2 <0.011, Supplementary Figure 2) and the total survey duration (R2 <0.026, Supplementary Figure 3). ANX, DRP, OMH, and QoL scores were found moderately inter-correlated, with the strongest association between anxiety and depression scoring as well as OMH and QoL rating (Supplementary Figure 4A). The highest level of co-occurrence was found for clinical DPR and ANX (AT: Cohen’s κ = 0.46, IT: κ = 0.54, Supplementary Figure 4B). Of note, a similar pattern of correlation and overlap between the investigated mental health and QoL variables was observed in the participant subsets with pre-existing DA (Supplementary Figure 5). The QoL rating as well as prevalence of ANX, DPR, and substantial stress were significantly higher in the IT than in the AT study collective, yet these differences were minor (Cramer’s V ≤ 0.12, r ≤ 0.14) [Table 3 and (22)].
Table 3. Rating of the mental health following Coronavirus Disease-19 (COVID-19) in the study cohorts.
Key Factors Impacting Mental Health and Quality of Life Outcomes in Coronavirus Disease-19 Convalescents
We sought to investigate how the broad set of 201 surveyed demographic, socioeconomic, medical history, COVID-19 course, and recovery parameters (Supplementary Table 1) affects the minimum/maximum-normalized rating of anxiety, depression, self-perceived OMH, and QoL. To this end, Random Forest models were trained, optimized, and calibrated in the AT collective (17, 28–30). Such models demonstrated good performance with the training AT data (root mean squared error [RMSE]: 0.15–0.18) and moderate-to-good accuracy in the validation IT cohort (RMSE: 0.21–0.23). The amount of explained variance was roughly twice as large in the AT cohort (pseudo-R2: 0.50–0.65) as in the validation IT data set (pseudo-R2: 0.24–0.37) (Figure 2A and Supplementary Figures 6–9).
Figure 2. Random Forest modeling of the mental health and quality of life scoring during Coronavirus Disease-19 (COVID-19) convalescence. The effects of 201 demographic, clinical, socioeconomic, and psychosocial factors (Supplementary Table 1) on the anxiety (ANX), depression (DPR), overall mental health (OMH), and quality of life (QoL) scoring were modeled with the Random Forest technique. Numeric variables were minimum/maximum normalized prior to modeling. The models were trained and calibrated in Austria (AT) cohort, 10-fold cross-validated (CV), and their predictions validated in Italy (IT) cohort. The top 20 most influential explanatory variables were identified in the AT cohort for each mental health and life quality score by unbiased ΔMSE statistic (Supplementary Figures 6–9). The numbers of complete observations are indicated in (A). (A) Random Forest model performance measured by root mean squared error (RMSE) and the fraction of explained variance in mental health and quality of life scoring expressed as R2. (B) Identification of common influential explanatory variables. Left: overlap in the top 20 most influential explanatory variables presented in a quasi-proportional Venn plot. Right: ΔMSE statistics for the most influential explanatory statistics shared by all responses, point size and color corresponds to the ΔMSE value. NC: neurocognitive symptoms, imp. conc.: impaired concentration, phys.: physical, #: number of.
Psychosocial stress rating and percentage of physical performance following COVID-19 were found to affect the ANX, DPR, OMH, and QoL scoring to the greatest extent in the AT cohort. The set of the 20 most important factors for each investigated response also included the total number of acute, sub-acute, and persistent COVID-19 symptoms as well as the number of specific neurocognitive symptoms. DA before COVID-19 impacted substantially the ANX, DPR, and OMH rating, pre-existing sleep disorders were found to be an influential factor for the DPR and OMH scores (Supplementary Figures 6–9). A total of eight highly influential explanatory variables were shared by the ANX, DPR, OMH, and QoL rating and included psychosocial stress, physical performance loss, acute and sub-acute symptom burden, counts of acute and sub-acute neurocognitive symptoms, as well as concentration deficits during acute and sub-acute COVID-19 (Figure 2B). In multi-variate Poisson modeling, this influential parameter set was associated with 22–37% explained variability in the mental health and QoL scoring both in the AT and IT collective (Supplementary Figure 10). Psychosocial stress, acute concentration deficits, symptom burden, and physical performance impairment are the strongest single explanatory features both in univariate and multivariate Poisson modeling of the ANX, DPR, OMH, and QoL rating following COVID-19 (Figures 3A–D, Supplementary Figure 10, and Supplementary Table 2).
Figure 3. Association of the most influential factors with the mental health readouts investigated by univariable modeling. Association of the most influential factors for the mental health and quality of life scoring (Figure 2B) with the anxiety (ANX) (A), depression (DPR) (B), overall mental health (OMH) (C), and quality of life (QoL) (D) rating was investigated by univariable, age- and sex-weighted Poisson regression (Supplementary Table 2). Numeric variables were minimum/maximum normalized prior to modeling. Exponent β estimate values with 95% Cis presented as Forest plots. Explained variance fraction estimated by adjusted R2 is presented in adjunct bar plots. The numbers of complete observations are shown under the plots. AT: Austria, IT: Italy. NC: neurocognitive symptoms, imp. conc.: impaired concentration, phys.: physical, #: number of.
Of note, the performance of the Random Forest models of ANX, DPR, OMH, and QoL modeling developed in the entire AT cohort was similar in the subsets of participants with and without pre-existing DA (Supplementary Figure 11).
Acute and Sub-Acute Neurocognitive Symptoms and Polysymptomatic Coronavirus Disease-19 Define the Subjects at Risk of Poor Mental Health
Next, we explored whether the set of the eight most influential factors impacting the mental health and QoL in the AT or IT cohort (Figure 2) may be applied to identify convalescents at particular risk of mental health deterioration following COVID-19.
By an SOM and hierarchical clustering (20, 31), three participant subsets, termed “Low Risk” (LR), “Intermediate Risk” (IR), and “High Risk” (HR) Mental Health Risk Clusters, were defined in the training AT cohort and validated in the IT collective with high consistency (between-cluster to total variance ratio, AT: 0.90, IT: 0.90) (Figure 4A and Supplementary Figure 12). The primary hallmarks of the IR and HR subsets were highly frequent acute neurocognitive symptoms and, in particular, impaired concentration as well as polysymptomatic acute COVID-19. The HR subset differed from the IR cluster by the presence of sub-acute neurocognitive complaints, i.e., confusion, memory, or concentration deficits beyond the first 2 weeks of the disease (Figure 4B).
Figure 4. Clustering of the study participants by the most influential factors affecting the mental health and quality of life scoring. Study participants were assigned to the Low Risk (LR), Intermediate Risk (IR), and High Risk (HR) subsets by clustering in respect to the most influential factors for the mental health and quality of life scoring (Figure 2B). Numeric variables were minimum/maximum normalized prior to modeling. The procedure in the training Austria (AT) cohort involved the self-organizing map (SOM, 13 13 hexagonal grid, Manhattan distance between participants) and the hierarchical clustering (Ward D2 method, Manhattan distance between the SOM nodes) algorithms. Assignment of Italy (IT) cohort participants to the clusters was accomplished by the k-nearest neighbors classification. The numbers of participants assigned to the clusters are presented in (B). (A) Cluster assignment of the participants in the 3-dimensional principal component (PC) analysis score plot. The first two components are shown. Percentages of the data set variance associated with the particular PC are presented in the plot axes. (B) Heat map of the minimum/maximum-normalized clustering features. NC: neurocognitive symptoms, imp. conc.: impaired concentration, phys.: physical, #: number of.
Notably, the HR followed by the IR group demonstrated significantly worse ANX, DPR, OMH, and QoL rating as well as higher frequencies of clinically relevant anxiety (AT: 6.4% in LR, 25.4% in HR, IT: 8.6% in LR, 41.7% in HR) and depression (AT: 5.9% in LR, 36.6% in HR, IT: 10.7% in LR, 47.9% in HR) compared with the LR cluster [Figure 5 and (22)]. In addition, the IR and HR clusters were characterized by lower frequency of self-reported complete convalescence, greater weight loss, higher levels of stress, higher symptom duration time, as well as higher frequency of acute and sub-acute fatigue, tiredness, and sleep problems as compared with the LR cluster in both AT and IT cohort (Supplementary Figures 13, 14 and Supplementary Table 3).
Figure 5. Mental health and quality of life scoring, depression and anxiety prevalence in the mental health risk clusters. Study participants were assigned to the Low Risk (LR), Intermediate Risk (IR), and High Risk (HR) subsets as presented in Figure 4. The numbers of participants assigned to the clusters are presented in (E). (A–D) Rating of anxiety (ANX) (A), depression (DPR) (B), overall mental health (OMH) (C), and quality of life (QoL) (D) in the clusters presented as violin plots, diamonds with whiskers represent medians with IQRs. Statistical significance was assessed by the Kruskal–Wallis test. P-values corrected for multiple testing with the Benjamini-Hochberg method and η2 effect size statistic values are shown in the plot captions. (B) Frequency of positive depression (DPR+) and anxiety (ANX+) screening in the clusters. Statistical significance was assessed by the Benjamini-Hochberg-corrected χ2 test, the effect size was expressed as Cramer’s V.
Depression or Anxiety Before Coronavirus Disease-19 Is Linked to a Higher Symptom Burden and Persistence
Finally, we sought to investigate differences in the pre-COVID-19 characteristics, disease course, and recovery between the participants with and without pre-existing DA.
In both study collectives, the DA-positive participants suffered from significantly more comorbidities, sleep disorders, and frequent respiratory infections before COVID-19 than the DA-negative respondents and, consequently, had a higher level of daily medication. Participants declaring anxiety/depression before the infection had a 20% higher median burden of overall acute COVID-19 symptoms and >30% more acute neurocognitive symptoms compared with the DA-free subset. The DA-positive participants were also more frequently affected by acute dizziness, acute, and sub-acute forgetfulness. DA before COVID-19 was also linked to a significantly worse self-perceived QoL, OMH, and a higher anxiety scoring (Figure 6 and Supplementary Table 3).
Figure 6. Characteristic of baseline features, COVID-19 course, and recovery in participants with pre-existing depression or anxiety. Differences in baseline characteristic, COVID-19 course, recovery, mental health, and quality of life scoring between the participants with pre-existing depression or anxiety (DA+) and the subjects without depression/anxiety history (DA–) were assessed by the χ2 or Mann–Whitney test in Austria (AT) and Italy (IT) cohort. The numeric variables were minimum/maximum normalized prior to modeling. The testing results were corrected from multiple testing with the Benjamini-Hochberg method (FDR: False Discovery Rate). The numbers of DA+ and DA– participants are shown in (A). (A) Multiple testing-adjusted significance (pFDR) and effect size (categorical: Cramer’s V for categorical factors, numeric features: Wilcoxon r) for the investigated variables. Variables significantly different between DA+ and DA – are highlighted in red. (B) Values of the features significantly different between DA+ and DA– participants in both AT and IT collectives presented in violin plots. The numeric features were minimum/maximum normalized. Orange diamonds represent mode (categorical variables) or median values (numeric variables). pre-CoV: before COVID-19, sleep disord.: sleep disorder, freq. resp. inf.: >2 respiratory infections per yes before COVID-19, daily medic.: number of drugs taken daily, comorb.: comorbidities, #: number of, QoL: quality of life, OMH: overall mental health, ANX: anxiety, NC: neurocognitive symptoms.
Discussion
In our binational survey, approximately 20% of non-hospitalized COVID-19 convalescents reported poor OMH, reduced QoL, or clinical DPR or ANX at about 3 months post-infection. High psychosocial stress and self-reported physical performance loss, high number of acute COVID-19 symptoms, incomplete symptom resolution within the first 2 weeks of the disease, as well as acute and sub-acute neurocognitive manifestations (impaired concentration, confusion, and forgetfulness) were identified as strong explanatory factors (Figure 7).
Figure 7. Summary of the study results.
So far, mental health disorders following COVID-19 have been investigated primarily in hospitalized patients. Signs of at least one psychiatric sequelae (post-traumatic stress disorder [PTSD], depression, anxiety, insomnia, and obsessive-compulsive symptomatology) were discerned in 56% of inpatients at 1 month after discharge (10). Anxiety, depression, and sleep difficulties were present in approximately one-quarter of hospitalized COVID-19 individuals at the 5–12 months of follow-ups (5–7). In large-scale studies encompassing both in- and outpatients, COVID-19 was identified as an important risk factor for anxiety, stress-related, and depressive adjustment disorders (9) and mental health conditions were ascertained in nearly one-fifth of COVID-19 convalescents (8). Of note, this figure is comparable with the frequency of PHQ-4 positive anxiety (AT: 12.4%, IT: 19.3%) and depression screening (AT: 17.3, IT: 23.2%) in our study cohorts. The variability of the reported rates of depression or anxiety in COVID-19 convalescents could be explained both by the differences in assessment methods and by the differing regional containment policies reflected by the rising frequencies of mental conditions in the general population (3). This may explain the significantly higher prevalence of post-COVID-19 depression and anxiety in the IT than in the AT study cohort, despite the similar frequency of pre-existing depression or anxiety.
Our results underscore the negative impact of psychosocial stress, physical performance impairment during convalescence, acute and sub-acute neurocognitive symptoms, such as concentration and memory deficits on the mental health rating. This likely reflects a net influence of the disease itself and the pandemic management measures, such as restricted physical activity due to quarantine (33) or increased loneliness and boredom (34). Mental health status was also investigated during past outbreaks of infectious diseases, such as Ebola (35) or H1N1 influenza (36), however, it has never been evaluated as rigorously as during the SARS-CoV-2 pandemic (37). Compared to individuals who were hospitalized for seasonal influenza, COVID-19 inpatients show a higher burden of mental health problems (9), but nevertheless, it cannot unambiguously be concluded whether this is due to viral factors or associated psychosocial factors and pandemic management. Psychoneuroimmunological processes, such as low-grade inflammation and associated microglia changes, were suggested to contribute to mental health problems following COVID-19 (38, 39). Such neuropathological alterations may also provide an explanation as, why acute neurocognitive complaints posed a “red flag” of subsequent mental health deterioration in our study cohorts. Other factors, such as Vitamin D, mitochondrial dysfunction, or gut dysbiosis, might also link COVID-19 pathobiology and mental health (40). In Random Forest modeling of mental health scoring in our study collectives, impaired physical performance following COVID-19 was found to impact particularly depression, OMH, and QoL rating. A similar phenomenon was described by Evans et al. (7) in hospitalized COVID-19 patients, who linked physical impairment with poor mental health status, respiratory symptoms, fatigue, and protracted systemic inflammation. Of note, a reciprocal axis between physical performance and mental health, and especially depression, may exist since physical impairment is one of the diagnostic criteria of major depressive disorder (41).
The neurocognitive complaints during acute COVID-19 were found frequently accompanied by lower respiratory, cardiological, neurological symptoms, and sleep disorders (7, 9, 12, 15, 42–45). Such “multi-organ phenotype” of COVID-19 was found by us to be a correlate of protracted clinical recovery (12). Herein, the neurocognitive features together with the high symptom burden of acute COVID-19, fatigue, tiredness, and sleep problems hallmarked the IR and HR Mental Health Risk Clusters of the participants likely to develop a mental health condition in course of the recovery. Such “red flags” of deteriorating mental health present in the first 2 weeks of COVID-19 may be exploited for early diagnosis and psychological or psychiatric intervention.
Pre-existing depression or anxiety was reported by roughly 5% of the respondents and was linked to mental health deficits during recovery – a phenomenon known from non-COVID-19 medical conditions (46). The Random Forest models demonstrated a comparable performance in the DA-positive and -negative study participants. This suggests that the major factors determining the mental health rating following COVID-19 were likely common for individuals with and without pre-existing DA. Concomitantly, the subset with pre-existing DA was found to experience a significantly higher burden of acute symptoms as well as acute and sub-acute neurocognitive complaints. However, it needs to be clarified whether this is attributed to the observed higher level of additional co-morbidity, increased susceptibility to respiratory infections, or different perception for symptoms in the DA subsets in our study. Conspicuously, psychiatric disorders before COVID-19 were described as age- and other comorbidity-independent risk factors for SARS-CoV-2 infection (8). This may indicate that alike chronic somatic diseases, pre-existing mental health conditions may predispose the patient to more severe and polysymptomatic COVID-19.
Several mechanisms might mediate the bidirectional associations of COVID-19, depression, anxiety, and psychosocial stress (47). Protracted systemic inflammation is an important pathogenetic factor in depressive-anxious disorders during COVID-19 convalescence (7, 10, 12, 48–50). Stress being the key co-variate of poor mental health in the study collectives was proposed to modulate anti-SARS-CoV-2 immunity culminating in more severe COVID-19 (51) and to perpetuate the systemic low-grade inflammation (46, 51). Other possible mechanisms include direct viral infection of the central nervous system, neuroinflammation, microvascular thrombosis, and neurodegeneration (52). The strong association of acute neurocognitive manifestations with poor mental health scoring in our study suggests that pathobiological processes triggered likely by the pathogen and anti-SARS-CoV-2 immunity early in the disease course may contribute to the mental health deterioration. Targeted investigations of COVID-19 recovery with mental health, biochemical, and immunological readouts are missing in our current survey study, and a case-control design is needed to shed more light on this phenomenon and to entangle the mechanistic interplay between acute COVID-19 pathobiology, recovery, and mental health status (53). The prime strength of our study is the inclusion of two independently recruited cohorts differing in socioeconomic structure and national containment measures which allowed for identification and validation of common influencing factors. Furthermore, the study cohorts encompassed outpatients only insufficiently characterized so far. The most important study limitation is a possible participants’ selection bias. The majority of respondents showed good mental health before COVID-19, and it is likely that predominantly individuals with severe or persistent COVID-19 symptoms and high health-awareness completed the survey (12). Modeling of the impact of the individual observation time and the total survey duration indicated that those two potential sources of bias had only a minor effect on the rating of mental health and QoL. Notably, the observation time variable was included in the multi-parameter models (22). Despite a broad set of independent study variables, the fraction of unexplained variability of the mental health and QoL scoring was substantial, especially in the validation Italian cohort. We could speculate that a higher explanatory power may be reached by the inclusion of additional explanatory variables concerning stringency of national containment measures, socioeconomic background (family status, income, and care duties), personal attitude to the pandemic management, or impact of the outbreak on one’s lifestyle, which may drive the raising frequency of mental disorders in the non-infected population as well (3, 34).
This study underlines the importance of mental health in the follow-up care of COVID-19 individuals. Psychosocial stress, polysymptomatic disease, and neurocognitive complaints during acute COVID-19 are proposed as a risk signature of a subsequent mental disorder (Figure 7). They may prompt clinicians, i.e., general practitioners, to monitor outpatients with COVID-19 more closely for mental health deterioration and identify those who could benefit from early psychological and psychiatric intervention. Additionally, a pre-existing mental health condition may pose a risk factor of more severe COVID-19.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation. Analysis of the psychosocial features is available as an online dashboard (https://im2-ibk.shinyapps.io/mental_health_dashboard). The complete R analysis pipeline is available at https://github.com/PiotrTymoszuk/mental-health-after-COVID-19.
Ethics Statement
The studies involving human participants were reviewed and approved by the Institutional Review Board of the Medical University of Innsbruck (approval number: 1257/2020) and the Institutional Review Board of the Autonomous Province of Bolzano – South Tyrol (approval number: 0150701). The patients/participants provided their digital written informed consent to participate in this study.
Author Contributions
AH, AP, BS-U, CW, GP, GW, HB, JL-R, KH, MG, RB-W, RH, SK, SS, and VR designed the study. KH, DA, SS, AP, VR, MG, AB, KK, TS, IT, BP, CW, HB, and GP collected the data. KH, PT, and DA performed data analysis. PT, DA, KH, RH, BS-U, and JL-R interpreted the data. PT, DA, KH, BS-U, and JL-R wrote the manuscript. All authors critically reviewed the final version of the manuscript.
Funding
This study was funded by the Research Fund of the State of Tyrol, Austria (Project GZ 71934, JL-R).
Conflict of Interest
PT owns Data Analytics as a Service Tirol and has received an honorarium from the ‘Health after COVID-19 in Tyrol’ study team from the Medical University of Innsbruck and Claudiana Bolzano for the study data management, curation and analysis, and minor manuscript work.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We acknowledge the commitment of the participants, healthcare administration, and general practitioners to the study and daily management of the COVID-19 pandemic. The manuscript is available as a preprint at medRxiv (54).
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2022.792881/full#supplementary-material
Footnotes
References
1. Martin A, Rief W, Klaiberg A, Braehler E. Validity of the brief patient health questionnaire mood scale (PHQ-9) in the general population. Gen Hosp Psychiatry. (2006) 28:71–7. doi: 10.1016/j.genhosppsych.2005.07.003
2. Löwe B, Decker O, Müller S, Brähler E, Schellberg D, Herzog W, et al. Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med Care. (2008) 46:266–74. doi: 10.1097/MLR.0b013e318160d093
3. Pieh C, Budimir S, Probst T. The effect of age, gender, income, work, and physical activity on mental health during coronavirus disease (COVID-19) lockdown in Austria. J Psychosom Res. (2020) 136:110186. doi: 10.1016/j.jpsychores.2020.110186
4. Nasserie T, Hittle M, Goodman SN. Assessment of the frequency and variety of persistent symptoms among patients with COVID-19: a systematic review. JAMA Netw Open. (2021) 4:e2111417. doi: 10.1001/jamanetworkopen.2021.11417
5. Huang C, Huang L, Wang Y, Li X, Ren L, Gu X, et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. (2021) 397:220–32. doi: 10.1016/S0140-6736(20)32656-8
6. Huang L, Yao Q, Gu X, Wang Q, Ren L, Wang Y, et al. 1-year outcomes in hospital survivors with COVID-19: a longitudinal cohort study. Lancet. (2021) 398:747–58. doi: 10.1016/S0140-6736(21)01755-4
7. Evans RA, McAuley H, Harrison EM, Shikotra A, Singapuri A, Sereno M, et al. Physical, cognitive, and mental health impacts of COVID-19 after hospitalisation (PHOSP-COVID): a UK multicentre, prospective cohort study. Lancet Respir Med. (2021) 9:1275–87. doi: 10.1016/S2213-2600(21)00383-0/ATTACHMENT/A18E12DB-60DA-4539-9F71-2E180B86FFEA/MMC2.PDF
8. Taquet M, Luciano S, Geddes JR, Harrison PJ. Bidirectional associations between COVID-19 and psychiatric disorder: retrospective cohort studies of 62 354 COVID-19 cases in the USA. Lancet Psychiatry. (2021) 8:130–40. doi: 10.1016/S2215-0366(20)30462-4
9. Al-Aly Z, Xie Y, Bowe B. High-dimensional characterization of post-acute sequalae of COVID-19. Nature. (2021) 594:259–64. doi: 10.1038/s41586-021-03553-9
10. Mazza MG, De Lorenzo R, Conte C, Poletti S, Vai B, Bollettini I, et al. Anxiety and depression in COVID-19 survivors: role of inflammatory and clinical predictors. Brain Behav Immun. (2020) 89:594–600. doi: 10.1016/j.bbi.2020.07.037
11. Angulo FJ, Finelli L, Swerdlow DL. Estimation of US SARS-CoV-2 infections, symptomatic infections, hospitalizations, and deaths using seroprevalence surveys. JAMA Netw Open. (2021) 4:e2033706. doi: 10.1001/JAMANETWORKOPEN.2020.33706
12. Sahanic S, Tymoszuk P, Ausserhofer D, Rass V, Pizzini A, Nordmeyer G, et al. Phenotyping of acute and persistent COVID-19 features in the outpatient setting: exploratory analysis of an international cross-sectional online survey. Clin Infect Dis. (2021) ciab978. doi: 10.1093/CID/CIAB978
13. Demichev V, Tober-Lau P, Lemke O, Nazarenko T, Thibeault C, Whitwell H, et al. A time-resolved proteomic and prognostic map of COVID-19. Cell Syst. (2021) 12:780. doi: 10.1016/J.CELS.2021.05.005
14. Sudre CH, Lee KA, Lochlainn MN, Varsavsky T, Murray B, Graham MS, et al. Symptom clusters in COVID-19: a potential clinical prediction tool from the COVID symptom study app. Sci Adv. (2021) 7:eabd4177. doi: 10.1126/sciadv.abd4177
15. Sudre CH, Murray B, Varsavsky T, Graham MS, Penfold RS, Bowyer RC, et al. Attributes and predictors of long COVID. Nat Med. (2021) 27:626–31. doi: 10.1038/s41591-021-01292-y
16. Heldt FS, Vizcaychipi MP, Peacock S, Cinelli M, McLachlan L, Andreotti F, et al. Early risk assessment for COVID-19 patients from emergency department data using machine learning. Sci Rep. (2021) 11:1–13. doi: 10.1038/s41598-021-83784-y
18. Khalilia M, Chakraborty S, Popescu M. Predicting disease risks from highly imbalanced data using random forest. BMC Med Inform Decis Mak. (2011) 11:51. doi: 10.1186/1472-6947-11-51/FIGURES/10
19. Nembrini S, König IR, Wright MN. The revival of the gini importance? Bioinformatics. (2018) 34:3711–8. doi: 10.1093/BIOINFORMATICS/BTY373
21. Wehrens R, Kruisselbrink J. Flexible self-organizing maps in kohonen 3.0. J Stat Softw. (2018) 87:1–18. doi: 10.18637/jss.v087.i07
22. Health after Covid-19 in Tyrol. Mental Health After COVID-19 in Tyrol. (2021). Available online at: https://im2-ibk.shinyapps.io/mental_health_dashboard/ (accessed September 9, 2021).
23. Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the patient health questionnaire-4 (PHQ-4) in the general population. J Affect Disord. (2010) 122:86–95. doi: 10.1016/j.jad.2009.06.019
24. Gräfe K, Zipfel S, Herzog W, Löwe B. Screening psychischer störungen mit dem “gesundheitsfragebogen für patienten (PHQ-D)”. Ergebnisse der deutschen validierungsstudie. Diagnostica. (2004) 50:171–81. doi: 10.1026/0012-1924.50.4.171
25. Wickham H, Averick M, Bryan J, Chang W, McGowan L, François R, et al. Welcome to the Tidyverse. J Open Source Softw. (2019) 4:1686. doi: 10.21105/joss.01686
26. Wickham H. ggplot2: Elegant Graphics for Data Analysis. 1st ed. New York, NY: Springer-Verlag (2016).
27. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. (1995) 57:289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x
28. Kuhn M. Building predictive models in R using the caret package. J Stat Softw. (2008) 28:1–26. doi: 10.18637/jss.v028.i05
29. Wright MN, Ziegler A. ranger: a fast implementation of random forests for high dimensional data in C++ and R. J Stat Softw. (2017) 77:1–17. doi: 10.18637/JSS.V077.I01
30. Fasiolo M, Wood SN, Zaffran M, Nedellec R, Goude Y. Fast Calibrated additive quantile regression. J Am Stat Assoc. (2020) 116:1402–12. doi: 10.1080/01621459.2020.1725521
31. Vesanto J, Alhoniemi E. Clustering of the self-organizing map. IEEE Trans Neural Netw. (2000) 11:586–600. doi: 10.1109/72.846731
32. Leng M, Wang J, Cheng J, Zhou H, Chen X. Adaptive semi-supervised clustering algorithm with label propagation. J Softw Eng. (2014) 8:14–22. doi: 10.3923/JSE.2014.14.22
33. Handschin C, Spiegelman BM. The role of exercise and PGC1α in inflammation and chronic disease. Nature. (2008) 454:463–9. doi: 10.1038/nature07206
34. Tutzer F, Frajo-Apor B, Pardeller S, Plattner B, Chernova A, Haring C, et al. Psychological distress, loneliness, and boredom among the general population of Tyrol, Austria during the COVID-19 pandemic. Front Psychiatry. (2021) 12:921. doi: 10.3389/FPSYT.2021.691896/BIBTEX
35. Reardon S. Ebola’s mental-health wounds linger in Africa: health-care workers struggle to help people who have been traumatized by the epidemic. Nature. (2015) 519:13–4. doi: 10.1038/519013A
36. Chan SS, Lam LCW, Chiu HFK. The emergence of the novel H1N1 virus: implications for global mental health. Int Psychogeriatr. (2009) 21:987–9. doi: 10.1017/S1041610209990925
37. Maalouf FT, Mdawar B, Meho LI, Akl EA. Mental health research in response to the COVID-19, Ebola, and H1N1 outbreaks: a comparative bibliometric analysis. J Psychiatr Res. (2021) 132:198–206. doi: 10.1016/J.JPSYCHIRES.2020.10.018
38. Mondelli V, Pariante CM. What can neuroimmunology teach us about the symptoms of long-COVID? Oxford Open Immunol. (2021) 2:iqab004. doi: 10.1093/OXFIMM/IQAB004
39. Matschke J, Lütgehetmann M, Hagel C, Sperhake JP, Schröder AS, Edler C, et al. Neuropathology of patients with COVID-19 in Germany: a post-mortem case series. Lancet Neurol. (2020) 19:919–29. doi: 10.1016/S1474-4422(20)30308-2
40. Bókkon I, Kapócs G, Vucskits A, Erdöfi-Szabó A, Vagedes J, Scholkmann F, et al. COVID-19: the significance of platelets, mitochondria, vitamin D, serotonin and the gut microbiota. Curr Med Chem. (2021) 28:7634–57. doi: 10.2174/0929867328666210526100147
41. World Health Organization. ICD-10: International Statistical Classification of Diseases and Related Health Problems: Tenth Revision. (2004). Available online at: https://apps.who.int/iris/handle/10665/42980 (accessed February 1, 2022).
42. Blomberg B, Mohn KGI, Brokstad KA, Zhou F, Linchausen DW, Hansen BA, et al. Long COVID in a prospective cohort of home-isolated patients. Nat Med. (2021) 27:1607–13. doi: 10.1038/s41591-021-01433-3
43. Goërtz YMJ, Van Herck M, Delbressine JM, Vaes AW, Meys R, Machado FVC, et al. Persistent symptoms 3 months after a SARS-CoV-2 infection: the post-COVID-19 syndrome? ERJ Open Res. (2020) 6:00542–2020. doi: 10.1183/23120541.00542-2020
44. Atkinson SR, Hamesch K, Spivak I, Guldiken N, Cabezas J, Argemi J, et al. Serum transferrin is an independent predictor of mortality in severe alcoholic hepatitis. Am J Gastroenterol. (2020) 115:398–405. doi: 10.14309/ajg.0000000000000492
45. Davis HE, Assaf GS, McCorkell L, Wei H, Low RJ, Re’em Y, et al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. EClinicalMedicine. (2021) 38:101019. doi: 10.1016/j.eclinm.2021.101019
46. Best C, Eckhardt-Henn A, Tschan R, Dieterich M. Psychiatric morbidity and comorbidity in different vestibular vertigo syndromes: results of a prospective longitudinal study over one year. J Neurol. (2009) 256:58–65. doi: 10.1007/s00415-009-0038-8
47. Postolache TT, Benros ME, Brenner LA. Targetable biological mechanisms implicated in emergent psychiatric conditions associated with SARS-CoV-2 infection. JAMA Psychiatry. (2021) 78:353–4. doi: 10.1001/jamapsychiatry.2020.2795
48. Jia Q, Shi S, Yuan G, Shi J, Shi S, Hu Y. Analysis of knowledge bases and research hotspots of coronavirus from the perspective of mapping knowledge domain. Medicine (Baltimore). (2020) 99:e20378. doi: 10.1097/MD.0000000000020378
49. Parker C, Shalev D, Hsu I, Shenoy A, Cheung S, Nash S, et al. Depression, anxiety, and acute stress disorder among patients hospitalized with coronavirus disease 2019: a prospective Cohort study. Psychosomatics. (2020) 62:211–219. doi: 10.1016/j.psym.2020.10.001
50. Mazza MG, Palladini M, De Lorenzo R, Magnaghi C, Poletti S, Furlan R, et al. Persistent psychopathology and neurocognitive impairment in COVID-19 survivors: effect of inflammatory biomarkers at three-month follow-up. Brain Behav Immun. (2021) 94:138–47. doi: 10.1016/j.bbi.2021.02.021
51. Peters EMJ, Schedlowski M, Watzl C, Gimsa U. Can stress interact with SARS-CoV-2? A narrative review with a focus on stress-reducing interventions that may improve defence against COVID-19. Psychother Psychosom Med Psychol. (2021) 71:61–71. doi: 10.1055/a-1322-3205
52. Nalbandian A, Sehgal K, Gupta A, Madhavan MV, McGroder C, Stevens JS, et al. Post-acute COVID-19 syndrome. Nat Med. (2021) 27:601–15. doi: 10.1038/s41591-021-01283-z
53. Amin-Chowdhury Z, Ladhani SN. Causation or confounding: why controls are critical for characterizing long COVID. Nat Med. (2021) 27:1129–30. doi: 10.1038/s41591-021-01402-w
Keywords: COVID-19, SARS-CoV-2, depression, anxiety, mental stress, neurocognitive, long COVID, machine learning
Citation: Hüfner K, Tymoszuk P, Ausserhofer D, Sahanic S, Pizzini A, Rass V, Galffy M, Böhm A, Kurz K, Sonnweber T, Tancevski I, Kiechl S, Huber A, Plagg B, Wiedermann CJ, Bellmann-Weiler R, Bachler H, Weiss G, Piccoliori G, Helbok R, Loeffler-Ragg J and Sperner-Unterweger B (2022) Who Is at Risk of Poor Mental Health Following Coronavirus Disease-19 Outpatient Management? Front. Med. 9:792881. doi: 10.3389/fmed.2022.792881
Received: 11 October 2021; Accepted: 11 February 2022;
Published: 14 March 2022.
Edited by:
Victoria Bunik, Lomonosov Moscow State University, RussiaReviewed by:
Rembert Koczulla, Andreas Rembert Koczulla, GermanyJurjen Luykx, University Medical Center Utrecht, Netherlands
Copyright © 2022 Hüfner, Tymoszuk, Ausserhofer, Sahanic, Pizzini, Rass, Galffy, Böhm, Kurz, Sonnweber, Tancevski, Kiechl, Huber, Plagg, Wiedermann, Bellmann-Weiler, Bachler, Weiss, Piccoliori, Helbok, Loeffler-Ragg and Sperner-Unterweger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Judith Loeffler-Ragg, judith.loeffler@i-med.ac.at