Abstract
Introduction: Self-Help Plus (SH+) is a group-based psychological intervention developed by the World Health Organization for managing stress. Objective: To assess the effectiveness of SH+ in preventing mental disorders in refugees and asylum seekers in Western Europe. Methods: We conducted a randomized controlled trial in 5 European countries. Refugees and asylum seekers with psychological distress (General Health Questionnaire score ≥3), but without a Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5) or ICD/10 diagnosis of mental disorder, as assessed with the Mini International Neuropsychiatric Interview (MINI), were randomized to SH+ or enhanced treatment as usual (ETAU). The primary outcome was the frequency of mental disorders with the MINI at 6 months. Secondary outcomes included the frequency of mental disorders at postintervention, self-identified problems, psychological symptoms, and other outcomes. Results: Four hundred fifty-nine individuals were randomly assigned to SH+ or ETAU. For the primary outcome, we found no difference in the frequency of mental disorders at 6 months (Cramer V = 0.007, p = 0.90, RR = 0.96; 95% CI 0.52–1.78), while the difference significantly favored SH+ at after the intervention (secondary outcome, measured within 2 weeks from the last session; Cramer V = 0.13, p = 0.01, RR = 0.50; 95% CI 0.29–0.87). Conclusions: This is the first randomized indicated prevention study with the aim of preventing the onset of mental disorders in asylum seekers and refugees in Western Europe. As a prevention effect of SH+ was not observed at 6 months, but rather after the intervention only, modalities to maintain its beneficial effect in the long term need to be identified.
Introduction
Refugees and asylum seekers are at an elevated risk of developing psychological symptoms and mental disorders in association with the numerous challenges that they experience before, during, and after migration [1-7]. In response to such challenges, a growing body of research has demonstrated the effectiveness of mental health interventions in treating psychological symptoms experienced by refugees and asylum seekers [8-16]. However, in relation to prevention, a recent Cochrane systematic review identified only 7 randomized controlled trials (RCT) examining the preventive effects of psychosocial interventions in humanitarian settings [15]. Of these, many did not systematically exclude participants with a probable mental disorder at baseline, and most did not assess for the development of a probable mental disorder at follow-up. Indeed, the review found no studies that evaluated incidence, and no overall preventive effects were identified for other outcomes such as symptom reduction or functioning [15].
The World Health Organization (WHO) has developed a novel, low-intensity, 5-session, group-delivered, guided self-help intervention for managing stress and coping with adversity. It is designed to be delivered by nonspecialist facilitators and does not require extensive training [17]. This psychological intervention, called Self-Help Plus (SH+), is intended to help people cope with distress stemming from diverse types of adversity and to enhance psychological flexibility [17]. SH+ was recently tested in a large cluster RCT with the aim of reducing psychological distress and improving functioning at a 3-month follow-up in a group of 694 severely distressed South Sudanese female refugees in Uganda [18]. In comparison with enhanced treatment as usual (ETAU), SH+ led to a significant reduction in psychological distress immediately after the intervention (ß = –3.25; 95% CI –4.31 to –2.19, p < 0.0001, d = –0.72) and at the 3-month follow-up (ß = –1.20; 95% CI –2.33 to –0.08, p = 0.04, d = –0.26).
The easily implementable structure of SH+, its contents, and its delivery modality may make this intervention a potentially useful public health strategy for preventing mental disorders in refugees and asylum seekers living in high-income countries. We therefore evaluated SH+ as an indicated preventive intervention for reducing the frequency of current mental disorders at a 6-month follow-up in refugees and asylum seekers experiencing psychological distress, but without mental disorders, as compared with ETAU. We additionally tested SH+ on a broader range of secondary outcomes, including psychological symptoms, functioning, wellbeing, perceived psychological problems, quality of life, and postmigration living difficulties.
Materials and Methods
Study Design
We conducted a rater-blind, parallel group, multinational RCT in 5 countries (Italy, Germany, Austria, Finland, and 2 sites in the UK, i.e., 1 in England and 1 in Scotland). The trial protocol was registered in clinicaltrials.gov (NCT03571347) before the start of recruitment and submitted and published in a scientific journal after the start of recruitment [19]. No changes were made to the study design after the start of the trial. An individual level randomization was chosen because of potential heterogeneity across clusters located in different European countries.
Participant recruitment occurred from September 1, 2018, to November 30, 2019. Project coordinators at each site approached local organizations providing social, health, and/or legal support to refugees and asylum seekers to identify potentially eligible participants. Based on a situational analysis of international migration flows, we identified refugees and asylum seekers from Syria, Afghanistan, Pakistan, Iraq, and Nigeria as potential target groups. All screening, baseline, and follow-up assessment questionnaires were administered in interview format or self-administered after the participants signed informed consent forms. Assessors were healthcare professionals who were trained in the administration of rating scales, instructed on how to perform follow-up assessments while preserving effective masking, and assisted by cultural mediators when needed.
Randomization and Masking
Randomization was centralized and coordinated by the WHO Collaborating Centre of the University of Verona. The randomization schedule was generated by the electronic software Castor Electronic Data Capture (EDC) [20], employing a variable block randomization method (block sizes: 4 and 6). Research team members involved in recruitment were able to access the web-based software to randomize each newly enrolled participant, but they were not able to access the randomization list and they were not aware of the block size. Castor EDC software allowed random allocation only after the main information on the enrolled participant had been entered, upon verification of the inclusion criteria. After random allocation, the software produced a unique identification number (ID) for each participant.
Masking of participants and research staff was not feasible due to the nature of the intervention. However, assessors evaluating primary and secondary outcomes, and the statistician performing the analyses, were masked to the participant allocation status. The trial statistician was not involved in determining the participants’ eligibility, in administering the intervention, in measuring the outcomes, or in entering data.
Inclusion and Exclusion Criteria
Refugees and asylum seekers at 1 of the 6 sites of the 5 European countries who presented psychological distress as assessed by the 12-item General Health Questionnaire (GHQ ≥3) [21] but did not meet the criteria for a mental disorder according to the Mini International Neuropsychiatric Interview (MINI) [22] were eligible to be randomly assigned to SH+ or ETAU in a 1:1 ratio. The MINI was designed as a brief structured interview for the diagnosis of current mental disorders in the Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5) [23] and the ICD-10 classification of mental and behavioral disorders [24]. Participants were excluded if they: (1) had a mental disorder according to the MINI [22]; (2) had an acute medical condition contraindicating study participation; (3) presented clinical evidence of an imminent suicide risk or a suicide risk scored as “moderate or high” (or a suicidality disorder according to the MINI suicidality module); (4) were not able to understand Dari, Urdu, Arabic, or English; or (5) showed signs of impaired decision-making as evidenced by responses during the clinical interview. Refugees and asylum seekers who were excluded because of a diagnosis of a mental disorder and/or an imminent suicide risk were referred to professional treatment.
Experimental and Control Intervention
The intervention delivery period lasted from September 2018 until March 2020. The SH+ program was developed by the WHO, as described elsewhere [17]. SH+ consists of a prerecorded audio course delivered by briefly trained facilitators in a group setting and complemented with an illustrated self-help book adapted for the cultural groups included in the study. It was recently updated and published by the WHO as Doing What Matters in Times of Stress: An Illustrated Guide [25].
The prerecorded audio format of SH+ is innovative in that it seeks to ensure that key intervention components are delivered as intended without the burden of extensive facilitator training. The SH+ program is based on acceptance and commitment therapy (ACT), a form of cognitive-behavioral therapy [26]. ACT emphasizes learning new ways to accommodate difficult thoughts and feelings while guiding people to take proactive steps toward living in a way that is consistent with their values [17].
The SH+ prerecorded audio material is delivered across five 2-h sessions to groups of up to 30 people. The audio material imparts key information about stress management and guides participants through individual exercises and small-group discussions. To augment the audio recordings, an illustrated self-help book reviews all essential content and concepts.
The SH+ intervention was fully delivered in the native language of the participants by trained facilitators with a migration background, who were native speakers of the target languages and proficient in English. Most facilitators had no prior work experience in this field and/or formal mental health training. Facilitators completed 5 days of training, which included listening to the audio recordings, receiving instruction on SH+ facilitation skills, and role-playing and practicing SH+ sessions. The facilitator’s role consisted of playing the audio, responding to questions and disruptions, demonstrating the exercises, and reading out scripted discussion questions.
Intervention supervision was provided by clinical psychologists or other health care professionals, who were also available for questions, discussion, and debriefing after the sessions. If necessary, additional training and consultations were available from SH+ expert trainers at the WHO through local visits. Fidelity was checked by the intervention supervisor through session adherence forms completed by the facilitators. In addition, the intervention supervisor (a clinical psychologist, a psychiatrist, or a specialized nurse with a formal background in mental health) observed at least 10% of the sessions and completed an adherence form for each SH+ session.
ETAU was provided to the control group and consisted of routinely delivered social support and/or care according to local regulations. Additionally, participants in the ETAU arm received baseline and follow-up assessments according to the study schedule (around 2 and 6 months after randomization, respectively), information about freely available health and social services, and links to community networks providing support to refugees and asylum seekers.
An ethics advisory board, consisting of experts giving advice on any ethical issues related to the trial, supervised this study.
Outcomes
The primary outcome was the presence of current mental disorders at the 6-month follow-up measured using the MINI, which was also administered as a screener, and after the intervention [22]. Validation and reliability studies have been conducted comparing the MINI to the Structured Clinical Interview for DSM-III-R [27] and the Composite International Diagnostic Interview, i.e., a structured interview developed by the WHO [28].
All other measures were secondary outcomes assessed at after the intervention and at the 6-month follow-up. Psychological distress was measured using the GHQ-12 questionnaire, asking whether the respondent has experienced a particular symptom or behavior recently [21]. Each item is rated on a 4-point Likert scale and gives a total score of 12 points based on the GHQ version and on the selected scoring methods. PTSD symptoms were assessed with the PTSD Checklist for DSM-5 (PCL-5) [29, 30], a 20-item questionnaire that measures PTSD symptom severity globally (score 0–80) and by cluster (intrusions, avoidance, negative changes in thoughts and mood, and changes in arousal). We measured depression symptoms with the Patient Health Questionnaire, 9-item version (PHQ-9) [31], a 4-point scale measure (score 0 to 27). Personally identified problems were examined with the Psychological Outcome Profiles instrument (PSYCHLOPS) [32], asking participants to describe 2 problems from their own perspective and rate the problem severity on a 6-point scale (range 0–18). Functional impairment and subjective wellbeing were assessed with the WHO Disability Assessment Schedule 2.0 (WHODAS) [33] and the WHO-5 Wellbeing Index (WHO-5) [34], respectively. We administered the 12-item version of the WHODAS, which uses a 5-point scale (score 12–60). The WHO-5 contains 5 questions using a 6-point scale (score 0–25). For evaluation of general health, we administered the EQ-5D-3L questionnaire, which is a brief self-report measure consisting of 5 dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) [35]. Traumatic/adverse life events and daily and environmental stressors were collected with the Harvard Trauma Questionnaire (HTQ)-Part A [36] and the 17-item Checklist for Post-Migration Living Difficulties (PMLD) [37]. HTQ-Part A asks for lifetime traumatic life events. The PMLD instead asks respondents to rate their experience of the problems, during the last 12 months, on a 5-point scale (from “was not a problem” to “very serious problem”).
Assessments were conducted as face-to-face interviews or remotely by telephone or secure online audio/video communication for reasons of feasibility related to the SARS-CoV2 pandemic. Adverse events reported spontaneously by the participants or observed by the research staff were recorded, reviewed by the ethics advisory board in regular meetings, and reported to the WHO Ethics Committee in midterm reports.
Researchers involved in screening, baseline, and follow-up assessments received specific 2-h training sessions for administering the MINI and the rating scales for measuring secondary outcomes by expert trainers based at the University of Verona.
In addition, we assessed secondary outcomes at the 12-month follow-up, as well as cost-effectiveness indicators. The results from these assessments will be presented elsewhere.
Statistical Analysis
We predicted a frequency rate of current mental disorders of 25% at 6 months in this population. We hypothesized that the provision of SH+ would show a clinically significant advantage by producing a between-groups absolute difference of 10% [19]. With these figures, in order to achieve at least 80% power for a 0.05 level of significance in a χ2 test for equality of proportions of people diagnosed with current mental disorders at 6 months, a sample size of 500 participants (250 in each group) was needed.
Descriptive statistics (mean and SD for continuous variables and absolute numbers and percentages for categorical variables) were calculated on sociodemographic, premigration, migration, and postmigration variables at baseline. Balance between treatment groups was checked by calculating standardized mean differences (SMD) using values of 0.1 and –0.1 as thresholds for imbalance [38, 39].
We followed an intention-to-treat (ITT) approach for the analysis of primary and secondary outcomes. The ITT population consisted of all participants randomly assigned to the competing intervention strategies, and with data on the baseline assessment available, irrespectively of the number of SH+ sessions received. To check the robustness of results, the primary outcome was additionally analyzed using a per protocol (PP) approach for confirmatory purposes only, by including only those participants who completed at least 3 SH+ sessions.
The primary outcome was compared between the 2 groups through a χ2 test (primary analysis); the Cramer V was also calculated, together with a RR and its 95% CI (Cramer V details are in the online suppl. Appendix; for all online suppl. material, see www.karger.com/doi/10.1159/000517504). Additionally, a multivariate analysis (secondary analysis) was performed through a Poisson regression model, with a robust error variance, to explore the potential confounding effect of prognostic factors, and the interactions with treatment, controlling for variables unbalanced at baseline.
We also performed a mixed analysis of covariance (ANCOVA) controlling for baseline scores, with robust standard errors and distinct variances for postintervention and the 6-month follow-up. In addition to mixed models, a last observation carried forward (LOCF) approach was used to account for missing observations at 6 months. Standardized coefficients, together with their SEs, were also calculated with the Stata “stdBeta” command [40]. We tested the null hypothesis of the intervention having no effect on any outcomes versus the alternative hypothesis of the intervention having an effect on at least 1 outcome by performing a seemingly unrelated regression (SUR) [41] equations model, in its modification to allow for unbalanced data as proposed by Baum and Schaffer [42], through the Stata “suregub” command. In particular, SURs were performed for each time point, controlling for baseline values. For each questionnaire, in case of missing items, we used the corrected item mean substitution method (i.e., the item mean across participants weighted by the subject’s mean of completed items) [43], using information from subjects belonging to the same treatment arm for the same follow-up time, through the Stata “hotvalue” command [44]. The substitution was only performed for observations having <50% missing items and if it resulted in admissible values in all cases. As a sensitivity analysis, we reran our models without any data imputation.
Possible interactions between treatment and specific variables (recruiting center, country of origin, gender, age, years of education, and length of stay in the hosting country) were evaluated. In particular, in the case of continuous outcomes, SURs for unbalanced data on all outcomes was performed, with their value at baseline, treatment status, all potential moderators, and their interactions with treatment status as predictors. A global test on all interaction terms was implemented and, in case of statistical significance, the same test was performed for each scale. Finally, for scales meeting the statistical significance threshold, single regressions were considered.
As for binary outcomes, to avoid the issue of poor performance of the model in case of solutions near the boundary described in Zhu et al. [45], Poisson regression models with robust standard errors, having the variable “intervention allocation,” each variable separately, and its interaction with treatment as regressors, were performed using the Bonferroni correction to take multiple testing into account. Originally, further analyses stratifying by method of assessment (face-to-face vs. telephone or secure online audio/video communication) were planned. However, due to the SARS-CoV2 pandemic, these analyses were not performed, as most follow-up assessments were conducted remotely.
For each secondary outcome, we performed multivariate analyses to take confounding factors into account, again including the baseline value as a covariate. Finally, lost-to-follow-up was compared between the 2 groups using a χ2 or a Fisher exact test, as appropriate. We also conducted 2 post hoc analyses, i.e., 1 analysis using the LOCF approach for the MINI at the 6-month follow-up by imputing missing values using information after the intervention and 1 analysis considering deterioration of psychological symptoms (PHQ-9, PCL-5, and WHODAS) after the intervention. All analyses were performed using Stata/SE, release 16.1 [46]. A statistical analysis plan was developed and signed before data analysis.
Results
After screening of 1,475 potentially eligible participants, 1,016 were excluded. A total of 505 participants were excluded because the level of distress was lower than the established cut-off, 461 participants were excluded because of a positive MINI, and 50 participants were excluded for other reasons (Fig. 1).
This left 459 individuals who met the inclusion criteria, consented to be randomized by signing a written informed consent form, and were allocated to either SH+ (230) or ETAU (229). We could not assess 112 individuals at post-intervention with the M.I.N.I. (24%), of which 59/230 in SH+ group and 53/229 in ETAU group, and 156 individuals at 6-month follow-up (34%), of which 84/230 in SH+ group and 72/229 in ETAU. Participants were lost to 6-month follow-up because they refused to participate (69), were not reachable and/or moved to other locations (40), or were not available due to other personal priorities (i.e., working, housing, other) (47). The distribution of participants lost to follow-up was similar between the study groups (Table 1).
Selected sociodemographic characteristics of the included participants are shown in Table 2 (the full list is presented in the online suppl. Appendix, Table 1).
The mean participant age was 33 years (SD = 11) in the SH+ group and 32 years (SD = 10) in the ETAU group. Approximately 7 out of every 10 participants were male. For about 40% primary school was the highest level of education, while 20% had received academic education, with 10 years of education on average. About 28% of the participants came from Syria, 25% came from Nigeria, and 18% came from Iraq, followed by Afghanistan, Pakistan, and other bordering countries. The travel route for moving to Western Europe was through the Balkans for 28% of the participants in the SH+ group and 34% of those in the ETAU group, followed by the African route, the Eastern route, and other travel routes. About 30% of the participants experienced detention during their transition to Europe. The 2 groups were similar with regard to most sociodemographic characteristics and baseline scores on outcomes, with the exception of the following variables: literacy, having distant relatives in the country of origin, detention duration, legal status conditions, and number of siblings. We added these variables in planned regression analyses accounting for imbalance between groups, without identifying relevant differences with respect to our main analyses on both primary and secondary outcomes (online suppl. Appendix, Table 4).
Assessment of more than 10% of SH+ sessions showed near-perfect fidelity. We only identified small mistakes consisting of longer breaks (10–15 min) in restarting the audio and taking more time for group discussion than allotted in the manual. Based on information collected at each site, the total supervision time required for all 5 sessions of an SH+ group was 2 h on average per group.
Differences between study conditions on primary and secondary outcomes are reported in Table 1.
SH+ led to a significant reduction in the frequency of any current mental disorders as measured with the MINI after the intervention (within 2 weeks from the last SH+ session) (Cramer V = 0.135, p = 0.012, RR = 0.499; 95% CI 0.285–0.873), but not at the 6-month follow-up (primary outcome: Cramer V = 0.007, p = 0.902, RR = 0.962; 95% CI 0.521–1.778). The majority of detected mental disorders after the intervention were major depressive disorders (9 out of 171 participants in the SH+ group and 20 out of 176 participants in the ETAU group), anxiety disorders (4 out of 171 participants in the SH+ group and 7 out of 176 participants in the ETAU group), and PTSD (2 out of 171 participants in the SH+ group and 7 out of 176 participants in the ETAU group). At the 6-month follow-up, the majority of the detected mental disorders were major depressive disorders (12 out of 146 participants in the SH+ group and 16 out of 157 participants in the ETAU group), anxiety disorders (2 out of 146 participants in the SH+ group and 3 out of 157 participants in the ETAU group), and PTSD (3 out of 146 participants in the SH+ group and 3 out of 157 participants in the ETAU group). Figure 2 is a graphical representation of the trend over time in the frequency of current mental disorders in each of the 2 groups and of their difference.
SH+, compared with ETAU, was also associated with larger improvements after the intervention for the secondary outcomes of psychological distress as measured with the GHQ-12 (standardized coefficient [Std Coef] = –0.157, SE = 0.051, p = 0.002), depression symptoms as measured with the PHQ-9 (Std Coef = –0.125, SE = 0.050, p = 0.013), wellbeing as measured with the WHO-5 (Std Coef = 0.175, SE = 0.051, p = 0.001), and perceived problems as measured with the PSYCHLOPS (Std Coef = –0.172, SE = 0.052, p = 0.001). Such results were confirmed by the global statistical significance of the intervention on all outcomes by performing SURs (p = 0.001). At 6 months, we detected a statistically significant difference in favor of SH+ on the WHO-5 (Std Coef = 0.187, SE = 0.050, p ≤ 0.001), while the other secondary outcome differences were not statistically significant. Results from SURs showed evidence of a global effect of treatment on secondary outcomes (p = 0.005) also at the 6-month follow-up. Results from the ANCOVA controlling for baseline scores were fully consistent with analyses using the LOCF approach (Table 1).
The ITT analysis results were confirmed in the PP analysis (online suppl. Appendix, Table 2). Secondary analyses of continuous outcomes conducted without any imputations of missing values did not identify any relevant difference with respect to the main analyses (online suppl. Appendix, Table 3).
We then proceeded to investigate the possible heterogeneity of the effect of treatment on outcomes by testing for interactions between intervention allocation and potential moderators. None of the interactions reached the statistical significance threshold for binary outcomes after application of the Bonferroni correction. By performing SURs on postintervention secondary outcomes, a global test on all interactions of the variable “intervention allocation,” with center and the potential moderators on all regressions, turned out to be not statistically significant (p = 0.581). The same test performed at the 6-month follow-up revealed interactions to be statistically significant (p = 0.025). We then conducted single regressions and found a global statistical significance of all interactions only in the regression having WHODAS as an outcome (p < 0.001). Thus, we performed simple models controlling for WHODAS at baseline and with the variable “intervention allocation”, each separate variable, and their interaction as regressors. Only length of stay in the hosting country (p = 0.022) and years of education (p = 0.042) emerged as statistically significant moderators. As shown in online supplementary Appendix, Figure 1, a significant protective effect of SH+ on the WHODAS score at 6 months emerged for those who had already been in the host country for 6 years or longer. Post hoc analyses using the LOCF approach for the MINI, and considering deterioration of psychological symptoms as an additional outcome, did not show any differences between groups (online suppl. Appendix, Tables 5, 6). With regard to safety considerations, the ethics advisory board responded to 8 adverse events that were equally distributed between groups (5 in ETAU and 3 in SH+), and none was evaluated to be related to the study/intervention participation.
Discussion
This is the first study in refugees and asylum seekers resettled in Western Europe that examines the effects of a preventive intervention on the development of mental disorders. It is likely the largest intervention study ever conducted in this population group in high-income countries. Though we did not find a preventive effect of SH+ on the presence of current mental disorders at the 6-month follow-up, which was our primary outcome, we found a significant difference in favor of SH+ in reducing the frequency of current mental disorders immediately after the intervention.
Several reasons may explain the loss of effect over time, in particular the short duration of the intervention and a likely reduction of practice or application of the techniques after the group ended. A lack of participant blindness to the allocated interventions might be another reason, as knowledge of being allocated to the “enhanced intervention as usual” arm might have disappointed participants, leading to worse mental health conditions in the control group after the intervention. At 6 months, however, the control group participants could have moved beyond an initial disappointment, reversing to the same level of mental health problems as the intervention group [47]. However, analysis of secondary outcomes did not suggest any worsening in the control group mental health conditions, so a nocebo effect related to control group allocation seems unlikely. A third reason might be related to the nonspecific intervention ingredients of SH+, which being transdiagnostic and based on the ACT might have generated a significant effect after the intervention, promoting flexibility and generic psychological skills that can be enhanced in any domain of life but not lasting over longer periods.
Interestingly, a decreased intervention effect over time was similarly observed in the SH+ treatment trial conducted in Uganda, which involved a larger group of participants [18]. More generally, reviews on the effectiveness of psychosocial interventions in vulnerable populations have found that the beneficial effects of interventions on PTSD, depression, and anxiety symptoms were reduced at follow-up [11, 13]. A recent systematic review of 17 RCTs involving 1,108 adult refugees confirmed a strong beneficial effect of psychological interventions in reducing PTSD and depression immediately after the intervention; this effect was reduced, but still statistically significant, at follow-up [8]. Compared to SH+, these interventions generally provided a larger intervention “dose,” for example because they were delivered as individual interventions or because the number of sessions was substantially greater. The length of follow-up was up to 6 months in the majority of the included studies [8]. In addition, there was a high heterogeneity across the included studies, indicating that there are moderators and mediators that need to be investigated in further analyses. Finally, meta-analyses from the available systematic reviews included very small studies, raising concerns regarding methodological standards and quality [48-50].
Little knowledge exists of whether these drops in effect sizes are due to intervention-related processes (e.g., a return to previous emotional/behavioral patterns), context-related variables (e.g., new or continued adversities experienced in the host countries, associated with renewed psychological distress), research-related variables (e.g., halo effect), or the impact that increased adversity may have on the effect of interventions over time. Likely, secondary analyses of the present study, and individual-participant data reanalyses of the whole body of randomized evidence on the efficacy of psychological interventions in vulnerable populations, will be able to ascertain which factors may contribute to maintenance versus loss of the effect over time.
For SH+, it will be important to explore whether booster sessions after the delivery of the group intervention, administered face-to-face or through online devices [51], might assist in maintaining its benefits over time. Notably, booster sessions for SH+ are possible, using the publication of the SH+ illustrated book Doing What Matters in Times of Stress: An Illustrated Guide [25].
We note several limitations of our study. First, although this is the largest study in this population in high-income countries, we were only able to get close to, but did not reach, the planned sample size. Several potential factors may have contributed to the smaller sample size. As the included participants did not have a mental disorder, they may not have perceived their psychological wellbeing as a priority. Reported priorities included uncertainty about the refugee application, housing, unstable working conditions, and plans to move to another country. These factors may have limited engagement and availability to participate. Moreover, we identified a relatively large proportion of individuals with a diagnosis of mental disorder who were advised to seek appropriate care according to a predefined protocol and were excluded from participation. We note, however, that the systematic exclusion of participants with a mental disorder at baseline is a key strength of our study, as compared with previous studies evaluating psychological interventions on severely distressed participants who are more likely to respond to the intervention or to attend the sessions because they prioritize the intervention more [52, 53]. These studies did not exclude participants with mental disorders at baseline, making it impossible to calculate the frequency of new cases of mental disorders at follow-up [54, 55]. Despite these challenges in reaching the target sample size, we were able to detect a statistically and clinically significant difference after treatment, thus indicating sufficient statistical power for this secondary analysis.
Second, a double-blind design was not feasible. However, outcome assessors were masked, i.e., they were not involved in any trial phase that might break their blindness [56, 57]. For that reason, both participants and assessors were instructed not to mention any interventions received during the study.
A third limitation is related to the heterogeneity of the included population groups. The choice of involving people from multiple backgrounds was justified by the need to generate an evidence base for an intervention that has the potential for large-scale uptake across migrant populations.
Finally, a substantial proportion of participants was lost to follow-up (more than 20% after the intervention and more than 30% at the 6-month follow-up). We note, however, that the number of people lost to follow-up is in line with the expectations listed in the study protocol [19] and similar to those reported in other psychological intervention studies [13, 18].
Given the characteristics of SH+, i.e., delivery by briefly trained nonspecialist peers, its ease of implementation, the large group format, its short-term efficacy in preventing the development of mental disorders, its efficacy in ameliorating psychological distress in different populations, and the lack of adverse effects associated with its delivery, it might be considered as a public health strategy for healthcare agencies and nongovernmental organizations implementing migrant reception programs. Further research should be conducted to replicate results immediately after intervention and to explore the potential effects of booster SH+ sessions to reinforce the beneficial effects even in the long term.
Statement of Ethics
This project was approved by the WHO Research Ethics Review Committee and by the ethics committees of all of the participating sites. Written informed consent was mandatory for all of the included participants. In accordance with the Declaration of Helsinki, the participants’ confidentiality was preserved and the contents of the recruitment and follow-up forms were not disclosed to any third party.
Conflict of Interest Statement
The authors have no conflict of interests to declare.
Funding Sources
This work was supported by the European Commission (grant agreement No. 779255; “RE-DEFINE: Refugee Emergency: DEFining and Implementing Novel Evidence-based psychosocial interventions”). The authors are grateful to peer facilitators and cofacilitators, who delivered the SH+ intervention, and to all of the assessors who administered baseline and follow-up interviews. The authors alone are responsible for the views expressed in this article, and they do not necessarily represent the views, decisions, or policies of the institutions with which they are affiliated.
Author Contributions
C.B. and M.v.O. conceived this study with inputs from K.C., M.P., and P.C. M.P. and C.B. drafted this paper. All the authors contributed to the study design, recruitment, follow-up assessments, and/or commenting on/editing the drafts of this work. F.T. planned and performed all of the statistical analyses with inputs from C.B.
The authors alone are responsible for the views expressed in this article and they do not necessarily represent the views, decisions, or policies of the institutions with which they are affiliated.
Data Availability Statement
Data collected in the RE-DEFINE study are stored in the online repository EUDAT B2SHARE (https://b2share.eudat.eu/records/fa7264d624364683830ff37acee01c04). The reuse of data will be offered only upon motivated request, which will undergo the scrutiny of the RE-DEFINE General Assembly.
References
Additional information
M. von Ommeren and C. Barbui contributed equally to this study.