Assessing the risk of symptom worsening in psilocybin-assisted therapy for depression: a systematic review and individual participant data meta-analysis
This meta-analysis (n=102, s=3) assesses the risk of symptom worsening in psilocybin trials for depression. It reports that clinically significant symptom worsening occurred in approximately 10% of participants in the psilocybin and escitalopram conditions, and in 63.6% of participants in the waitlist condition. Psilocybin showed a lower likelihood of symptom worsening compared to waitlist, and no difference when compared to escitalopram.
Abstract
We conducted a meta-analysis using individual participant data from three, two-dose psilocybin trials for depression (N=102) with the aim of assessing the risk of symptom worsening. Clinically significant symptom worsening occurred for a minority of participants in the psilocybin and escitalopram conditions (∼10%) and for a majority of participants in the waitlist condition (63.6%). Using data from the two trials with control arms, the psilocybin arm showed a lower likelihood of symptom worsening versus waitlist, and no difference in the likelihood of symptom worsening versus escitalopram. The limitation of a relatively small sample size should be addressed in future studies.
Research Summary of 'Assessing the risk of symptom worsening in psilocybin-assisted therapy for depression: a systematic review and individual participant data meta-analysis'
Introduction
Depression is a leading cause of global disability and current treatments do not reliably help all patients; some people fail to respond and others experience symptom worsening. Psilocybin-assisted therapy has produced reductions in depressive symptoms in several clinical trials, but prior work had not quantified clinically relevant worsening of depressive symptoms within psilocybin trials, nor had it thoroughly examined whether baseline demographic characteristics predict either symptom worsening or treatment response. Simonsson and colleagues set out to address this gap by performing an individual participant data (IPD) meta-analysis of published clinical trials of psilocybin for depression. The study aimed to (1) estimate the prevalence of clinically relevant worsening of depressive symptoms after psilocybin-assisted therapy and (2) examine whether baseline demographic variables were associated with symptom worsening or with treatment response. The authors hypothesised that rates of clinically relevant worsening would be lower in psilocybin conditions than in control conditions for trials that included controls, and they did not specify a priori hypotheses about demographic predictors.
Methods
The investigators conducted an IPD meta-analysis reported in line with PRISMA guidance and preregistered on the Open Science Framework; the IRB at UW–Madison determined the project to be exempt. They searched PubMed, PsycINFO, Embase and the Cochrane Library from inception through 28 March 2022 using the search term "psilo*", with no restrictions on language or publication status. Bibliographies of recent meta-analyses were also screened. Eligible studies used psilocybin as the primary intervention and reported outcomes on standardised depression measures; both controlled and uncontrolled studies and clinical and non‑clinical populations were eligible. For outcome measurement the team calculated standardised mean difference (SMD) scores for depression measures by computing pre–post change (post minus pre) divided by the baseline standard deviation of each measure. The authors defined clinically relevant symptom worsening as SMD ≥ 0.24. Analyses used a one‑step random effects approach implemented as random intercept multilevel models, nesting participants within study ID in line with recommended practice. Multilevel linear regression was used for continuous SMD outcomes and multilevel logistic regression for the dichotomous worsening outcome. Five baseline demographic predictors that were available across the included studies were examined: age; gender (male versus female); race/ethnicity (White versus non‑White); education (undergraduate degree or higher versus other); and employment status (unemployed versus other). Models of treatment response included the psilocybin arms from all three trials. Analyses were conducted in R; when an empty cell occurred for a demographic predictor (no non‑White participants reported worsening after psilocybin) the investigators used bias‑reduced penalised likelihood logistic regression (logistf) as a sensitivity approach. Deviations from the preregistration and further methodological detail were reported in Supplemental Materials.
Results
Three eligible studies were included; each had two dosing sessions and focused on populations with depressive disorders. Across these studies 102 participants completed both baseline and six‑week follow‑up depression assessments: 62 received psilocybin‑assisted therapy, 29 received escitalopram, and 11 were assigned to waitlist. On average, participants in the psilocybin and escitalopram arms showed large reductions in depressive symptoms at post‑test, with SMDs of −2.38 (SD = 1.69) for psilocybin and −1.56 (SD = 1.36) for escitalopram. Participants in the waitlist condition showed a mean worsening of symptoms (SMD = 0.26, SD = 1.06). The proportion of participants meeting the study’s pre‑specified threshold for clinically significant worsening was 9.7% in the psilocybin arm and 10.3% in the escitalopram arm, whereas 63.6% of waitlist participants met the worsening threshold. When analyses were restricted to the two studies that included control conditions, assignment to the psilocybin arm was associated with a lower likelihood of symptom worsening relative to waitlist; the reported odds ratio comparing worsening in waitlist versus psilocybin was 13.30 (95% CI [3.02, 70.74], p = .001), which the authors interpret as greater odds of worsening in the waitlist group. There was no significant difference in likelihood of symptom worsening between psilocybin and escitalopram (OR = 0.88, 95% CI [0.17, 3.89], p = .865). Including the five demographic covariates did not alter these test results (psilocybin vs waitlist remained p < .001; psilocybin vs escitalopram p = .833 in the adjusted model as reported). None of the five baseline demographic variables were significantly associated with treatment response or with likelihood of symptom worsening in the psilocybin arm. The authors also report that treatment‑resistant depression status was not associated with frequency of symptom worsening (5.3% for treatment‑resistant depression vs 18.1% for other studies; OR = 0.42, 95% CI [0.02, 3.30], p = .446). The authors note the small sample sizes—particularly the waitlist group (n = 11)—and the occurrence of an empty cell for race in the worsening analysis, which prompted use of penalised logistic regression as a robustness check.
Discussion
Simonsson and colleagues interpret their findings as indicating that clinically relevant worsening of depressive symptoms occurred in a minority of participants receiving psilocybin‑assisted therapy (approximately 10%), a rate comparable to that reported for psychotherapy (~7%) and similar to the rate observed with escitalopram in this pooled dataset. By contrast, a majority of participants in the waitlist condition met the worsening threshold (63.6%), a proportion the authors note is higher than a prior psychotherapy waitlist meta‑analysis (17.4%) but may reflect differences in the chosen worsening cutoff (their conservative SMD ≥ 0.24 versus a larger threshold used elsewhere) and potential nocebo effects when participants do not receive a desired treatment. The pooled analyses that included control trials suggested that psilocybin confers a lower risk of symptom worsening than being assigned to waitlist and a similar risk to an FDA‑approved antidepressant (escitalopram). No baseline demographic variables among the five examined (age, gender, race/ethnicity, education, employment) were associated with either treatment response or likelihood of worsening, and treatment‑resistant status was not linked to higher rates of worsening in these data. The authors acknowledge several important limitations: the overall sample size was relatively small, limiting power to detect smaller effects and making some subgroup comparisons unreliable; the waitlist sample was especially small; the study operationalised worsening only as change in depressive symptom scores and did not capture other clinical deteriorations such as increased suicidality; included trials were heterogeneous in design; only five baseline demographics were available, precluding analysis of psychological or genetic predictors; participant samples lacked diversity in race and ethnicity; and follow‑up was limited to six weeks, preventing assessment of longer‑term trajectories. They conclude that the results are preliminary but suggest psilocybin‑assisted therapy is not associated with higher short‑term risk of clinically relevant symptom worsening compared with standard pharmacological treatment, and that replication in larger, more diverse, and longer‑duration studies would strengthen these safety inferences.
View full paper sections
INTRODUCTION
The leading factor contributing to disability worldwide is depression, a mood disorder that is estimated to affect more than 350 million people. Standard treatments for depression are effective for some patients, but many do not respond to treatment at all, and some experience worsening of depressive symptoms. Such treatments can also take weeks or even months to produce clinically relevant reductions in depressive symptoms, highlighting the need for novel treatments for depressive disorders. One intervention that shows promise is psilocybin-assisted therapy. The administration of psilocybin in conjunction with therapy has been shown to reduce depressive symptoms in several clinical trials, but no study to date has evaluated clinically relevant worsening of depressive symptoms in psilocybin clinical trials for depression. There is also limited information on whether baseline demographic characteristics are associated with symptom worsening or treatment response to psilocybinassisted therapy. In this study, we identified all published psilocybin clinical trials on depression. We requested the primary depression outcome data from study authors and conducted an individual participant data meta-analysis 1) assessing prevalence of clinically relevant worsening of depressive symptoms and 2) examining baseline demographic characteristics associated with symptom worsening or treatment response. We hypothesized that rates of clinically relevant worsening of depressive symptoms would be lower in psilocybin conditions than rates in control conditions for studies that included control groups, but we had no a priori hypotheses about baseline demographic characteristics associated with symptom worsening or treatment response.
METHODS
This independent participant data meta-analysis is reported following the PRISMA guidelines. The study protocols were registered at the Open Science Framework:and. Deviations from our preregistration are reported in Supplemental Materials. The study was determined to be exempt from review by the Internal Review Board (IRB) at UW-Madison.
SEARCH STRATEGY AND STUDY SELECTION
We searched PubMed, PsycINFO, Embase and the Cochrane Library with the following search term: psilo*. The search was conducted on 28 th March, 2022. The databases were searched since their inception. No restrictions were placed on language or publication status. Studies that had this term appear in the abstract, title, and/or keywords were reviewed. Bibliographies of recent meta-analyses examining psilocybin and psychedelic trials were also searched for potentially relevant studies. Eligible studies had to have used psilocybin as the primary intervention and have reported outcome data on standardized measures of depression. Controlled and uncontrolled studies on both clinical and non-clinical populations were eligible (see Supplemental Materials for information about data extraction).
STATISTICAL ANALYSES
To characterize symptom change, we calculated standardized mean difference (SMD) scores for the depression measures (GRID-Hamilton Depression Rating Scale;, in keeping with meta-analytic methods. Specifically, we calculated pre-post change scores (post minus pre) and divided this value by the baseline standard deviation of each measure. To define symptom worsening, we used a value of SMD ≥ 0.24. We then conducted a series of one-step meta-analyses with a random effects component (i.e., random intercept multilevel models;examining predictors of symptom worsening and treatment response. In keeping with Burke and colleagues (2017), we modeled the nesting of effects within study ID. We examined five demographic variables which were available across all three studies as predictors. Models examining response to psilocybin included the psilocybin arm from all three trials. Models examining treatment response as a continuous variable (SMD) used multilevel linear regression while models examining treatment response as a dichotomous variable (i.e., symptom worsening) used multilevel logistic regression. Analyses were conducted in R (R Core Team, 2022; see Supplemental Materials for R code).
RESULTS
Three studies were included in the independent participant data meta-analysis; see Fig.), 1 which were all of the eligible studies with two dosing sessions focused on populations with depressive disorders (see Supplemental Materials and Supplemental Tables 1-3 for details of studies included). Collectively, these studies included 102 participants who completed the measures at both baseline and at sixweek follow-up, of whom 62 received psilocybin-assisted therapy, 29 received escitalopram, and 11 received waitlist. Five baseline demographic characteristics across the three studies were included: age, gender (coded as male versus female), race/ethnicity (coded as White versus non-White), education (coded as undergraduate degree or higher versus other), and employment status (coded as unemployed versus other). Participants in the psilocybin and escitalopram conditions showed large reductions in depressive symptoms at post-test in both conditions (SMDs = -2.38 and -1.56, SD = 1.69 and 1.36, respectively) while participants in the waitlist control showed a worsening of symptoms on average (SMD = 0.26, SD = 1.06). A minority of participants in the psilocybin and escitalopram conditions showed clinically significant symptom worsening (9.7% and 10.3%, respectively), while the majority of participants in the waitlist control condition showed clinically significant symptom worsening (63.6%; see Supplemental Table). When restricted to the two studies that included a control condition, assignment to the psilocybin arm was associated with a lower likelihood of symptom worsening relative to waitlist (OR = 13.30, 95% CI [3.02, 70.74], p = .001) and no difference in the likelihood of symptom worsening relative to escitalopram (OR = 0.88, 95% CI [0.17, 3.89], p = .865). 2 None of the five demographic variables examined were associated with response to the psilocybin arm (Supplemental Table). One empty cell was detected when examining demographic variables in association with symptom worsening. Specifically, no non-White participants reported worsening symptoms following psilocybin. To examine these this demographic predictor, we implementedbias-reduced penalized likelihood logistic regression implemented in the 'logistf' package in R). 2 Significance tests did not change when including the five demographic variables as covariates, p < .001 for psilocybin vs. waitlist; OR = 1.20, 95%], p = .833 for psilocybin vs. escitalopram). None of the five demographics variables examined were associated with likelihood of symptom worsening in response to psilocybin (Supplemental Table). 3
DISCUSSION
This study was an individual participant data meta-analysis assessing the prevalence of clinically relevant worsening of depressive symptoms and examining baseline demographic characteristics associated with symptom worsening or treatment response. Results showed clinically significant symptom worsening in a minority (~10%) of participants in the psilocybin and escitalopram conditions. This is in line with rates for psychotherapy, where ~7% of the patients show symptom worsening. By contrast, a majority (63.6%) of the waitlist condition showed symptom worsening. That is a surprisingly high proportion when compared with a meta-analysis of waitlist controls in psychotherapy that found only 17.4% of patients showed symptom worsening. However, had the psychotherapy meta-analysis used the same conservative cut-off of 0.24 instead of 0.84 SMD units, the proportion may have been comparable. This relatively high rate of worsening in the waitlist condition may reflect a kind of "nocebo" effect, where participants not receiving a desired treatment are actively disappointed, resulting in symptom worsening. Worsening associated with waitlist conditions specifically has been observed in psychotherapy trials previously. In the two clinical trials with control conditions, assignment to the psilocybin arm was associated with a lower likelihood of symptom worsening relative to waitlist and no difference in the likelihood of symptom worsening relative to escitalopram. Thus, it appears that receipt of psilocybin confers risk of symptom worsening similar to an FDA-approved antidepressant medication and is substantially protective against risk of symptom worsening 3 Whether the study focused on participants with treatment-resistant depression was not associated with frequency of symptom worsening (5.3% for treatment-resistant depression vs. 18.1% for other studies, OR = 0.42, 95% CI [0.02, 3.30], p = .446). relative to treatment with delayed start. None of the five baseline demographic characteristics examined were associated with response to psilocybin or likelihood of symptom worsening in response to psilocybin. There are several limitations to consider when interpreting the results of this study. First, the combined sample size of the included studies was relatively small, which limited statistical power to detect potentially smaller magnitude associations. The sample size of the waitlist control condition (n=11) was especially small and may therefore have impacted the reliability of comparisons. Second, there are many ways to operationalize worsening of clinical status (e.g., increase in suicidality), but this study focused solely on worsening of depressive symptoms. Third, the included studies were heterogeneous in terms of research design. Fourth, participant-level predictors were limited to five baseline demographic characteristics. It would be useful in future studies to examine additional potential predictors of treatment response (e.g., psychological, genetic). Fifth, the diversity (e.g., race and ethnicity) in the samples was limited and should be addressed in future studies to increase the generalizability of findings. Sixth, only six-week follow-up was examined in this study. It was therefore not possible for this analysis to provide guidance on the time course of symptom worsening or any sustained effects beyond these assessments. Although the findings in this study should be considered preliminary, these results suggest that clinically relevant symptom worsening in depressed patients is not more common with psilocybin-assisted therapy than with standard pharmacological treatment (i.e., escitalopram). If such findings are replicated in future studies, it would further strengthen the overall safety profile of psilocybin, which appears favorable based on the evidence to date.
AUTHOR CONTRIBUTIONS
OS, PC, and SBG conceptualized and preregistered the study. OS and PC conducted the screening. SBG supervised the study and conducted the analyses. RCH, AKD, DJN, RRG, DE provided data and made critical revisions.
Full Text PDF
Study Details
- Study Typemeta
- Populationhumans
- Characteristicsmeta analysis
- Journal
- Compound
- Author