Great Expectations: Recommendations for improving the methodological rigor of psychedelic clinical trials

Aday and colleagues situate their paper in the context of a rapid expansion of clinical research on psychedelic medicines alongside longstanding concerns about expectancy effects, control conditions and effective masking. Earlier research from both psychotherapy and pharmacology trials has long recognised that non-specific factors—such as spontaneous remission, regression to the mean, Hawthorne effects, placebo and nocebo responses—can produce apparent clinical change independent of a tested intervention. Psychedelic trials face these general challenges plus additional, field-specific problems: highly salient acute subjective effects that make masking difficult, widespread positive media and cultural “hype” that elevate participants' outcome expectations, and interactions between unmasking and expectations that may amplify placebo or nocebo influences. This paper aims to review the methodological challenges specific to psychedelic clinical trials and to offer practical recommendations to improve their rigour. Rather than testing a new treatment, the authors undertake a scoping synthesis of prior literature and trial practices to identify common sources of bias, evaluate previous masking strategies and propose an integrated framework of design, recruitment, procedural and analytic measures to reduce expectancy-related confounds. The objective is to improve the ability of future trials to distinguish treatment-specific effects of psychedelic therapy from treatment-nonspecific influences.

The paper is presented as a scoping, narrative review and methodological commentary rather than as a formal systematic review or meta-analysis. The authors synthesise evidence and examples from prior clinical trials, methodological reviews and empirical studies across psychotherapy and psychopharmacology, with particular attention to psychedelic research. Extracted text does not report a formal search strategy, inclusion criteria, databases searched, date range, or study selection process, so it is not possible to reconstruct a reproducible literature search from this extraction. Rather than applying a single quantitative method, the investigators review conceptual distinctions (treatment-specific versus treatment-nonspecific effects), summarise empirical findings about expectancies and masking from relevant trials (including examples from psilocybin, ayahuasca, MDMA and other substances), and review trial designs and masking techniques that have been attempted. From that synthesis they generate practical recommendations spanning study development and design, participant recruitment and selection, study procedures (including measurement of expectations and masking efficacy), active placebo development, and analytic strategies. Where specific trials or experimental strategies are discussed (e.g., low-dose control conditions, incomplete disclosure, amnestic pairing with midazolam), the authors draw on reported outcomes from those studies or trials to illustrate methodological strengths and limitations.

The authors' synthesis highlights several consistent findings and empirical observations relevant to psychedelic trials. First, multiple mechanisms unrelated to a specific treatment—spontaneous remission, regression to the mean and observation effects (Hawthorne)—regularly produce symptom change in clinical studies and therefore require appropriate control arms. Second, outcome expectancies have substantial, measurable effects on clinical outcomes across psychotherapy and pharmacology; the authors cite a meta-analysis reporting an effect of outcome expectancies on treatment results (Cohen's d = 0.36) and note placebo analgesia studies in which expectancies accounted for up to 81% of variance in post-treatment pain ratings. Specific to psychotropic and psychedelic research, the extracted text reports that masking is often ineffective. A systematic review found poor reporting of masking and high rates of functional unmasking in pharmacologic trials; in the authors' account, masking was not maintained in 20/23 “double-blind” psychotropic trials and only 59% of trial reports in top psychiatry journals adequately reported masking outcomes. Psychedelic trials have repeatedly struggled with active-placebo approaches: classic examples include the Good Friday Experiment (psilocybin versus niacin) where participants correctly identified allocation, and modern trials using niacin, methylphenidate or dextromethorphan which often achieved masking success of less than 25% or did not report masking. Other reported figures include studies where participants accurately identified MDMA or psilocybin ~70–85% of the time in designs attempting broader consent to multiple substances. Microdosing and macrodosing trials that measured expectations found that baseline outcome expectancies predicted wellbeing gains irrespective of active drug versus inert placebo, and an ayahuasca macrodose study found pre-treatment expectancy predicted changes in personality measures. Design-specific findings: crossover designs are problematic for psychedelics because of durable treatment effects and carryover that can persist for many months; one cited consequence is that even long washouts may not suffice. Low-dose (microdosing) controls and incomplete disclosure have been tried to improve masking, though each has trade-offs: low doses may be therapeutic or distressing, and incomplete disclosure raises ethical concerns. An innovative approach under development pairs psilocybin with an amnestic agent (midazolam) to attempt to preserve masking by preventing memory formation of the psychedelic session; the authors note this design is experimentally intriguing but raises both ethical and technical uncertainties. Finally, the authors compile a range of practical recommendations based on their synthesis: include both inactive and active control arms (three-arm designs), consider sequential parallel designs with placebo run-in to exclude placebo responders, recruit psychedelic-naive participants (and naive to the chosen active placebo), measure participants' and therapists' outcome expectations and perceived allocation both pre- and post-session, power studies with known placebo effect sizes (pooled placebo benchmark reported as Hedges' g = 1.05 in depression by one cited source), repeat baseline assessments to mitigate regression to the mean, test and report masking efficacy, and analyse outcomes using expectancy and perceived allocation as covariates.

The authors interpret their review as showing that psychedelic trials face both general and unique methodological challenges. In their view, salient psychoactive effects and broad cultural enthusiasm ('hype') elevate outcome expectancies and make traditional inert-placebo masking insufficient for high-dose psychedelic studies. They argue that inadequate masking can allow expectancies to conflate with treatment assignment, undermining the ability to detect treatment-specific pharmacological effects. To address these problems, the authors position a suite of design, procedural and analytic strategies as necessary steps. They emphasise combining multiple approaches—better control condition choice (including active comparators), incomplete disclosure when ethically permissible, recruitment of psychedelic-naive participants, rigorous measurement of expectations and masking success, and analytic plans that adjust for expectancy and perceived allocation. The authors also recommend trial designs suited to the field's particularities, such as three-arm trials and sequential parallel designs, while warning against simple crossover designs because of carryover effects. Where standard explanatory RCTs may not capture the interactive system of drug, context and expectation, they suggest pragmatic clinical trials to assess real-world effectiveness and natural experiments (population-level evaluations following legalisation) as alternative or complementary strategies. The authors acknowledge practical, ethical and scientific limitations of their recommended approaches. Incomplete disclosure and deceptive practices require careful ethical justification and institutional review; amnestic agents pose safety and interpretive uncertainties; low-dose controls may be either therapeutic or cause distress; and active-placebo development is technically challenging and currently lacks validated candidates. They stress that masking is not binary and that incremental improvements—combined across study development, recruitment, conduct and analysis—can reduce expectancy-related bias. Finally, the authors underscore the value of measuring and reporting expectancy and masking metrics systematically, so future trials can iteratively improve design and interpretation.

Aday and colleagues conclude that separating pharmacological effects from interacting socio-psychological factors in psychedelic medicine is both essential and difficult. Traditional inert-placebo masking is generally insufficient in high-dose psychedelic trials; therefore, the field should adopt a framework incorporating improved control conditions, strategic recruitment, measured and managed participant expectations, rigorous masking-efficacy testing, and analytic strategies that account for expectancies. While some approaches raise ethical and practical challenges, implementing these recommendations should increase the methodological rigour of future psychedelic research and may also be applicable to psychotherapy and pharmacology trials more broadly.