Development of the Psychological Insight Questionnaire among a sample of people who have consumed psilocybin or LSD
The authors developed and validated the 23‑item Psychological Insight Questionnaire, comprising two subscales (Avoidance and Maladaptive Patterns Insights; Goals and Adaptive Patterns Insights), in a sample of psilocybin and LSD users. Scores showed good construct validity, were moderately-to-strongly associated with retrospectively reported increases in psychological flexibility and well‑being, and predicted these changes beyond measures of mystical and challenging acute effects.
Authors
- Barrett, F. S.
- Davis, A. K.
- Griffiths, R. R.
Published
Abstract
Background: Several measures have been developed to examine acute psychedelic effects (e.g. mystical-type and challenging experiences), but no measure assesses acute psychologically insightful experiences that may occur during psychedelic experiences. Aim: The purpose of this study was to develop and examine the psychometric properties of the Psychological Insight Questionnaire. Method: A cross-sectional survey study among psilocybin and LSD users. Respondents ( n=1661; Mage=22.9, standard deviation=8.5; Caucasian/White=83%; non-Hispanic=91%; men=72%; United States resident=66%) completed an Internet-based survey. Results: The Psychological Insight Questionnaire consists of 23 items with two subscales: (a) Avoidance and Maladaptive Patterns Insights and (b) Goals and Adaptive Patterns Insights. Construct validity of the Psychological Insight Questionnaire was supported by strong correlations of the Psychological Insight Questionnaire (and Avoidance and Maladaptive Patterns Insights and Goals and Adaptive Patterns Insights subscales) scores with the insight subscale of the Session Impacts Scale, and weak-to-moderate correlations with the Mystical Experiences and Challenging Experiences Questionnaires. Furthermore, Psychological Insight Questionnaire (and Avoidance and Maladaptive Patterns Insights and Goals and Adaptive Patterns Insights subscales) scores were moderately-to-strongly correlated with retrospectively reported increases in psychological flexibility, and well-being/life satisfaction that were attributed to a memorable psychedelic experience. Lastly, incremental validity was established showing that the Psychological Insight Questionnaire (and Avoidance and Maladaptive Patterns Insights subscale) scores predict unique variance in changes in psychological flexibility, and Psychological Insight Questionnaire (and Avoidance and Maladaptive Patterns Insights and Goals and Adaptive Patterns Insights subscales) scores predict changes in well-being and life satisfaction, beyond measures of acute mystical-type and challenging effects. Conclusions: The Psychological Insight Questionnaire has the potential to extend the understanding of the acute and enduring effects of psychedelics. Further longitudinal research is necessary to determine the long-term predictive validity of the Psychological Insight Questionnaire and to examine the role of psychological insight in predicting therapeutic outcomes.
Research Summary of 'Development of the Psychological Insight Questionnaire among a sample of people who have consumed psilocybin or LSD'
Introduction
Earlier research has produced several broad instruments to quantify subjective psychedelic effects (for example, the States of Consciousness Questionnaire, Hallucinogen Rating Scale, and Altered States of Consciousness Rating Scale), and shorter targeted measures have since been derived to capture specific experiential domains such as mystical-type experiences (Mystical Experiences Questionnaire, MEQ) and challenging experiences (Challenging Experience Questionnaire, CEQ). However, the authors note that no psychometrically validated, multi-item measure specifically targets acute psychologically insightful experiences—realizations or discoveries about one’s personality, relationships, patterns of behaviour or emotions—that can occur during a discrete psychedelic episode. Existing single- or few-item constructs of insight (for instance, the “insightfulness” sub-factor within Oceanic Boundlessness or single items in persisting-effects questionnaires) and measures of emotional breakthrough capture parts of this domain but do not assess its breadth. Davis and colleagues designed this study to develop and psychometrically evaluate a brief self-report instrument, the Psychological Insight Questionnaire (PIQ), intended to measure acute insight experiences occasioned by classic psychedelics. The primary aims were to generate candidate items, test the instrument’s factor structure and internal reliability, and evaluate construct, predictive and incremental validity against established measures of mystical and challenging experiences as well as retrospective reports of changes in psychological flexibility and well-being. The authors positioned the PIQ as a tool for future clinical and laboratory research on mechanisms of psychedelic-related change.
Methods
Item development began with consultation among psilocybin session facilitators and iterative revision by members of the study team, yielding an initial pool of 38 candidate items that was reduced to a 28-item draft after removing redundant or unclear items. Respondents rated the intensity with which they experienced each candidate insight item during a single most-insightful psychedelic experience on a six-point scale from 0 ("No; not at all") to 5 ("Extremely (more than ever before in my life)"). The final PIQ and scoring are reported as provided in the supplementary material (not included here). Data were collected via an anonymous internet-based cross-sectional survey conducted June 2018–February 2019. Inclusion criteria were age 18+; fluent English; having taken a single psychedelic that produced moderate-to-strong psychoactive effects; and attributing a gained psychological insight to that experience. Recruitment used online postings, e-mail announcements and an article on Motherboard/VICE. Of 15,470 people who clicked the advertisement, 3177 began the survey; after exclusions for polysubstance use (n=996), use of psychedelics other than psilocybin or LSD (n=398), and inconsistent responses (n=122), the final analytic sample was 1661. The sample was predominantly young (mean age 22.9, SD=8.5), White (83%), male (72%) and US residents (66%). The study received institutional review board approval; no incentives were offered. Alongside the PIQ, respondents completed established measures to evaluate construct and predictive validity: the 30-item MEQ (mean score used; alpha=0.95), the 26-item CEQ (mean score used; alpha=0.95), the five-item Session Impacts Scale (SIS) insight subscale (0–4 scale; alpha=0.84), the Acceptance and Action Questionnaire II (AAQ-II) administered twice to derive retrospective pre–post change in psychological flexibility (reversed so higher = greater flexibility; alphas 0.91 and 0.88), and the Satisfaction With Life Scale (SWLS) administered twice to derive retrospective change in well-being (alphas 0.86 and 0.82). Change scores were computed as post minus pre means for AAQ-II and SWLS and used in subsequent analyses. For scale development, the 1661 respondents were stratified into matched exploratory and confirmatory subsamples (after dropping 250 observations to ensure adequate cell sizes), yielding 1411 responses for factor analyses (exploratory n=652; confirmatory n=759). The exploratory stratum underwent principal components analysis (PCA) with varimax rotation; parallel analysis and scree inspection guided factor extraction. Items with loadings <0.4 or cross-loadings ≥0.4 were removed iteratively to achieve a simple structure. Internal consistency was assessed with Cronbach’s alpha, corrected item-total correlations and average inter-item correlations. The resulting factor structure was tested in the confirmatory stratum via confirmatory factor analysis (CFA) with standard fit indices (RMSEA, SRMR, CFI). Construct validity was examined with Pearson correlations and linearity tests. Incremental validity was assessed using stepwise linear regression models predicting retrospective changes in psychological flexibility and well-being, first entering MEQ and CEQ scores, then adding PIQ subscale scores to evaluate added explanatory variance.
Results
Scale structure and reliability: Principal component analysis in the exploratory subsample indicated two components, after removal of items that failed loading criteria, resulting in a final PIQ with two subscales labelled Avoidance and Maladaptive Patterns Insights (AMP) and Goals and Adaptive Patterns Insights (GAP). Parallel analysis supported a single component within each subscale. Internal consistency was high: AMP Cronbach’s alpha = 0.93 (95% CI 0.92–0.94) and GAP alpha = 0.85 (95% CI 0.84–0.87). Corrected item–total correlations ranged approximately 0.48–0.78 across subscales and average inter-item correlations were r=0.48 (AMP) and r=0.37 (GAP). No remaining item removal materially increased alpha, so all retained items were kept. In the confirmatory subsample, CFA yielded acceptable fit (RMSEA = 0.052, 90% CI 0.045–0.058; SRMR = 0.027; CFI = 0.973). The AMP and GAP subscales were strongly correlated with one another (r = 0.62, p < 0.001) and with the PIQ total score. Construct validity: Correlational analyses in the full sample (n=1661) showed weak-to-moderate associations between PIQ metrics and mystical-type and challenging experiences. Specifically, PIQ mean score correlations with MEQ were reported as moderate (PIQ r=0.38, p<0.001; AMP r=0.27, p<0.001; GAP r=0.50, p<0.001). Correlations with the CEQ were generally weak (PIQ r=0.14, p<0.001; AMP r=0.21, p<0.001; GAP r = -0.02, not significant), suggesting the PIQ taps a domain distinct from challenging experiences. The PIQ total and subscales also correlated strongly with the SIS insight subscale; the extracted text reports a strong correlation but the precise correlation coefficient for the PIQ–SIS relation is not clearly reported in the provided extraction. Predictive and incremental validity: Descriptive statistics reported for the PIQ and outcome change scores were: PIQ mean = 3.08 (SD 1.03), AMP mean = 2.90 (SD 1.22), GAP mean = 3.36 (SD 1.01); AAQ-II change mean = 1.55 (SD 1.46); SWLS change mean = 1.15 (SD 1.05). The authors report a strong correlation between PIQ (and both subscales) and retrospective increases in psychological flexibility, and a moderate correlation between PIQ (and subscales) and increases in well-being/life satisfaction, though exact correlation coefficients for these relations are not fully reported in the extract. Stepwise regression analyses assessed whether PIQ scores added predictive value beyond MEQ and CEQ. For change in psychological flexibility, adding AMP and GAP substantially increased explained variance: in the final model MEQ β = 0.09 (p < 0.001), CEQ β = -0.08 (p < 0.001), AMP β = 0.52 (p < 0.001), and GAP β = 0.04 (p = 0.147); the F change for adding the two PIQ subscales was F(2,1656) = 316.78, p < 0.001, and adjusted R2 for the model including PIQ subscales was reported as 0.31. For change in well-being and life satisfaction, the final model coefficients included MEQ β = 0.17 (p < 0.001), CEQ β = -0.04 (p = 0.104), AMP β = 0.27 (p < 0.001) and GAP β = 0.10 (p = 0.001); the F change for adding PIQ subscales was F(2,1656) = 104.55, p < 0.001. A portion of the extracted regression reporting (for example some adjusted R2 values and earlier-step model betas) is truncated in the provided text and not clearly recoverable from the extraction.
Discussion
Davis and colleagues interpret their findings as supporting the PIQ as a brief, reliable measure of acute psychological insight following psilocybin or LSD experiences, with two coherent subscales that capture insight about avoidance/maladaptive patterns (AMP) and about goals/adaptive patterns (GAP). Both subscales and the total PIQ demonstrated high internal consistency, and the two-factor structure held up in confirmatory factor analysis with acceptable fit indices. Construct validity was evidenced by strong associations with a general session-insight measure (SIS) and by distinct, weaker associations with measures of mystical-type and challenging experiences, indicating that the PIQ measures aspects of the psychedelic experience not fully captured by MEQ or CEQ. The authors argue that the PIQ showed predictive promise: PIQ scores were associated with retrospective reports of increased psychological flexibility and improved life satisfaction, and they accounted for unique variance in those outcomes beyond MEQ and CEQ scores. AMP in particular showed a large unique association with changes in psychological flexibility, while both AMP and GAP contributed to predicting well-being. From this, the study team proposes that acute psychological insight may be a distinct experiential mechanism that can contribute to therapeutic change after psychedelic experiences. The discussion situates these results within the broader psychotherapy and psychedelic literature, noting concordance with prior findings linking insight to positive outcomes across different interventions but also differences in effect sizes compared to some earlier reports; the authors caution that differences in measurement, sample characteristics and substances studied may account for discrepancies. They also acknowledge that related constructs—such as the Emotional Breakthrough Inventory—may overlap with the PIQ but were not compared here because of timing and reporting differences. Important limitations are acknowledged. The cross-sectional, retrospective web-survey design may introduce recall bias, selection bias due to targeted recruitment of people who recalled insight experiences, and demographic skew (primarily young, White men), limiting generalisability. The study did not assess clinical history or contextual variables (set and setting) and lacked independent content validation of items. The authors therefore emphasise the need for prospective, longitudinal, and clinical-laboratory research with more diverse samples to confirm predictive validity, to examine how reported insight varies with time since the experience, and to compare the PIQ with other emerging measures. They suggest the PIQ may also be useful for assessing acute insight in traditional psychotherapy contexts and for advancing mechanistic research in psychedelic-assisted interventions.
View full paper sections
CONCLUSION
The present study describes the development and initial psychometric examination of a novel scale to measure acute psychological insight that may occur in the context of a psychedelic experience. The resulting self-report measure was found to have two subscales measuring (a) avoidance and maladaptive patterns insights (AMP) and (b) goals and adaptive patterns insights (GAP), both of which demonstrated a high level of internal consistency as did the overall PIQ scale. Construct validity was supported by strong correlations with the PIQ scale and the SIS, as well as with both PIQ subscales and the SIS. Also supporting construct validity were weak-to-moderate correlations between the AMP subscale and MEQ and CEQ, and a moderate correlation with the PIQ scale (and the GAP subscale) and the MEQ. Overall, PIQ, and AMP and GAP, scores were moderately-to-strongly correlated with increases in psychological flexibility and well-being/ life satisfaction, suggesting predictive validity. A weak correlation between the mean scores on the PIQ and CEQ, as well as the AMP subscale and CEQ, and no correlation between the mean GAP subscale and CEQ scores suggests that, despite any difficulties associated with insight experiences, these experiences were not necessarily interpreted as being substantially challenging. Lastly, incremental validity was established showing that mean PIQ and AMP subscale scores predict unique variance in changes in psychological flexibility, and mean PIQ, and mean AMP and GAP, scores predict changes in well-being and life satisfaction beyond previously established measures of acute psychedelic effects. The PIQ has the potential to extend our understanding of the psychological mechanisms that may account for therapeutic effects of psychedelics. Mean PIQ scores had a moderate correlation with MEQ scores suggesting that the PIQ may capture experiential qualities that are distinct from those that fall under the category of mystical-type experiences. Though much attention has been paid to the contribution of mystical-type experiences to positive outcomes of psychedelic experiences, positive outcomes are possible in the absence of such effects. Indeed, the PIQ explores in detail a more readily describable facet of acute subjective psychedelic drug effects (i.e. psychological insight). Given that the PIQ scale predicts retrospective reports of increases in psychological flexibility and improvement in life satisfaction and well-being beyond what is predicted by the MEQ and CEQ scales, this suggests that the PIQ may reflect insights that are therapeutic in content. This finding indicates that it may also prove to be a valuable clinical tool to examine how phenomena that are otherwise difficult to describe may produce tangible shifts in one's mental health and assumptive worldview. Our findings were generally consistent with other literature on insight as it relates to psychedelic drug effects. Insight experiences have previously been found to correlate with positive outcomes after psychedelic use in prospective laboratory assessment in depressed patients, as well as in retrospective survey data from those with history of alcohol use disorder. Compared towe found a different correlation between the PIQ and the MEQ (0.38 vs 0.51). The smaller correlation between the PIQ scale and the MEQ in this sample may have been a result of differences in the assessment tool (single-item assessment vs multi-item PIQ), the study sample, or differences in psychedelic drugs reported in the experience (psilocybin/LSD vs any psychedelic). Although the content of the Emotional Breakthrough Inventoryappears to share some phenomenology related to psychological insights,did not provide sufficient detail of data to compare to our findings. Furthermore, we did not include the EBI in the current study because it had not been published when we collected data, thus future research will be needed to explore the relationship between these measures. Nevertheless, the PIQ is a more comprehensive measure compared to the insight items used in prior studies, which may be an advantage in that it could capture more nuances within the insight experience and thus provide more specificity with regard to measuring this acute effect. There are a number of challenges in understanding the present results in the context of the existing literature on insight in traditional psychotherapy. Apart from varying definitions of insight, much of the research in this area has to do with trait insightfulness rather than changes in insight secondary to treatment (i.e. acute insight experiences in the context of a discrete event). Additionally, prior studies that assessed change in insight have used a variety of assessment tools and have assessed different psychotherapeutic interventions in different clinical populations. However, the literature does reveal a few applicable studies that are largely consistent with our findings. For example,found that self-reported insight, as defined by conscious awareness of thoughts and feelings contributing to distress, increased over the course of 20 psychoanalytic psychotherapy sessions. Insight was correlated with positive outcomes with a "lead-lag" relationship (i.e. decreases in target complaints were generally preceded by and were proportional to increases in insight). This is congruent with our findings in that insight, as an aspect of the acute psychedelic experience, likely preceded any self-reported retrospective changes in well-being.also used a definition of insight that resembled the two items that loaded most strongly onto the first subscale of the PIQ (i.e. awareness and discovery of feelings that were previously avoided). Similarly,found that patients with psychosomatic, "neurotic," and personality disorders who gained insight over the course of psychotherapy, as measured by a clinician rater, had improved ability to cope by the end of treatment. Assuggested, insight may be an evolving process. This point was further demonstrated bywho found that insight followed a "high-lowhigh" pattern over a 16-week course of psychotherapy. Given the cross-sectional design of the present study, we were not able to evaluate whether there were any changes in reported insight over time. Future research should consider this in a study with longitudinal methodology. This cross-sectional study has several limitations. Responses were obtained through retrospective report via an anonymous Web-survey. Responses may thus have been influenced by access to the Internet, differences in exposure to online recruitment information, recall bias, differences in temperament of those who are more likely to respond to web surveys, or mood at time of filling out the questionnaire. Additionally, advertisements used for recruiting specifically targeted individuals who reported insight experiences secondary to psychedelic use, which may have skewed the result to favor a stronger correlation between insight experiences and well-being. The development of the scale also lacked independent ratings or validation of content validity, which could have increased confidence in the breadth of the items included in the preliminary and final questionnaires. The study design also lacked inclusion of questions related to the context (e.g. set and setting) in which the psychedelic was ingested, which could have been associated with acute and enduring effects. Consistent with prior studies that had similar recruitment procedures, respondents consisted primarily of young white men. Thus, results may not be more widely generalizable to other demographic groups. Mental health history was also not assessed, which limits the application of these data in clinical populations. The psychological value of this scale needs further examination in prospective studies with more diverse samples in order to overcome the limitations to generalizability noted above. This study demonstrates several positive elements of reliability and validity of the PIQ in assessing acute psychological insight, a less-well characterized aspect of psychedelic drug effects. Our findings suggest that psychological insight may represent a distinct facet of the psychedelic experience that is associated with long-term positive outcomes. Prospective measurement of acute insight effects and subsequent changes in mood, behaviors, and well-being in clinical and laboratory settings would be necessary to strengthen interpretations about the relationship between this construct and other measures of acute psychedelic effects as well as the predictive validity of this measure. Evaluation of the attribution of insight as a function of time since the psychedelic experience should also be evaluated. Finally, the PIQ may also be useful in assessment of insight effects of traditional psychotherapy or other interventions and provide an additional basis for comparison.
Study Details
- Study Typeindividual
- Populationhumans
- Characteristicssurvey
- Journal
- Compounds
- Topic