Role of Serotoninergic Neurons and 5-HT Receptors in the Action of Hallucinogens

Nichols frames the topic by noting renewed scientific interest in serotonin receptors and serotoninergic pathways as targets for psychoactive drugs, contrasted with the relative neglect of so-called hallucinogens. He emphasises that hallucinogens remain poorly understood pharmacologically, are subject to strict legal controls that have impeded clinical research, and that even nomenclature for the class is unsettled; terms such as "hallucinogen", "psychotomimetic", "psychedelic" and "entheogen" each carry different implications and none has universal acceptance. The introduction also highlights the long cultural and ritual history of hallucinogenic substances, and the considerable variability of their psychological effects, which depend strongly on dose, individual ‘‘set’’ (expectation and personality) and ‘‘setting’’ (environment). This chapter sets out to review experimental evidence bearing on the mechanism(s) of action of hallucinogens, with a particular focus on interactions with serotonin (5-HT) receptor subtypes and on how different chemical classes of hallucinogens (notably tryptamines, ergolines and phenethylamines) may act through overlapping but not identical serotonergic and monoaminergic mechanisms. Nichols frames the review around key experimental approaches (biochemistry, receptor pharmacology, electrophysiology, and behavioural paradigms) and highlights the central unresolved questions: which 5-HT receptor subtypes mediate the characteristic effects of hallucinogens, how tolerance develops, and how findings in laboratory animals map onto human experience.

The extracted text does not present a formal Methods section because the paper is a narrative review rather than an original experimental report. Nichols synthesises findings from biochemical assays, receptor binding and functional studies, electrophysiological recordings (notably dorsal raphe firing), in vitro signalling assays, site-directed mutagenesis of cloned receptors, and multiple behavioural paradigms in animals (for example the two-lever drug discrimination paradigm and the rat head-twitch response). Much of the cited experimental evidence comes from rodent work, including receptor binding affinities (Ki), measures of second-messenger signalling (e.g. phosphoinositide hydrolysis), and behavioural pharmacology using selective antagonists and agonists. Drug discrimination studies, in which animals are trained to distinguish a training drug from saline and antagonist or substitution tests probe receptor mediation, are emphasised as a primary behavioural model. Electrophysiology of dorsal raphe neurons is used to assess presynaptic effects on serotonin neuron firing. Molecular approaches cited include mutagenesis of the 5-HT2A receptor (notably Ser242/Ala242 substitutions) to probe species differences in ligand recognition. Nichols notes that human pharmacological data are sparse and mostly historical; the review therefore relies heavily on animal and in vitro studies. The paper does not describe a systematic literature-search strategy, risk-of-bias assessment, or quantitative meta-analytic methods, so it should be read as an expert synthesis rather than a formal systematic review.

Chemical classification: Nichols organises classical hallucinogens into two broad chemical families, the tryptamines (including DMT and psilocin, plus the ergoline subclass represented by LSD) and the phenethylamines (prototype mescaline and substituted amphetamine derivatives such as DOM). He emphasises differences in conformational flexibility between simple tryptamines and rigid ergolines. Serotonergic involvement and historical observations: Early work linked LSD and serotonin because of structural similarities and pharmacological interactions. Although initial ideas proposed that LSD acted as a serotonin antagonist, subsequent data showed that many hallucinogens increase brain 5-HT levels or decrease serotonin turnover, and that some compounds behave as direct agonists at central 5-HT receptors rather than simple antagonists. Presynaptic (raphe) hypothesis: Electrophysiological studies showed that LSD and several tryptamine hallucinogens suppress firing of dorsal raphe serotonin neurons, an effect mediated by 5-HT1A somatodendritic autoreceptors. However, the presynaptic inhibition hypothesis was weakened because phenethylamine hallucinogens (for example mescaline, DOM) did not suppress raphe firing, non‑hallucinogenic ergolines also suppress raphe firing, and some selective 5-HT1A agonists that inhibit raphe firing are not hallucinogenic. Thus, raphe suppression alone does not account for hallucinogenic effects across chemical classes. Strong evidence for 5-HT2A agonism: Behavioural pharmacology, especially rat two‑lever drug discrimination studies, provides convergent evidence that activation of the 5-HT2A receptor subtype is the principal mediator of the interoceptive cue of many hallucinogens. Antagonists selective for 5-HT2A (for example MDL 100,907) block discriminative stimulus effects and the DOI-induced rat head-twitch response, whereas selective 5-HT2C antagonists generally do not. Antagonist correlation analyses showed that the potency of varied 5-HT2A/2C antagonists to block DOM’s discriminative cue correlated with their affinity at 5-HT2A sites but not 5-HT2C sites. Nichols reports specific data such as DOTFM having Ki = 1.5 nM at a DOI-labelled 5-HT2A/2C site and being a full agonist at cloned 5-HT2A/2C receptors. Role of 5-HT2C: Although 5-HT2A agonism appears central in rats, Nichols presents evidence that 5-HT2C activation may also contribute to hallucinogenic intoxication. Non-hallucinogenic analogues such as 2-bromo-LSD (BOL) and lisuride lack 5-HT2C agonist activity despite interacting with other serotonergic sites. Experimental manipulations that deplete serotonin (p‑chlorophenylalanine, PCPA) increase sensitivity to LSD’s stimulus effects and raise maximal phosphoinositide hydrolysis mediated by 5-HT2C receptors by 46%, suggesting a role for 5-HT2C in modulating hallucinogen responsiveness. 5-HT1A involvement and interactions between receptor subtypes: Nichols summarises that many tryptamine hallucinogens (LSD, DMT, 5‑methoxy‑DMT, psilocin) have appreciable affinity and agonist efficacy at 5-HT1A receptors and that this activity can inhibit raphe firing via autoreceptors. He notes functional interactions in which 5-HT1A agonists can attenuate 5-HT2A-mediated behaviours (for example 8-OH-DPAT reduces DOI-induced head-twitch); conversely, 5-HT2 antagonists may enhance some 5-HT1A-mediated effects. These interactions complicate attribution of subjective effects to a single receptor subtype and may contribute to qualitative differences between tryptamines and phenethylamines—for instance, tryptamines are often associated with vivid visual imagery and have higher 5-HT1A affinity in some cases. Tolerance and receptor regulation: Rapid tolerance to hallucinogens in humans (loss of sensitivity within days) is paralleled in animal studies by rapid desensitisation and downregulation of central 5-HT2 receptors. Nichols reports that repeated DOM treatment (2.5 mg/kg s.c. every 8 h) produced a significant reduction in cortical 5-HT2 sites after two treatments, with receptor numbers recovering slowly (reported t1/2 ≈ 5 days). Species differences and receptor mutagenesis: Evidence from receptor mutagenesis identifies a single amino acid residue in transmembrane helix V (Ser242 in human versus Ala242 in rat 5-HT2A receptors) that alters ligand affinities and may explain differing structure–activity relationships across species. Examples include differential affinities of ergolines and tryptamines, and psilocin showing ≈15-fold higher affinity at the human receptor compared with the rat receptor. Nichols cautions that these molecular differences limit the certainty with which rodent data predict human pharmacology. Potentiation by other receptor interactions and LSD’s uniqueness: Nichols emphasises that LSD binds many other monoaminergic receptors with high affinity (including 5-HT1A, 5-HT2A/2C, 5-HT6/7, dopamine D2 and D1, and alpha‑adrenergic sites). He presents data suggesting LSD’s high behavioural potency relative to phenethylamines may reflect synergistic interactions at additional sites, notably dopamine D2 receptors (reported Ki ≈ 6.4 nM) and possibly alpha2-adrenoceptor modulation; risperidone (a mixed 5-HT2/D2 antagonist) was reported to be more potent than a pure 5-HT2 antagonist in blocking LSD’s discriminative cue, consistent with a catecholaminergic component.

Nichols interprets the assembled evidence to conclude that agonism at serotonin 5-HT2A receptors represents the most compelling and consistent mechanism underlying the distinctive pharmacology of classical hallucinogens in animal models, particularly in rats. He allows, however, that 5-HT2A activation may be necessary but not always sufficient for full hallucinogenic effects, and that concurrent stimulation of 5-HT2C receptors could be required in some cases. He positions these conclusions relative to earlier hypotheses by noting that presynaptic inhibition of raphe firing (mediated by 5-HT1A autoreceptors) explained some observations, especially for tryptamines, but failed to account for phenethylamine-class drugs and non-hallucinogenic compounds that share raphe-suppressing properties. Nichols therefore presents a more nuanced view in which different chemical classes evoke overlapping but distinct receptor interaction profiles: tryptamines commonly engage 5-HT1A as well as 5-HT2A/2C sites, which may contribute to qualitative differences such as enhanced visual imagery. Key limitations are acknowledged: the preponderance of evidence is derived from animal and in vitro studies, with limited and largely historical human pharmacology data; species differences at the molecular level (for example Ser242/Ala242 in 5-HT2A) complicate extrapolation to humans; and there is a shortage of highly selective ligands for some receptor subtypes (notably 5-HT2C) that would permit definitive tests in vivo. Nichols also notes that legal and regulatory barriers have constrained clinical research, limiting direct human experimental evidence. For future directions, the author suggests that resolving which receptor interactions are sufficient for human hallucinogenic experience will require more clinical studies and the use of selective pharmacological tools. He highlights the potential relevance of hallucinogen pharmacology to understanding psychiatric disorders—particularly given possible interactions between 5-HT2A and dopamine D2 systems—and calls for renewed human research to clarify therapeutic or mechanistic implications. Nichols emphasises that LSD’s multi-receptor pharmacology likely underpins its exceptional potency and distinctive subjective effects, and that integrated study of serotonergic and dopaminergic interactions is a promising avenue.

Nichols concludes that, on the balance of available data, agonist action at serotonin 5-HT2A receptors constitutes the dominant pharmacological correlate of hallucinogen effects in animal models. He adds that 5-HT2C activation may also contribute and that tryptamine compounds frequently engage 5-HT1A receptors, which could underlie qualitative differences among classes. The exceptional potency and uniqueness of LSD likely reflect its high affinity across multiple monoamine receptors, including dopamine D2, producing synergistic effects. Finally, Nichols stresses the limitations imposed by species differences and restricted human data, and he advocates for expanded clinical research to better understand the human pharmacology and possible therapeutic relevance of these compounds.