5D Library › Biomathematical Models of Sub-Perceptual Tryptamine Pharmacokinetics, 5-HT2A Receptor Desensitisation and Neuroplastic Window Dynamics · 中文

Chapter 5. Connectivity Entropy: Indistinguishable from Noise

The entropic brain

Evidence

The entropic brain (theory and imaging). In 2014 Carhart-Harris and colleagues proposed the “entropic brain” hypothesis: that conscious states can be characterised by the level of some entropy of brain activity, and that psychedelics push the system toward a higher-entropy state (Carhart-Harris et al. 2014); the 2018 revision collects subsequent evidence and criticism (Carhart-Harris 2018). Associated imaging results include Daws and colleagues’ report of increased global integration after psilocybin therapy for depression (Daws et al. 2022). Volume 8, Chapter 3 discussed this hypothesis and its limits and is not repeated here.

This chapter handles one narrow methodological question: if someone measures “the entropy of whole-brain functional connectivity” and reports that it rose, what can that measurement support?

Entropy in a Gaussian graphical model

For a multivariate Gaussian the differential entropy is H=12logdet(2πeΣ)H = \tfrac12\log\det(2\pi e\,\Sigma), so for a correlation matrix entropy is determined entirely by logdet\log\det. That makes the problem exactly tractable.

Calculation

# Chapter 5. "Entropy of whole-brain functional connectivity", and what it
# measures. For a multivariate Gaussian the differential entropy is
#   H = 0.5 log det(2 pi e Sigma)
# so for a correlation matrix the only thing entropy depends on is log det.
# The program builds a schematic correlation matrix with a single global
# factor of loading g plus independent noise, and shows that entropy rises
# monotonically as g falls. Then it shows that TWO quite different things
# lower g: a genuine reduction in global coupling, and added independent
# measurement noise (head motion, physiological noise, a shorter window). Both
# raise the entropy by the same amount, and no entropy value distinguishes
# them. Exact linear algebra, no simulation; dimensionless.
import math

P = 20                      # number of regions

def corr_from_factor(g, noise=0.0):
    """One global factor with loading g, plus independent noise of variance
    `noise`."""
    out = []
    for i in range(P):
        row = []
        for j in range(P):
            if i == j:
                row.append(1.0)
            else:
                row.append(g * g / (1.0 + noise))
        out.append(row)
    return out

def logdet(M):
    """Cholesky; M must be symmetric positive definite."""
    n = len(M)
    L = [[0.0] * n for _ in range(n)]
    for i in range(n):
        for j in range(i + 1):
            s = M[i][j] - math.fsum(L[i][k] * L[j][k] for k in range(j))
            if i == j:
                if s <= 0:
                    return float("-inf")
                L[i][i] = math.sqrt(s)
            else:
                L[i][j] = s / L[j][j]
    return 2.0 * math.fsum(math.log(L[i][i]) for i in range(n))

def entropy_bits(M):
    """Entropy of the standardised multivariate Gaussian, relative to
    independence."""
    return logdet(M) / (2.0 * math.log(2.0))

if __name__ == "__main__":
    print(
        "{} regions, one global factor of loading g. Entropy is reported"
        " relative to".format(P)
    )
    print("the independent case (g = 0), in bits; 0 is the maximum.\n")
    print("   g      mean off-diagonal r   relative entropy (bits)")
    for g in (0.0, 0.2, 0.4, 0.6, 0.8, 0.9):
        M = corr_from_factor(g)
        print(
            "   {:5.2f} {:21.4f} {:24.3f}".format(g, g * g, entropy_bits(M))
        )

    print(
        "\nEntropy rises as coupling falls, which is the result the"
        " entropic-brain"
    )
    print(
        "literature reports as an 'increase in entropy'. Now the confound."
        " Adding"
    )
    print("independent noise of variance v to every channel attenuates every")
    print("correlation by 1/(1+v) and so raises entropy too:")
    print(
        "\n   true g   added noise v   observed mean r   relative entropy"
        " (bits)"
    )
    rows = []
    for g, v in ((0.8, 0.0), (0.8, 0.25), (0.8, 0.78), (0.6, 0.0)):
        M = corr_from_factor(g, v)
        rows.append((g, v, g * g / (1 + v), entropy_bits(M)))
        print("   {:6.3f} {:15.2f} {:17.4f} {:24.3f}".format(*rows[-1]))

    print(
        "\n   Compare the last two rows. True coupling 0.8 with added"
        " noise, and"
    )
    print(
        "   genuinely weaker coupling 0.6 with no noise, give observed"
        " correlations"
    )
    print(
        "   of {:.4f} and {:.4f} and entropies of {:.3f} and {:.3f} bits: the"
        " same".format(rows[2][2], rows[3][2], rows[2][3], rows[3][3])
    )
    print(
        "   measurement to within {:.3f} bits, from two completely different"
        " states".format(abs(rows[2][3] - rows[3][3]))
    )
    print(
        "   of the brain. An entropy increase is therefore not evidence of a"
        " change"
    )
    print(
        "   in coupling unless the noise is shown not to have changed - and"
        " head"
    )
    print("   motion, breathing and heart rate all change with a drug.")

    print(
        "\nHow much noise would be needed to fake a given entropy rise,"
        " starting"
    )
    print("from true coupling g = 0.8?")
    base = entropy_bits(corr_from_factor(0.8))
    print("   target entropy rise (bits)   required added noise v")
    need = {}
    for target in (0.5, 1.0, 2.0, 4.0):
        lo, hi = 0.0, 50.0
        for _ in range(60):
            mid = 0.5 * (lo + hi)
            if entropy_bits(corr_from_factor(0.8, mid)) - base < target:
                lo = mid
            else:
                hi = mid
        need[target] = hi
        print("   {:26.1f} {:22.3f}".format(target, hi))
    print(
        "\n   A rise of 1 bit across {} regions needs added noise of only"
        " {:.1%} of".format(P, need[1.0])
    )
    print(
        "   the signal variance, and 4 bits needs {:.0%} - both well inside"
        " the range".format(need[4.0])
    )
    print(
        "   that a change in head motion or physiological noise can"
        " produce. The"
    )
    print(
        "   measure is far more sensitive to nuisance variance than its use"
        " as a"
    )
    print(
        "   marker of 'brain entropy' implies. This is why Chapter 5 asks for"
        " motion"
    )
    print(
        "   and physiological regressors, a matched-length window and a"
        " pre-specified"
    )
    print(
        "   estimator, and treats any connectivity entropy as exploratory"
        " only."
    )
# 20 regions, one global factor of loading g. Entropy is reported relative to
# the independent case (g = 0), in bits; 0 is the maximum.
#
#    g      mean off-diagonal r   relative entropy (bits)
#     0.00                0.0000                    0.000
#     0.20                0.0400                   -0.152
#     0.40                0.1600                   -1.382
#     0.60                0.3600                   -4.631
#     0.80                0.6400                  -12.143
#     0.90                0.8100                  -20.744
#
# Entropy rises as coupling falls, which is the result the entropic-brain
# literature reports as an 'increase in entropy'. Now the confound. Adding
# independent noise of variance v to every channel attenuates every
# correlation by 1/(1+v) and so raises entropy too:
#
#    true g   added noise v   observed mean r   relative entropy (bits)
#     0.800            0.00            0.6400                  -12.143
#     0.800            0.25            0.5120                   -8.121
#     0.800            0.78            0.3596                   -4.622
#     0.600            0.00            0.3600                   -4.631
#
#    Compare the last two rows. True coupling 0.8 with added noise, and
#    genuinely weaker coupling 0.6 with no noise, give observed correlations
#    of 0.3596 and 0.3600 and entropies of -4.622 and -4.631 bits: the same
#    measurement to within 0.009 bits, from two completely different states
#    of the brain. An entropy increase is therefore not evidence of a change
#    in coupling unless the noise is shown not to have changed - and head
#    motion, breathing and heart rate all change with a drug.
#
# How much noise would be needed to fake a given entropy rise, starting
# from true coupling g = 0.8?
#    target entropy rise (bits)   required added noise v
#                           0.5                  0.022
#                           1.0                  0.046
#                           2.0                  0.101
#                           4.0                  0.248
#
#    A rise of 1 bit across 20 regions needs added noise of only 4.6% of
#    the signal variance, and 4 bits needs 25% - both well inside the range
#    that a change in head motion or physiological noise can produce. The
#    measure is far more sensitive to nuisance variance than its use as a
#    marker of 'brain entropy' implies. This is why Chapter 5 asks for motion
#    and physiological regressors, a matched-length window and a pre-specified
#    estimator, and treats any connectivity entropy as exploratory only.

The first table gives the expected direction: weaker coupling, higher entropy. That is the quantity reported in the literature as “an increase in entropy”.

The second table is the point of the chapter. Adding independent noise to every channel attenuates every correlation and so also raises entropy. So true coupling 0.8 with noise and true coupling 0.6 without give the same observed correlations (0.3596 against 0.3600) and the same entropy, differing by 0.009 bits. Two entirely different brain states, one measured value.

And the amount of noise required is small: the program’s last section shows that raising entropy by 1 bit across 20 regions needs only about 4.6 % added noise variance, and 4 bits about 25 %.

Evidence

Head motion produces systematic connectivity artefacts. Power and colleagues demonstrated that participant motion produces spurious but systematic correlations in functional connectivity, and that these artefacts are not random — they raise correlations at short distances and lower them at long distances (Power et al. 2012). How to regress confounds is itself a benchmarked research question, and Ciric and colleagues compared many strategies systematically and found none that removes the artefact completely (Ciric et al. 2017).

Putting these together gives the chapter’s conclusion:

“connectivity entropy rose” is not evidence of a change in brain coupling unless the noise is shown not to have changed. And head motion, breathing and heart rate all change with a drug.

Left: relative entropy in a Gaussian graphical model against global coupling g (20 regions). Right: true coupling 0.8 with independent noise (filled point) and true coupling 0.6 with no noise (open point) land in the same place: the same observed correlations and the same entropy, from two different states.

Estimator bias

The second problem is mathematically the same as the imagery-stream entropy of Volume 53, Chapter 3: entropy estimates on short sequences — here short windows — carry a systematic bias.

Calculation

# Chapter 5. The other half of the entropy problem: the estimator.
# Correlations estimated from a window of T samples are noisy, and the noise
# inflates log det downward (toward apparent lower entropy) or upward
# depending on the regime, so the measured "entropy" depends on scan length.
# The program estimates the correlation matrix of a P-region Gaussian from
# windows of several lengths and reports the bias, then shows the matched-
# length comparison that removes it. Synthetic data; fixed seed; standard
# library only.
import math
import random

P, G_TRUE = 12, 0.7

def sample_window(T, g, rng):
    """T samples of P regions with one global factor of loading g."""
    cols = [[0.0] * T for _ in range(P)]
    for t in range(T):
        f = rng.gauss(0.0, 1.0)
        for i in range(P):
            cols[i][t] = g * f + math.sqrt(1.0 - g * g) * rng.gauss(0.0, 1.0)
    return cols

def corr(cols):
    T = len(cols[0])
    means = [math.fsum(c) / T for c in cols]
    sds = [math.sqrt(math.fsum((v - m) ** 2 for v in c) / (T - 1))
           for c, m in zip(cols, means)]
    M = [[0.0] * P for _ in range(P)]
    for i in range(P):
        for j in range(P):
            if i == j:
                M[i][j] = 1.0
            else:
                cov = math.fsum(
                    (cols[i][t] - means[i]) * (cols[j][t] - means[j])
                    for t in range(len(cols[0]))
                ) / (T - 1)
                M[i][j] = cov / (sds[i] * sds[j])
    return M

def logdet(M):
    n = len(M)
    L = [[0.0] * n for _ in range(n)]
    for i in range(n):
        for j in range(i + 1):
            s = M[i][j] - math.fsum(L[i][k] * L[j][k] for k in range(j))
            if i == j:
                if s <= 0:
                    return float("-inf")
                L[i][i] = math.sqrt(s)
            else:
                L[i][j] = s / L[j][j]
    return 2.0 * math.fsum(math.log(L[i][i]) for i in range(n))

def ent(M):
    return logdet(M) / (2.0 * math.log(2.0))

def truth(g):
    M = [[1.0 if i == j else g * g for j in range(P)] for i in range(P)]
    return ent(M)

if __name__ == "__main__":
    rng = random.Random(5209)
    t0 = truth(G_TRUE)
    print(
        "{} regions, true global loading {:.1f}; true relative entropy {:.3f}"
        " bits.".format(P, G_TRUE, t0)
    )
    print(
        "\n   window T   mean estimated entropy (bits)   bias     s.d. over"
        " runs"
    )
    for T in (30, 60, 120, 300, 1200):
        vals = [ent(corr(sample_window(T, G_TRUE, rng))) for _ in range(120)]
        m = math.fsum(vals) / len(vals)
        sd = math.sqrt(
            math.fsum((v - m) ** 2 for v in vals) / (len(vals) - 1)
        )
        print("   {:8d} {:30.3f} {:+8.3f} {:16.3f}".format(T, m, m - t0, sd))

    print(
        "\nShorter windows give systematically HIGHER entropy estimates:"
        " sampling"
    )
    print(
        "noise pushes the estimated correlations toward zero, which is"
        " exactly what"
    )
    print(
        "a genuine decoupling would do. The bias at T = 30 is larger than the"
        " whole"
    )
    print("difference between two quite different coupling strengths:")
    print(
        "   true g = 0.7 -> {:.3f} bits; true g = 0.5 -> {:.3f} bits;"
        "\n   difference {:.3f}".format(
            truth(0.7), truth(0.5), truth(0.5) - truth(0.7)
        )
    )

    print(
        "\nThe fix is not a better estimator but a matched design."
        " Comparing two"
    )
    print("conditions using windows of the SAME length cancels the bias:")
    print(
        "   T      E[entropy | g=0.7]   E[entropy | g=0.5]   difference  "
        " truth"
    )
    for T in (30, 60, 120, 300):
        a = [ent(corr(sample_window(T, 0.7, rng))) for _ in range(120)]
        b = [ent(corr(sample_window(T, 0.5, rng))) for _ in range(120)]
        ma = math.fsum(a) / len(a)
        mb = math.fsum(b) / len(b)
        print("   {:5d} {:20.3f} {:20.3f} {:12.3f} {:7.3f}"
              .format(T, ma, mb, mb - ma, truth(0.5) - truth(0.7)))

    print(
        "\n   The estimated DIFFERENCE is close to the truth at every window"
        " length,"
    )
    print(
        "   even where each estimate separately is badly biased. So a"
        " connectivity-"
    )
    print(
        "   entropy comparison is usable if and only if the windows are"
        " matched in"
    )
    print(
        "   length and the data are matched in quality; an entropy value"
        " reported on"
    )
    print(
        "   its own, or compared across scans of different length or"
        " different"
    )
    print("   motion, carries a bias of the same size as the effect.")
# 12 regions, true global loading 0.7; true relative entropy -4.005 bits.
#
#    window T   mean estimated entropy (bits)   bias     s.d. over runs
#          30                         -5.983   -1.978            1.191
#          60                         -4.853   -0.848            0.699
#         120                         -4.362   -0.357            0.493
#         300                         -4.197   -0.192            0.317
#        1200                         -4.069   -0.064            0.171
#
# Shorter windows give systematically HIGHER entropy estimates: sampling
# noise pushes the estimated correlations toward zero, which is exactly what
# a genuine decoupling would do. The bias at T = 30 is larger than the whole
# difference between two quite different coupling strengths:
#    true g = 0.7 -> -4.005 bits; true g = 0.5 -> -1.329 bits;
#    difference 2.676
#
# The fix is not a better estimator but a matched design. Comparing two
# conditions using windows of the SAME length cancels the bias:
#    T      E[entropy | g=0.7]   E[entropy | g=0.5]   difference   truth
#       30               -6.119               -3.354        2.765   2.676
#       60               -4.747               -2.248        2.499   2.676
#      120               -4.409               -1.779        2.630   2.676
#      300               -4.195               -1.477        2.718   2.676
#
#    The estimated DIFFERENCE is close to the truth at every window length,
#    even where each estimate separately is badly biased. So a connectivity-
#    entropy comparison is usable if and only if the windows are matched in
#    length and the data are matched in quality; an entropy value reported on
#    its own, or compared across scans of different length or different
#    motion, carries a bias of the same size as the effect.

The magnitudes are worth recording: with 12 regions and a window of 30 time points the bias is −1.978-1.978 bits, while the difference between true couplings of 0.7 and 0.5 is 2.676 bits. Bias and effect are the same size. Paninski analysed the properties of entropy estimators systematically (Paninski 2003).

But the program’s second table supplies a remedy, and it is a design remedy rather than a statistical one: comparing two conditions with windows of the same length largely cancels the bias. The estimated difference is close to the truth at every window length (2.765, 2.499, 2.630, 2.718, against a truth of 2.676), even where each estimate separately is badly biased.

Note

Consequences for Chapter 8. Connectivity-entropy measures are exploratory outcomes only in Chapter 8, with three requirements: (i) the window lengths for the two conditions must be identical and the scan length fixed in the protocol; (ii) motion indices must be reported and regressed as confounds, with the strategy chosen from existing benchmark work (Power et al. 2012; Ciric et al. 2017); and (iii) the estimator must be pre-specified in the protocol. Even so, such a measure cannot on its own support any conclusion about “brain entropy”.

Hypothesis · not established

The author’s hypothesis (not established): after matching window lengths and including motion and physiological noise as covariates, sub-perceptual exposure produces no change in functional connectivity entropy beyond measurement variability. What would show it to be wrong: in a pre-registered double-blind crossover study with the length-matched entropy difference as a pre-specified outcome, finding that the 95 % confidence interval for the active condition relative to placebo excludes zero, that it still excludes zero after adding motion and physiological covariates, and replicating that in an independent sample.

Summary

The entropic-brain hypothesis and its associated imaging results are central to this field. This chapter handles only the measurement question and reaches two results. First, in a Gaussian graphical model an “increase in entropy” is indistinguishable from an increase in noise: true coupling 0.8 with noise and true coupling 0.6 without give the same observed correlations and the same entropy (differing by 0.009 bits), while raising entropy by 1 bit across 20 regions needs only about 4.6 % added noise variance; head motion is known to produce systematic connectivity artefacts, and no confound-regression strategy removes them completely. Second, short-window entropy estimates are systematically biased: with 12 regions and 30 time points the bias is −1.978-1.978 bits against a true difference of 2.676 bits between two quite different coupling strengths. The remedy is a design one: a difference between length-matched windows is close to the truth at every length. Chapter 8 therefore treats connectivity-entropy measures as exploratory outcomes with three stated requirements.

References

Carhart-Harris, Robin L. 2018. “The Entropic Brain — Revisited.” Neuropharmacology 142: 167–78. https://doi.org/10.1016/j.neuropharm.2018.03.010.
Carhart-Harris, Robin L., Robert Leech, Peter J. Hellyer, Murray Shanahan, Amanda Feilding, Enzo Tagliazucchi, Dante R. Chialvo, and David Nutt. 2014. “The Entropic Brain: A Theory of Conscious States Informed by Neuroimaging Research with Psychedelic Drugs.” Frontiers in Human Neuroscience 8: 20. https://doi.org/10.3389/fnhum.2014.00020.
Ciric, Rastko, Daniel H. Wolf, Jonathan D. Power, David R. Roalf, Graham L. Baum, Kosha Ruparel, Russell T. Shinohara, et al. 2017. “Benchmarking of Participant-Level Confound Regression Strategies for the Control of Motion Artifact in Studies of Functional Connectivity.” NeuroImage 154: 174–87. https://doi.org/10.1016/j.neuroimage.2017.03.020.
Daws, Richard E., Christopher Timmermann, Bruna Giribaldi, James D. Sexton, Matthew B. Wall, David Erritzoe, Leor Roseman, David Nutt, and Robin Carhart-Harris. 2022. “Increased Global Integration in the Brain After Psilocybin Therapy for Depression.” Nature Medicine 28: 844–51. https://doi.org/10.1038/s41591-022-01744-z.
Paninski, Liam. 2003. “Estimation of Entropy and Mutual Information.” Neural Computation 15 (6): 1191–1253. https://doi.org/10.1162/089976603321780272.
Power, Jonathan D., Kelly A. Barnes, Abraham Z. Snyder, Bradley L. Schlaggar, and Steven E. Petersen. 2012. “Spurious but Systematic Correlations in Functional Connectivity MRI Networks Arise from Subject Motion.” NeuroImage 59 (3): 2142–54. https://doi.org/10.1016/j.neuroimage.2011.10.018.

Fan, Y. (2026). Biomathematical Models of Sub-Perceptual Tryptamine Pharmacokinetics, 5-HT2A Receptor Desensitisation and Neuroplastic Window Dynamics: From Michaelis–Menten Kinetics of Prodrug Deacetylation and Whole-Brain Connectivity Entropy to the Microdose Tolerance Ratchet, with a Textual Examination of the Dose Boundary in the Classical Materia Medica [亚知觉色胺药代动力学、5-HT2A 受体脱敏与神经可塑性窗口的生物数学模型] (Version 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.24019347 · Licensed under Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0).