information decomposition

信息分解
  • 文章类型: Journal Article
    人类前额叶和岛屿区域如何相互作用,同时最大化奖励和最小化惩罚是未知的。利用人类颅内记录,我们证明,与局部表征相比,对奖励或惩罚学习的功能特异性通过相互作用更好地解开。前额叶和岛状皮质显示非选择性神经群体的奖励和惩罚。非选择性反应,然而,产生特定于上下文的区域间互动。我们确定了一个奖励子系统,在眶额叶和腹内侧前额皮质之间具有冗余的相互作用,具有后者的驱动作用。此外,我们发现了一个惩罚子系统,在岛状和背外侧皮层之间有多余的相互作用,具有脑岛的驱动作用。最后,奖惩学习之间的转换是由两个子系统之间的协同相互作用介导的。这些结果为支持奖励和惩罚学习的分布式皮层表示和交互提供了统一的解释。
    How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    了解不同网络之间的关系是理解复杂系统的关键。我们引入了一个直观而强大的框架,以解开网络可以彼此相似和互补的不同方式。我们分解由一个源网络唯一贡献的节点之间的最短路径,或者冗余地,或两者协同作用。我们的方法考虑了网络的完整拓扑,在多个分辨率级别提供见解:从全球统计到单个路径。我们的框架广泛适用于整个科学领域,从公共交通到大脑网络。在人类和其他124个物种中,我们证明了长程白质纤维在结构性脑网络中的独特贡献的普遍性.跨物种,有效的通信还依赖于远程和短程光纤之间比偶然预期的更大的协同作用。我们的框架可以找到用于设计网络系统或评估现有网络系统的应用程序。
    Understanding how different networks relate to each other is key for understanding complex systems. We introduce an intuitive yet powerful framework to disentangle different ways in which networks can be (dis)similar and complementary to each other. We decompose the shortest paths between nodes as uniquely contributed by one source network, or redundantly by either, or synergistically by both together. Our approach considers the networks\' full topology, providing insights at multiple levels of resolution: from global statistics to individual paths. Our framework is widely applicable across scientific domains, from public transport to brain networks. In humans and 124 other species, we demonstrate the prevalence of unique contributions by long-range white-matter fibers in structural brain networks. Across species, efficient communication also relies on significantly greater synergy between long-range and short-range fibers than expected by chance. Our framework could find applications for designing network systems or evaluating existing ones.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    人们普遍认为,高水平的大脑功能来自多个神经系统的协调活动。然而,缺乏对实验数据出现的正式定义和实际量化,神经科学家一直无法对这一长期存在的猜想进行实证检验。在这里,我们通过利用最近提出的称为“综合信息分解”的框架来研究这个基本问题,它建立了一种原则性的信息理论方法来操作和量化动力系统中的出现——包括人脑。通过分析功能性MRI数据,我们的研究结果表明,在患有严重脑损伤的慢性无反应患者中,神经动力学的突发性和分级性显著降低。在功能层面,我们证明,出现能力与大脑活动的分层组织程度呈正相关。此外,通过结合网络控制理论和全脑生物物理建模的计算方法,我们表明,严重脑损伤患者的紧急和分级动力学能力的降低可以通过患者结构连接体的破坏从机制上解释。总的来说,我们的结果表明,严重脑损伤导致的慢性无反应性可能是由于脑动力学支持出现所需的基本神经基础设施的结构性损伤.
    High-level brain functions are widely believed to emerge from the orchestrated activity of multiple neural systems. However, lacking a formal definition and practical quantification of emergence for experimental data, neuroscientists have been unable to empirically test this long-standing conjecture. Here we investigate this fundamental question by leveraging a recently proposed framework known as \"Integrated Information Decomposition,\" which establishes a principled information-theoretic approach to operationalise and quantify emergence in dynamical systems - including the human brain. By analysing functional MRI data, our results show that the emergent and hierarchical character of neural dynamics is significantly diminished in chronically unresponsive patients suffering from severe brain injury. At a functional level, we demonstrate that emergence capacity is positively correlated with the extent of hierarchical organisation in brain activity. Furthermore, by combining computational approaches from network control theory and whole-brain biophysical modelling, we show that the reduced capacity for emergent and hierarchical dynamics in severely brain-injured patients can be mechanistically explained by disruptions in the patients\' structural connectome. Overall, our results suggest that chronic unresponsiveness resulting from severe brain injury may be related to structural impairment of the fundamental neural infrastructures required for brain dynamics to support emergence.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    涌现是一个深奥的课题,跨越了许多科学学科,包括星系的形成以及意识是如何从神经元的集体活动中产生的。尽管人们对这个概念有广泛的兴趣,对涌现的研究缺乏可用于指导讨论和推进理论的形式主义。这里,我们总结一下,详细说明,并扩展了基于信息分解的因果出现的最新形式理论,这是可以量化的,也是可以接受实证检验的。该理论将出现与有关系统时间演变的信息联系起来,这些信息不能分别从系统的各个部分获得。本文提供了一个可访问但严格的框架介绍,讨论该方法在各种感兴趣的情况下的优点。我们还讨论了几个解释问题和潜在的误解,同时突出了这种形式主义的独特好处。本文是“复杂的物理和社会技术系统中的新兴现象:从细胞到社会”主题的一部分。
    Emergence is a profound subject that straddles many scientific disciplines, including the formation of galaxies and how consciousness arises from the collective activity of neurons. Despite the broad interest that exists on this concept, the study of emergence has suffered from a lack of formalisms that could be used to guide discussions and advance theories. Here, we summarize, elaborate on, and extend a recent formal theory of causal emergence based on information decomposition, which is quantifiable and amenable to empirical testing. This theory relates emergence with information about a system\'s temporal evolution that cannot be obtained from the parts of the system separately. This article provides an accessible but rigorous introduction to the framework, discussing the merits of the approach in various scenarios of interest. We also discuss several interpretation issues and potential misunderstandings, while highlighting the distinctive benefits of this formalism. This article is part of the theme issue \'Emergent phenomena in complex physical and socio-technical systems: from cells to societies\'.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    神经科学中的一个中心问题涉及意识与其物理底物之间的关系。这里,我们认为,通过将意识视为由不同的信息理论元素组成,可以获得更丰富的意识特征。换句话说,我们建议从意识的量化-被视为整合的信息-转变为其分解。通过这种方法,称为集成信息分解(ΦID),我们提出了一个正式的论点,即给定系统的意识是否是一种新兴现象,取决于其信息理论的组成,为长期以来关于意识与出现之间关系的争论提供了原则性的答案。此外,我们表明两种生物可以获得相同数量的综合信息,但它们的信息理论组成不同。基于ΦID对综合信息的修订理解,称为ΦR,我们还引入了ΦR-ing比率的概念,以量化实体使用信息进行有意识处理的效率。ΦR和ΦR-ing比率的组合可能提供一种重要的方法来比较意识不同方面的神经基础。意识的分解使我们能够识别质量上不同的“意识模式”,建立一个共同的空间来映射不同意识状态的现象学。我们概述了在现象学和信息理论模式之间进行这种映射的理论和经验途径,从日常意识的中心特征开始:自我。总的来说,ΦID产生了丰富的探索信息之间关系的新途径,意识,以及它从神经动力学中的出现。
    A central question in neuroscience concerns the relationship between consciousness and its physical substrate. Here, we argue that a richer characterization of consciousness can be obtained by viewing it as constituted of distinct information-theoretic elements. In other words, we propose a shift from quantification of consciousness-viewed as integrated information-to its decomposition. Through this approach, termed Integrated Information Decomposition (ΦID), we lay out a formal argument that whether the consciousness of a given system is an emergent phenomenon depends on its information-theoretic composition-providing a principled answer to the long-standing dispute on the relationship between consciousness and emergence. Furthermore, we show that two organisms may attain the same amount of integrated information, yet differ in their information-theoretic composition. Building on ΦID\'s revised understanding of integrated information, termed ΦR, we also introduce the notion of ΦR-ing ratio to quantify how efficiently an entity uses information for conscious processing. A combination of ΦR and ΦR-ing ratio may provide an important way to compare the neural basis of different aspects of consciousness. Decomposition of consciousness enables us to identify qualitatively different \'modes of consciousness\', establishing a common space for mapping the phenomenology of different conscious states. We outline both theoretical and empirical avenues to carry out such mapping between phenomenology and information-theoretic modes, starting from a central feature of everyday consciousness: selfhood. Overall, ΦID yields rich new ways to explore the relationship between information, consciousness, and its emergence from neural dynamics.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    If regularity in data takes the form of higher-order functions among groups of variables, models which are biased towards lower-order functions may easily mistake the data for noise. To distinguish whether this is the case, one must be able to quantify the contribution of different orders of dependence to the total information. Recent work in information theory attempts to do this through measures of multivariate mutual information (MMI) and information decomposition (ID). Despite substantial theoretical progress, practical issues related to tractability and learnability of higher-order functions are still largely unaddressed. In this work, we introduce a new approach to information decomposition-termed Neural Information Decomposition (NID)-which is both theoretically grounded, and can be efficiently estimated in practice using neural networks. We show on synthetic data that NID can learn to distinguish higher-order functions from noise, while many unsupervised probability models cannot. Additionally, we demonstrate the usefulness of this framework as a tool for exploring biological and artificial neural networks.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    一对随机变量的熵通常使用维恩图来描述。这种说法可能会误导,然而,因为多元互信息可能是负的。本文提出了多变量信息内容的新度量,可以使用维恩图对任意数量的随机变量进行准确描述。这些度量补充了现有的多元互信息度量,并通过考虑信息共享的代数结构来构造。表明,一组边缘观察者可以与非观察第三方共享其信息的不同方式对应于自由分布晶格的元素。然后,通过组合联合和共享信息内容的代数结构,可以随后并独立地得出来自部分信息分解的冗余格。
    The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of multivariate information content that can be accurately depicted using Venn diagrams for any number of random variables. These measures complement the existing measures of multivariate mutual information and are constructed by considering the algebraic structure of information sharing. It is shown that the distinct ways in which a set of marginal observers can share their information with a non-observing third party corresponds to the elements of a free distributive lattice. The redundancy lattice from partial information decomposition is then subsequently and independently derived by combining the algebraic structures of joint and shared information content.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    Heart rate variability (HRV; variability of the RR interval of the electrocardiogram) results from the activity of several coexisting control mechanisms, which involve the influence of respiration (RESP) and systolic blood pressure (SBP) oscillations operating across multiple temporal scales and changing in different physiological states. In this study, multiscale information decomposition is used to dissect the physiological mechanisms related to the genesis of HRV in 78 young volunteers monitored at rest and during postural and mental stress evoked by head-up tilt (HUT) and mental arithmetics (MA). After representing RR, RESP and SBP at different time scales through a recently proposed method based on multivariate state space models, the joint information transfer T RESP , SBP → RR is decomposed into unique, redundant and synergistic components, describing the strength of baroreflex modulation independent of respiration ( U SBP → RR ), nonbaroreflex ( U RESP → RR ) and baroreflex-mediated ( R RESP , SBP → RR ) respiratory influences, and simultaneous presence of baroreflex and nonbaroreflex respiratory influences ( S RESP , SBP → RR ), respectively. We find that fast (short time scale) HRV oscillations-respiratory sinus arrhythmia-originate from the coexistence of baroreflex and nonbaroreflex (central) mechanisms at rest, with a stronger baroreflex involvement during HUT. Focusing on slower HRV oscillations, the baroreflex origin is dominant and MA leads to its higher involvement. Respiration influences independent on baroreflex are present at long time scales, and are enhanced during HUT.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    信息通常被描述为与可能选择的限制相关的不确定性的减少。尽管出现在哈特利的信息论基础工作中,令人惊讶的是,在排除方面缺乏对这种解释的正式处理。本文通过在概率质量排除方面提供明确的信息特征来解决这一差距。然后,它证明了不同的排除可以产生相同数量的信息,并讨论了这提供的关于信息如何在随机变量之间共享的见解-在这一领域缺乏进展是阻止我们理解信息如何在复杂系统中分布的关键障碍。本文通过得出可以区分不同排除的互信息的分解来结束;这提供了对定向信息性质的惊人见解。
    Information is often described as a reduction of uncertainty associated with a restriction of possible choices. Despite appearing in Hartley\'s foundational work on information theory, there is a surprising lack of a formal treatment of this interpretation in terms of exclusions. This paper addresses the gap by providing an explicit characterisation of information in terms of probability mass exclusions. It then demonstrates that different exclusions can yield the same amount of information and discusses the insight this provides about how information is shared amongst random variables-lack of progress in this area is a key barrier preventing us from understanding how information is distributed in complex systems. The paper closes by deriving a decomposition of the mutual information which can distinguish between differing exclusions; this provides surprising insight into the nature of directed information.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Editorial
    Williams和Beer在2010年制定的部分信息分解(PID)框架引起了人们对定义冗余(或共享)问题的大量关注,一组源变量提供的关于目标的互信息的独特和协同(或互补)成分。这种关注导致提出了一些措施来捕捉这些概念,对这些措施的理论研究,以及对经验数据(特别是神经科学数据集)的应用。在本期关于熵的“多源相互作用中目标效应的信息分解”的特刊中,我们已经从该领域的许多领先研究小组收集了有关此类信息分解方法的最新工作。我们通过向读者提供以前的信息分解研究的回顾来开始我们的社论,包括拟议的各种措施的概述,它们是如何被解释和应用于实证调查的。然后我们逐一介绍特刊中的文章,将这些条款类似地分类为:i.新措施的建议;ii.对这些方法的性质和解释的理论研究,andiii.这些措施在实证研究中的应用。最后,我们对该领域的未来进行了展望。
    The formulation of the Partial Information Decomposition (PID) framework by Williams and Beer in 2010 attracted a significant amount of attention to the problem of defining redundant (or shared), unique and synergistic (or complementary) components of mutual information that a set of source variables provides about a target. This attention resulted in a number of measures proposed to capture these concepts, theoretical investigations into such measures, and applications to empirical data (in particular to datasets from neuroscience). In this Special Issue on \"Information Decomposition of Target Effects from Multi-Source Interactions\" at Entropy, we have gathered current work on such information decomposition approaches from many of the leading research groups in the field. We begin our editorial by providing the reader with a review of previous information decomposition research, including an overview of the variety of measures proposed, how they have been interpreted and applied to empirical investigations. We then introduce the articles included in the special issue one by one, providing a similar categorisation of these articles into: i. proposals of new measures; ii. theoretical investigations into properties and interpretations of such approaches, and iii. applications of these measures in empirical studies. We finish by providing an outlook on the future of the field.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

公众号