information theory

信息论
  • 文章类型: Journal Article
    在理性的决策过程中,机器人个体间的信息交互是影响系统稳定性的重要因素。我们建立了基于互信息的博弈论模型,以解决由群体机器人之间的差分信息交互引起的分工决策和稳定性问题。首先,利用互信息模型来测量机器人之间的信息交互,并分析其对机器人个体行为的影响。其次,采用古诺模型和斯塔克尔伯格模型,我们对群体机器人受互信息差异影响的不同决策行为进行建模。在博弈过程中,系统在视差互信息值下表现出的复杂的决策动态,随着纳什平衡点的稳定性,被分析。最后,在视差互信息值下模拟博弈模型的动态复杂度:(1)当博弈模型的v1在一定范围内变化时,纳什平衡点失去稳定性,进入混沌状态。(2)随着I(X;Y)的增加,机器人的决策模式逐渐从古诺游戏过渡到斯塔克尔伯格游戏。同时,群体机器人系统对决策参数变化的敏感性降低,降低系统进入混沌状态的可能性。
    In rational decision-making processes, the information interaction among individual robots is a critical factor influencing system stability. We establish a game-theoretic model based on mutual information to address division of labor decision-making and stability issues arising from differential information interaction among swarm robots. Firstly, a mutual information model is employed to measure the information interaction among robots and analyze its influence on the behavior of individual robots. Secondly, employing the Cournot model and the Stackelberg model, we model the diverse decision-making behaviors of swarm robots influenced by discrepancies in mutual information. The intricate decision dynamics exhibited by the system under the disparity mutual information values during the game process, along with the stability of Nash equilibrium points, are analyzed. Finally, dynamic complexity simulations of the game models are simulated under the disparity mutual information values: (1) When ν1 of the game model varies within a certain range, the Nash equilibrium point loses stability and enters a chaotic state. (2) As I(X;Y) increases, the decision-making pattern of robots transitions gradually from the Cournot game to the Stackelberg game. Concurrently, the sensitivity of swarm robotics systems to changes in decision parameter decreases, reducing the likelihood of the system entering a chaotic state.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    最初发展为意识理论,集成信息理论提供了一个数学框架来量化系统和系统中单元子集的因果不可约性。具体来说,机制综合信息量化了一个州中一个单元子集的因果力,也被称为一种机制,不能用它的零件来解释。如果该机制的因果力可以用其各个部分来充分解释,它是可还原的,其综合信息为零。这里,我们研究这一措施的上限以及它是如何实现的。我们孤立地研究机制,一组机制,和机制之间的因果关系组。我们提出了新的理论结果,表明彼此共享零件的机制无法全部达到最大值。我们还介绍了设计系统的技术,这些系统可以最大化其机制或关系子集的集成信息。我们的结果可以潜在地用于利用对称性和约束,以显着减少计算,并根据其最大可实现的集成信息比较不同的连通性概况。
    Originally developed as a theory of consciousness, integrated information theory provides a mathematical framework to quantify the causal irreducibility of systems and subsets of units in the system. Specifically, mechanism integrated information quantifies how much of the causal powers of a subset of units in a state, also referred to as a mechanism, cannot be accounted for by its parts. If the causal powers of the mechanism can be fully explained by its parts, it is reducible and its integrated information is zero. Here, we study the upper bound of this measure and how it is achieved. We study mechanisms in isolation, groups of mechanisms, and groups of causal relations among mechanisms. We put forward new theoretical results that show mechanisms that share parts with each other cannot all achieve their maximum. We also introduce techniques to design systems that can maximize the integrated information of a subset of their mechanisms or relations. Our results can potentially be used to exploit the symmetries and constraints to reduce the computations significantly and to compare different connectivity profiles in terms of their maximal achievable integrated information.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    无标度大脑活动,与学习有关,不同时间尺度的积分,和心理模型的形成,与亚稳态的认知基础相关。光谱斜率,无标度动力学的一个关键方面,被提议作为区分不同睡眠阶段的潜在指标。研究表明,大脑网络在清醒状态下保持一致的无标度结构,麻醉,和恢复。尽管性别之间的麻醉敏感性差异得到了认可,这些变化在皮质的临床脑电图记录中并不明显。最近,发现神经活动的幂律指数的斜率变化与Rényi熵的变化相关,香农信息熵的扩展概念。这些发现将量词确立为研究大脑无标度动力学的有前途的工具。我们的研究提出了一种新颖的视觉表示,称为Rényi熵-复杂性因果关系空间,它封装了复杂性,排列熵,和Rényi参数q。这项研究的主要目标是在理论范围内为经典动力系统定义这个空间。此外,该研究旨在调查模拟无标度活动的不同时间序列在多大程度上可以被区分。最后,该工具用于检测颅内脑电图(iEEG)信号的动态特征。为了实现这些目标,本研究实施了序数模式的Bandt和Pompe方法。在这个过程中,每个信号都与概率分布相关联,基于参数q计算Rényi熵和复杂度的因果度量。该方法是分析模拟时间序列的有价值的工具。它有效地区分了相关噪声的元素,并提供了一种直接的方法来检查行为差异,特点,和分类。对于iEEG实验数据,REM状态显示出更多的显著性别差异,而上回区在不同模式和分析中表现出最大的变化。用这个框架探索无标度大脑活动可以为认知和神经系统疾病提供有价值的见解。该结果可能对理解两性之间的大脑功能差异及其与神经系统疾病的可能相关性具有意义。
    Scale-free brain activity, linked with learning, the integration of different time scales, and the formation of mental models, is correlated with a metastable cognitive basis. The spectral slope, a key aspect of scale-free dynamics, was proposed as a potential indicator to distinguish between different sleep stages. Studies suggest that brain networks maintain a consistent scale-free structure across wakefulness, anesthesia, and recovery. Although differences in anesthetic sensitivity between the sexes are recognized, these variations are not evident in clinical electroencephalographic recordings of the cortex. Recently, changes in the slope of the power law exponent of neural activity were found to correlate with changes in Rényi entropy, an extended concept of Shannon\'s information entropy. These findings establish quantifiers as a promising tool for the study of scale-free dynamics in the brain. Our study presents a novel visual representation called the Rényi entropy-complexity causality space, which encapsulates complexity, permutation entropy, and the Rényi parameter q. The main goal of this study is to define this space for classical dynamical systems within theoretical bounds. In addition, the study aims to investigate how well different time series mimicking scale-free activity can be discriminated. Finally, this tool is used to detect dynamic features in intracranial electroencephalography (iEEG) signals. To achieve these goals, the study implementse the Bandt and Pompe method for ordinal patterns. In this process, each signal is associated with a probability distribution, and the causal measures of Rényi entropy and complexity are computed based on the parameter q. This method is a valuable tool for analyzing simulated time series. It effectively distinguishes elements of correlated noise and provides a straightforward means of examining differences in behaviors, characteristics, and classifications. For the iEEG experimental data, the REM state showed a greater number of significant sex-based differences, while the supramarginal gyrus region showed the most variation across different modes and analyzes. Exploring scale-free brain activity with this framework could provide valuable insights into cognition and neurological disorders. The results may have implications for understanding differences in brain function between the sexes and their possible relevance to neurological disorders.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Editorial
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    人类语言理解的帐户提出了单词的上下文概率与处理难度之间的不同数学关系,包括线性,对数,和超对数的。然而,有利于其中任何一个的经验证据都是喜忧参半的,似乎根据使用的处理难度指数和计算上下文概率的方法而有所不同。为了帮助解开这些结果,我们专注于语料库派生的上下文概率与N400之间的数学关系,N400是处理难度的神经指标。具体来说,我们使用37个当代转换语言模型来计算来自6个实验研究的N400刺激的上下文概率,并测试N400振幅是否最好通过线性预测,对数,超对数,或使用这些语言模型计算的概率的次对数变换,以及这些转换后的指标的组合。我们复制了在一些数据集上的发现,线性和对数变换概率的组合可以比单独的任何度量更好地预测N400振幅。此外,我们发现总的来说,N400振幅的最佳单预测因子是次对数变换概率,对于几乎所有的语言模型和数据集,它解释了N400振幅中的所有方差,否则由线性和对数变换解释。这是一个新的发现,没有任何当前的理论预测,因此,我们认为这可能在增加我们对语言统计规律如何影响语言理解的理解方面发挥重要作用。
    Accounts of human language comprehension propose different mathematical relationships between the contextual probability of a word and how difficult it is to process, including linear, logarithmic, and super-logarithmic ones. However, the empirical evidence favoring any of these over the others is mixed, appearing to vary depending on the index of processing difficulty used and the approach taken to calculate contextual probability. To help disentangle these results, we focus on the mathematical relationship between corpus-derived contextual probability and the N400, a neural index of processing difficulty. Specifically, we use 37 contemporary transformer language models to calculate the contextual probability of stimuli from 6 experimental studies of the N400, and test whether N400 amplitude is best predicted by a linear, logarithmic, super-logarithmic, or sub-logarithmic transformation of the probabilities calculated using these language models, as well as combinations of these transformed metrics. We replicate the finding that on some datasets, a combination of linearly and logarithmically-transformed probability can predict N400 amplitude better than either metric alone. In addition, we find that overall, the best single predictor of N400 amplitude is sub-logarithmically-transformed probability, which for almost all language models and datasets explains all the variance in N400 amplitude otherwise explained by the linear and logarithmic transformations. This is a novel finding that is not predicted by any current theoretical accounts, and thus one that we argue is likely to play an important role in increasing our understanding of how the statistical regularities of language impact language comprehension.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:电子定位是一个概念,它使科学家能够更好地了解电子系统的物理和化学性质。它与具有相反自旋的电子对的积累倾向以及它们对外部扰动的响应有关。本文详细介绍了KLD程序的设计与实现,这主要是在我们的研究小组中开发的,通过评估电子对密度函数的信息含量来阐明分子系统中的电子定位。KLD采用两个基于信息的函数作为同旋电子的费米和库仑孔的实空间度量,并且与其他方法相比具有更好的分辨率(即,ELF)。有关代码加速的信息也包括在本工作中,值得注意的是,壁挂时间计算的减少和版本之间的误差计算。
    方法:KLD的设计易于使用,延伸,并保持;因此,现代软件开发的许多原则,广泛的测试,并采用包管理。KLD程序的最新版本是利用统一计算设备架构(CUDA)版本创建的,这允许它使用NVIDIA图形处理单元(GPU)的计算能力进行处理。电子对条件密度是根据在HF/6-31G(2df,p)水平,或者在MP2/6-31G计算的显式相关波函数的情况下的自然轨道(2df,p)//HF/6-31G(2df,P)水平。
    BACKGROUND: The electron localization is a concept that allows scientists to better understand the physical and chemical properties of electronic systems. It is associated with the propensity of electron pairs with opposite spins to accumulate as well as with their response to external perturbations. This paper contains a detailed description of the design and implementation of the program KLD, which was primarily developed in our research group to elucidate electron localization in molecular systems by evaluating the information content of electron-pair density functions. KLD employs two information-based functions as a real space measure of the Fermi and Coulomb holes for same-spin electrons and shows a better resolution as compared to other methods (i.e., ELF). Information about the acceleration of the code is also included in the present work, being noticeable the reduction of wall-time calculation and the error calculation between versions.
    METHODS: KLD was designed to be easy to use, extend, and maintain; thus, many principles of modern software development, extensive testing, and package management were adopted. The latest version of the KLD program was created utilizing the Compute Unified Device Architecture (CUDA) version, which allows it to use the computational capacity of NVIDIA Graphics Processing Units (GPUs) for processing purposes. The electron-pair conditional density was calculated from the canonical molecular orbitals obtained at the HF/6-31G(2df,p) level, or alternatively the natural orbitals in the case of explicit correlated wavefunctions computed at the MP2/6-31G(2df,p)//HF/6-31G(2df,p) level.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    提出并分析了在知识空间理论(KST)框架下评估测试整体可靠性的指标。首先,在KST中应用现有的经典测试理论(CTT)方法的可能性,基于度量的真实得分方差和总方差之间的比率,已被探索。然而,这些方法是不适合的,因为在KST中误差和真实评分不是独立的。因此,基于熵和条件熵的概念,开发了两个新的指标。一个指标用于在给定知识状态的情况下估计响应模式的可靠性,而第二个是指一个人估计的知识状态的可靠性。在研究这些指标在一定数量的不同条件下的行为时,提供了一些理论考虑以及模拟和真实数据的经验示例。
    Indexes for estimating the overall reliability of a test in the framework of knowledge space theory (KST) are proposed and analyzed. First, the possibility of applying in KST the existing classical test theory (CTT) methods, based on the ratio between the true score variance and the total variance of the measure, has been explored. However, these methods are not suitable because in KST error and true score are not independent. Therefore, two new indexes based on the concepts of entropy and conditional entropy are developed. One index is used to estimate the reliability of the response pattern given the knowledge state, while the second one refers to the reliability of the estimated knowledge state of a person. Some theoretical considerations as well as simulations and an empirical example on real data are provided within a study of the behavior of these indexes under a certain number of different conditions.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    我们研究了随机线性上下文域(CB),其中代理通过具有未知信道参数的噪声信道观察真实上下文的噪声版本。我们的目标是设计一种可以“近似”贝叶斯预言的行动策略,该策略可以访问奖励模型和噪声通道参数。我们引入了一种改进的汤普森采样算法,并通过信息理论工具分析了其相对于oracle行动策略的贝叶斯累积遗憾。对于具有高斯上下文噪声的高斯乐队,我们的信息理论分析表明,在先验方差的一定条件下,贝叶斯累积后悔量表为O~(mT),其中m是特征向量的维数,T是时间范围。我们还考虑了问题设置,其中代理在收到奖励后有一些延迟地观察真实上下文,并表明延迟的真实背景会导致较低的遗憾。最后,我们通过经验证明了所提出的算法对基线的性能。
    We study stochastic linear contextual bandits (CB) where the agent observes a noisy version of the true context through a noise channel with unknown channel parameters. Our objective is to design an action policy that can \"approximate\" that of a Bayesian oracle that has access to the reward model and the noise channel parameter. We introduce a modified Thompson sampling algorithm and analyze its Bayesian cumulative regret with respect to the oracle action policy via information-theoretic tools. For Gaussian bandits with Gaussian context noise, our information-theoretic analysis shows that under certain conditions on the prior variance, the Bayesian cumulative regret scales as O˜(mT), where m is the dimension of the feature vector and T is the time horizon. We also consider the problem setting where the agent observes the true context with some delay after receiving the reward, and show that delayed true contexts lead to lower regret. Finally, we empirically demonstrate the performance of the proposed algorithms against baselines.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    听觉和前庭系统的显着信号检测能力已经研究了数十年。从这项研究中产生的许多概念框架表明,这些感觉系统处于不稳定的边缘,在Hopf分叉附近,为了解释检测规格。然而,这种范式包含几个未解决的问题。关键系统对随机波动或系统参数的不精确调整不具有鲁棒性。Further,处于临界状态的系统表现出动态系统理论中称为临界减速的现象,其中响应时间随着系统接近临界点而发散。这些感觉系统的另一种描述是基于混沌动力学的概念,其中动力学固有的不稳定性产生高的时间敏锐度和对弱信号的敏感性,即使有噪音。该替代描述解决了在关键性图片中出现的问题。我们回顾了支持这些系统使用混沌进行信号检测的概念框架和实验证据,并提出未来的验证实验。
    The remarkable signal-detection capabilities of the auditory and vestibular systems have been studied for decades. Much of the conceptual framework that arose from this research has suggested that these sensory systems rest on the verge of instability, near a Hopf bifurcation, in order to explain the detection specifications. However, this paradigm contains several unresolved issues. Critical systems are not robust to stochastic fluctuations or imprecise tuning of the system parameters. Further, a system poised at criticality exhibits a phenomenon known in dynamical systems theory as critical slowing down, where the response time diverges as the system approaches the critical point. An alternative description of these sensory systems is based on the notion of chaotic dynamics, where the instabilities inherent to the dynamics produce high temporal acuity and sensitivity to weak signals, even in the presence of noise. This alternative description resolves the issues that arise in the criticality picture. We review the conceptual framework and experimental evidence that supports the use of chaos for signal detection by these systems, and propose future validation experiments.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Editorial
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号