We investigated the impact of nonequilibrium conditions on the transmission and recovery of information through noisy channels. By measuring the recoverability of messages from an information source, we demonstrate that the ability to recover information is connected to the nonequilibrium behavior of the information flow, particularly in terms of sequential information transfer. We discovered that the mathematical equivalence of information recoverability and entropy production characterizes the dissipative nature of information transfer. Our findings show that both entropy production (or recoverability) and mutual information increase monotonically with the nonequilibrium strength of information dynamics. These results suggest that the nonequilibrium dissipation cost can enhance the recoverability of noise messages and improve the quality of information transfer. Finally, we propose a simple model to test our conclusions and found that the numerical results support our findings.

Single-cell omics data are growing at an unprecedented rate, whereas effective integration of them remains challenging due to different sequencing methods, quality, and expression pattern of each omics data. In this study, we propose a universal framework for the integration of single-cell multi-omics data based on graph convolutional network (GCN-SC). Among the multiple single-cell data, GCN-SC usually selects one data with the largest number of cells as the reference and the rest as the query dataset. It utilizes mutual nearest neighbor algorithm to identify cell-pairs, which provide connections between cells both within and across the reference and query datasets. A GCN algorithm further takes the mixed graph constructed from these cell-pairs to adjust count matrices from the query datasets. Finally, dimension reduction is performed by using non-negative matrix factorization before visualization. By applying GCN-SC on six datasets, we show that GCN-SC can effectively integrate sequencing data from multiple single-cell sequencing technologies, species or different omics, which outperforms the state-of-the-art methods, including Seurat, LIGER, GLUER and Pamona.

Extracellular vesicles (EVs) are naturally released membrane vesicles that act as carriers of proteins and RNAs for intercellular communication. With various biomolecules and specific ligands, EV has represented a novel form of information transfer, which possesses extremely outstanding efficiency and specificity compared to the classical signal transduction. In addition, EV has extended the concept of signal transduction to intercellular aspect by working as the collection of extracellular information. Therefore, the functions of EVs have been extensively characterized and EVs exhibit an exciting prospect for clinical applications. However, the biogenesis of EVs and, in particular, the regulation of this process by extracellular signals, which are essential to conduct further studies and support optimal utility, remain unclear. Here, we review the current understanding of the biogenesis of EVs, focus on the regulation of this process by extracellular signals and discuss their therapeutic value.

Cognitive functionality emerges due to neural interactions. The interregional signal interactions underlying episodic memory are a complex process. Thus, we need to quantify this process more accurately to understand how brain regions receive information from other regions. Studies suggest that resting-state functional connectivity (FC) conveys cognitive information; additionally, activity flow estimates the contribution of the source region to the activation pattern of the target region, thus decoding the cognitive information transfer. Therefore, we performed a combined analysis of task-evoked activation and resting-state FC voxel-wise by activity flow mapping to estimate the information transfer pattern of episodic memory. We found that the cinguloopercular (CON), frontoparietal (FPN) and default mode networks (DMNs) were the most recruited structures in information transfer. The patterns and functions of information transfer differed between encoding and retrieval. Furthermore, we found that information transfer was a better predictor of memory ability than previous methods. Additional analysis indicated that structural connectivity (SC) had a transportive role in information transfer. Finally, we present the information transfer mechanism of episodic memory from multiple neural perspectives. These findings suggest that information transfer is a better biological indicator that accurately describes signal communication in the brain and strongly influences the function of episodic memory.

OBJECTIVE: Sleep apnea hypopnea syndrome (SAHS) is a prevalent sleep breathing disorder that can lead to brain damage and is also a risk factor for cognitive impairment and some common diseases. Studies on cortical effective connectivity (EC) during sleep may provide more direct and pathological information and shed new light on brain dysfunction due to SAHS. However, the EC is rarely explored in SAHS patients, especially during different sleep stages.
METHODS: To this end, six-channel EEG signals of 43 SAHS patients and 41 healthy participants were recorded by whole-night polysomnography (PSG). The symbolic transfer entropy (STE) was applied to measure the EC between cortical regions in different frequency bands. Posterior-anterior ratio (PA) was employed to evaluate the posterior-to-anterior pattern of information flow based on overall cortical EC. The statistical characteristics of the STE and PA and of the intra-individual normalized parameters (STE* and PA*) were served as different feature sets for classifying the severity of SAHS.
RESULTS: Although the patterns of STE across electrodes were similar, significant differences were found between the patient and the control groups. The variation trends across stages in the PA were also different in multiple frequency bands between groups. Important features extracted from the STE* and PA* were distributed in multiple rhythms, mainly in δ, α, and γ. The PA* feature set gave the best results, with accuracies of 98.8% and 83.3% for SAHS diagnosis (binary) and severity classification (four-way).
CONCLUSIONS: These results suggest that modifications in cortical EC were existed in SAHS patients during sleep, which may help characterize cortical abnormality in patients.

Information diffusion within financial markets plays a crucial role in the process of price formation and the propagation of sentiment and risk. We perform a comparative analysis of information transfer between industry sectors of the Chinese and the USA stock markets, using daily sector indices for the period from 2000 to 2017. The information flow from one sector to another is measured by the transfer entropy of the daily returns of the two sector indices. We find that the most active sector in information exchange (i.e., the largest total information inflow and outflow) is the non-bank financial sector in the Chinese market and the technology sector in the USA market. This is consistent with the role of the non-bank sector in corporate financing in China and the impact of technological innovation in the USA. In each market, the most active sector is also the largest information sink that has the largest information inflow (i.e., inflow minus outflow). In contrast, we identify that the main information source is the bank sector in the Chinese market and the energy sector in the USA market. In the case of China, this is due to the importance of net bank lending as a signal of corporate activity and the role of energy pricing in affecting corporate profitability. There are sectors such as the real estate sector that could be an information sink in one market but an information source in the other, showing the complex behavior of different markets. Overall, these findings show that stock markets are more synchronized, or ordered, during periods of turmoil than during periods of stability.

In this paper, a rigorous formalism of information transfer within a multi-dimensional deterministic dynamic system is established for both continuous flows and discrete mappings. The underlying mechanism is derived from entropy change and transfer during the evolutions of multiple components. While this work is mainly focused on three-dimensional systems, the analysis of information transfer among state variables can be generalized to high-dimensional systems. Explicit formulas are given and verified in the classical Lorenz and Chua\'s systems. The uncertainty of information transfer is quantified for all variables, with which a dynamic sensitivity analysis could be performed statistically as an additional benefit. The generalized formalisms can be applied to study dynamical behaviors as well as asymptotic dynamics of the system. The simulation results can help to reveal some underlying information for understanding the system better, which can be used for prediction and control in many diverse fields.

This paper applies effective transfer entropy to research the information transfer in the Chinese stock market around its crash in 2015. According to the market states, the entire period is divided into four sub-phases: the tranquil, bull, crash, and post-crash periods. Kernel density estimation is used to calculate the effective transfer entropy. Then, the information transfer network is constructed. Nodes\' centralities and the directed maximum spanning trees of the networks are analyzed. The results show that, in the tranquil period, the information transfer is weak in the market. In the bull period, the strength and scope of the information transfer increases. The utility sector outputs a great deal of information and is the hub node for the information flow. In the crash period, the information transfer grows further. The market efficiency in this period is worse than that in the other three sub-periods. The information technology sector is the biggest information source, while the consumer staples sector receives the most information. The interactions of the sectors become more direct. In the post-crash period, information transfer declines but is still stronger than the tranquil time. The financial sector receives the largest amount of information and is the pivot node.

Rainfall is one of the most fundamental components of the water cycle and is one of the fundamental inputs of hydrological models. A well-designed network can not only depict the regional precipitation characteristics, but also economically yield maximum needed rainfall information. In regions where either there is limited data or data is not available, it is a common challenge to add stations. The entropy theory-based information transfer model and geostatistical interpolation techniques are two solutions to meet the challenge. In this study, we used a representative rain gauge network to do the network design. Two models, based on information transfer and data transfer, were compared for network design. Other rain gauges in the study area were used as reference (\"true values\") for assessing the model. Results showed that the information transfer model estimated transinformation between station pairs better than did the data transfer model. Different representative gauges were evaluated separately by the directional information transfer index (DIT). The candidate gauges selected with least information redundancy were similar for both information transfer and data transfer models. Though both models captured some least information-redundant areas, other areas may be bypassed because of model errors or estimation errors.

Neural oscillations can enhance feature recognition (Azouz and Gray Proceedings of the National Academy of Sciences of the United States of America, 97, 8110-8115 2000), modulate interactions between neurons (Womelsdorf et al. Science, 316, 1609-01612 2007), and improve learning and memory (Markowska et al. The Journal of Neuroscience, 15, 2063-2073 1995). Numerical studies have shown that coherent spiking can give rise to windows in time during which information transfer can be enhanced in neuronal networks (Abeles Israel Journal of Medical Sciences, 18, 83-92 1982; Lisman and Idiart Science, 267, 1512-1515 1995, Salinas and Sejnowski Nature Reviews. Neuroscience, 2, 539-550 2001). Unanswered questions are: 1) What is the transfer mechanism? And 2) how well can a transfer be executed? Here, we present a pulse-based mechanism by which a graded current amplitude may be exactly propagated from one neuronal population to another. The mechanism relies on the downstream gating of mean synaptic current amplitude from one population of neurons to another via a pulse. Because transfer is pulse-based, information may be dynamically routed through a neural circuit with fixed connectivity. We demonstrate the transfer mechanism in a realistic network of spiking neurons and show that it is robust to noise in the form of pulse timing inaccuracies, random synaptic strengths and finite size effects. We also show that the mechanism is structurally robust in that it may be implemented using biologically realistic pulses. The transfer mechanism may be used as a building block for fast, complex information processing in neural circuits. We show that the mechanism naturally leads to a framework wherein neural information coding and processing can be considered as a product of linear maps under the active control of a pulse generator. Distinct control and processing components combine to form the basis for the binding, propagation, and processing of dynamically routed information within neural pathways. Using our framework, we construct example neural circuits to 1) maintain a short-term memory, 2) compute time-windowed Fourier transforms, and 3) perform spatial rotations. We postulate that such circuits, with automatic and stereotyped control and processing of information, are the neural correlates of Crick and Koch\'s zombie modes.