Temporal convolutional network

时间卷积网络
  • 文章类型: Journal Article
    时间干扰深脑磁刺激(TI-DMS)在海马中诱导节律电场(EF)以使认知功能正常化。海马EF的节律性时间序列对于评估TI-DMS至关重要。然而,有限元方法(FEM)需要几个小时才能获得EF的时间序列。为了减少时间成本,采用时间卷积网络(TCN)模型对TI-DMS诱导的海马EF时间序列进行预测。它以线圈配置和加载电流作为输入,并预测左右海马EF的最大值和平均值的时间序列。预测只需要几秒钟。通过交叉验证方法优化选择核大小和层数的模型参数组合。对多个受试者的实验结果表明,该模型预测的所有时间序列的R2均超过0.98。随着输入参数接近训练集,预测精度甚至更高。这些结果表明,所采用的模型可以快速预测TI-DMS诱导的海马EF的时间序列,并具有较高的准确性。有利于今后的临床应用。
    Temporal interference deep-brain magnetic stimulation (TI-DMS) induces rhythmic electric field (EF) in the hippocampus to normalize cognitive function. The rhythmic time series of the hippocampal EF is essential for the assessment of TI-DMS. However, the finite element method (FEM) takes several hours to obtain the time series of EF. In order to reduce the time cost, the temporal convolutional network (TCN) model is adopted to predict the time series of hippocampal EF induced by TI-DMS. It takes coil configuration and loaded current as input and predicts the time series of maximum and mean values of the left and right hippocampal EF. The prediction takes only a few seconds. The model parameter combination of kernel size and layers is selected optimally by cross-validation method. The experimental results for multiple subjects show that the R2 of all the time series predicted by the model exceed 0.98. And the prediction accuracy is even higher as the input parameters approach the training set. These results demonstrate that the adopted model can quickly predict the time series of hippocampal EF induced by TI-DMS with relatively high accuracy, which is beneficial for future clinical applications.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    霉菌污染对中草药(CHM)的加工和储存构成了重大挑战,导致质量下降和功效降低。为了解决这个问题,我们提出了一种快速准确的CHM模具检测方法,特别关注白术,采用电子鼻(电子鼻)技术。该方法引入了偏心时间卷积网络(ETCN)模型,它有效地从电子鼻数据中捕获时间和空间信息,在CHM中实现高效和精确的模具检测。在我们的方法中,我们采用随机共振(SR)技术从原始电子鼻数据中消除噪声。通过全面分析来自八个传感器的数据,SR增强的ETCN(SR-ETCN)方法达到了94.3%的令人印象深刻的精度,优于其他七个比较模型,这些模型仅使用上升阶段前7.0秒的响应时间。实验结果展示了ETCN模型的准确性和效率,为中草药霉菌检测提供了可靠的解决方案。这项研究有助于加快草药质量的评估,从而有助于确保传统医学实践的安全性和有效性。
    Mold contamination poses a significant challenge in the processing and storage of Chinese herbal medicines (CHM), leading to quality degradation and reduced efficacy. To address this issue, we propose a rapid and accurate detection method for molds in CHM, with a specific focus on Atractylodes macrocephala, using electronic nose (e-nose) technology. The proposed method introduces an eccentric temporal convolutional network (ETCN) model, which effectively captures temporal and spatial information from the e-nose data, enabling efficient and precise mold detection in CHM. In our approach, we employ the stochastic resonance (SR) technique to eliminate noise from the raw e-nose data. By comprehensively analyzing data from eight sensors, the SR-enhanced ETCN (SR-ETCN) method achieves an impressive accuracy of 94.3%, outperforming seven other comparative models that use only the response time of 7.0 seconds before the rise phase. The experimental results showcase the ETCN model\'s accuracy and efficiency, providing a reliable solution for mold detection in Chinese herbal medicine. This study contributes significantly to expediting the assessment of herbal medicine quality, thereby helping to ensure the safety and efficacy of traditional medicinal practices.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在隧道掘进机(TBM)施工中,准确的穿透率预测提高了破岩效率并减少了圆盘刀具的损坏。然而,该过程面临着巨大的挑战,例如地面条件的高度不确定性以及在大型和大型隧道中保持最佳TBM操作的复杂性。为了应对这些挑战,我们提出TCN-SENet++,一种新颖的混合多步实时渗透率预测模型,该模型结合了时间卷积网络(TCN)和挤压和激励(SENet)块,用于辅助隧穿。本研究旨在展示TCN-SENet++的应用,以及其他模型,如RNN,LSTM,GRU,和TCN,用于TBM渗透率预测。该模型是使用从Yin-Song引水项目中收集的实际数据集开发的。我们采用30秒的时间步长来预测渗透率的未来时间步长(1st,3rd,5th,Seven,和9th)。影响渗透率的特征,例如刀盘扭矩,推力,和刀盘功率,被考虑。使用平均绝对误差和均方误差进行比较分析,发现TCN-SENet++模型优于其他模型,包括RNN,LSTM,GRU,TCN,和TCN-SENet+。相比之下,TCN-SENet++实现了18%的平均MSE降低,6%,3%,1%,2%,分别。TCN-SENet++模型在新项目中显示出更少的错误,验证其在TBM施工中实时渗透率预测的有效性和适用性。
    Accurate penetration rate prediction enhances rock-breaking efficiency and reduces disc cutter damage in tunnel boring machine (TBM) construction. However, this process faces significant challenges such as the high uncertainty of ground conditions and the complexity of maintaining optimal TBM operation in long and large tunnels. To address these challenges, we propose TCN-SENet++, a novel hybrid multistep real-time penetration rate prediction model that combines a temporal convolutional network (TCN) and a squeeze-and-excitation (SENet) block for aided tunneling. This study aims to demonstrate the application of TCN-SENet++, as well as other models such as RNN, LSTM, GRU, and TCN, for TBM penetration rate prediction. The model was developed using actual datasets collected from the Yin-Song diversion project. We employ a 30-s time step to predict the future time steps of the penetration rate (1st, 3rd, 5th, 7th, and 9th). The features that influence the penetration rate, such as the cutterhead torque, thrust, and cutterhead power, were considered. A comparative analysis using the mean absolute error and mean squared error revealed that the TCN-SENet++ model outperformed the other models, including RNN, LSTM, GRU, TCN, and TCN-SENet+. In comparison, TCN-SENet++ achieved average MSE reductions of 18%, 6%, 3%, 1%, and 2%, respectively. The TCN-SENet++ model demonstrated fewer errors in the new project, validating its effectiveness and suitability for real-time penetration rate prediction in TBM construction.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    准确的电力负荷预测对智能电网的可持续运行至关重要。然而,负载的复杂性和不确定性,随着大规模和高维的能源信息,在处理复杂的动态功能和长期依赖关系方面面临挑战。本文提出了一种计算方法来解决短期电力负荷预测和能源信息管理中的这些挑战,以准确预测未来负荷需求为目标。该研究引入了一种混合方法,该方法结合了多个深度学习模型,门控递归单元(GRU)用于捕获时间序列数据中的长期依赖性,而时间卷积网络(TCN)有效地学习加载数据中的模式和特征。此外,引入了注意力机制,以自动专注于与负载预测任务最相关的输入组件,进一步提高模型性能。根据对四个公共数据集进行的实验评估,包括GEFCom2014,所提出的算法在预测精度、效率,和稳定性。值得注意的是,在GEFCom2014数据集上,FLOP减少超过48.8%,推理时间缩短了46.7%以上,MAPE提高了39%。该方法显著提高了可靠性,稳定性,以及智能电网的成本效益,这有助于在智能电网系统信息管理的背景下进行风险评估优化和运营规划。
    Accurate power load forecasting is crucial for the sustainable operation of smart grids. However, the complexity and uncertainty of load, along with the large-scale and high-dimensional energy information, present challenges in handling intricate dynamic features and long-term dependencies. This paper proposes a computational approach to address these challenges in short-term power load forecasting and energy information management, with the goal of accurately predicting future load demand. The study introduces a hybrid method that combines multiple deep learning models, the Gated Recurrent Unit (GRU) is employed to capture long-term dependencies in time series data, while the Temporal Convolutional Network (TCN) efficiently learns patterns and features in load data. Additionally, the attention mechanism is incorporated to automatically focus on the input components most relevant to the load prediction task, further enhancing model performance. According to the experimental evaluation conducted on four public datasets, including GEFCom2014, the proposed algorithm outperforms the baseline models on various metrics such as prediction accuracy, efficiency, and stability. Notably, on the GEFCom2014 dataset, FLOP is reduced by over 48.8%, inference time is shortened by more than 46.7%, and MAPE is improved by 39%. The proposed method significantly enhances the reliability, stability, and cost-effectiveness of smart grids, which facilitates risk assessment optimization and operational planning under the context of information management for smart grid systems.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    N4-乙酰半胱氨酸(ac4C)是mRNA中的化学修饰,其通过向胞嘧啶的N4位置添加乙酰基来改变mRNA的结构和功能。研究表明,ac4C与各种癌症的发生和发展密切相关。因此,准确预测人mRNA上的ac4C修饰位点对于揭示其在疾病中的作用以及开发新的诊断和治疗策略至关重要。然而,现有的深度学习模型在预测精度和泛化能力方面仍然存在局限性,这限制了它们处理复杂生物序列数据的有效性。本文介绍了一种基于深度学习的模型,STM-ac4C,用于预测人mRNA上的ac4C修饰位点。该模型结合了选择性核卷积的优点,时间卷积网络,和多头自我注意机制,有效地提取和整合RNA序列的多层次特征,从而实现了对ac4C位点的高精度预测。在独立测试数据集上,STM-ac4C显示改善1.81%,3.5%,准确率为0.37%,马修斯相关系数,和曲线下的面积,分别,与现有的最先进的技术相比。此外,它在其他平衡和不平衡数据集上的表现也证实了模型的鲁棒性和泛化能力。各种实验结果表明,STM-ac4C在预测性能方面优于现有方法。总之,STM-ac4C擅长预测人mRNA上的ac4C修饰位点,为深入了解mRNA修饰和癌症治疗的生物学意义提供了强大的新工具。此外,该模型通过序列区域影响分析揭示了影响ac4C位点预测的关键序列特征,为未来的研究提供了新的视角。源代码和实验数据可在https://github.com/ymy12341/STM-ac4C获得。
    N4-acetylcysteine (ac4C) is a chemical modification in mRNAs that alters the structure and function of mRNA by adding an acetyl group to the N4 position of cytosine. Researchers have shown that ac4C is closely associated with the occurrence and development of various cancers. Therefore, accurate prediction of ac4C modification sites on human mRNA is crucial for revealing its role in diseases and developing new diagnostic and therapeutic strategies. However, existing deep learning models still have limitations in prediction accuracy and generalization ability, which restrict their effectiveness in handling complex biological sequence data. This paper introduces a deep learning-based model, STM-ac4C, for predicting ac4C modification sites on human mRNA. The model combines the advantages of selective kernel convolution, temporal convolutional networks, and multi-head self-attention mechanisms to effectively extract and integrate multi-level features of RNA sequences, thereby achieving high-precision prediction of ac4C sites. On the independent test dataset, STM-ac4C showed improvements of 1.81%, 3.5%, and 0.37% in accuracy, Matthews correlation coefficient, and area under the curve, respectively, compared to the existing state-of-the-art technologies. Moreover, its performance on additional balanced and imbalanced datasets also confirmed the model\'s robustness and generalization ability. Various experimental results indicate that STM-ac4C outperforms existing methods in predictive performance. In summary, STM-ac4C excels in predicting ac4C modification sites on human mRNA, providing a powerful new tool for a deeper understanding of the biological significance of mRNA modifications and cancer treatment. Additionally, the model reveals key sequence features that influence the prediction of ac4C sites through sequence region impact analysis, offering new perspectives for future research. The source code and experimental data are available at https://github.com/ymy12341/STM-ac4C.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    脑电图(EEG)在癫痫分析中起着至关重要的作用,预测癫痫发作对癫痫的临床治疗具有重要价值。目前,使用卷积神经网络(CNN)的预测方法主要关注脑电的局部特征,这使得从多通道EEG中同时捕获空间和时间特征以有效地识别发作前状态具有挑战性。为了提取多通道脑电图之间固有的空间关系,同时获得它们的时间相关性,本研究通过结合图注意网络(GAT)和时间卷积网络(TCN),提出了一种预测癫痫发作的端到端模型.将低通滤波的脑电信号送入GAT模块进行脑电空间特征提取,然后是TCN来捕获时间特征,允许端到端模型获取多通道脑电图的时空相关性。该系统在公开可用的CHB-MIT数据库上进行了评估,基于分段的屈服精度为98.71%,特异性98.35%,灵敏度为99.07%,F1得分为98.71%,分别。基于事件的敏感度为97.03%,假阳性率(FPR)为0.03/h。实验结果表明,该系统可以通过利用脑电时空特征的融合来实现癫痫发作预测的卓越性能,而无需特征工程。
    Electroencephalography (EEG) plays a crucial role in epilepsy analysis, and epileptic seizure prediction has significant value for clinical treatment of epilepsy. Currently, prediction methods using Convolutional Neural Network (CNN) primarily focus on local features of EEG, making it challenging to simultaneously capture the spatial and temporal features from multi-channel EEGs to identify the preictal state effectively. In order to extract inherent spatial relationships among multi-channel EEGs while obtaining their temporal correlations, this study proposed an end-to-end model for the prediction of epileptic seizures by incorporating Graph Attention Network (GAT) and Temporal Convolutional Network (TCN). Low-pass filtered EEG signals were fed into the GAT module for EEG spatial feature extraction, and followed by TCN to capture temporal features, allowing the end-to-end model to acquire the spatiotemporal correlations of multi-channel EEGs. The system was evaluated on the publicly available CHB-MIT database, yielding segment-based accuracy of 98.71%, specificity of 98.35%, sensitivity of 99.07%, and F1-score of 98.71%, respectively. Event-based sensitivity of 97.03% and False Positive Rate (FPR) of 0.03/h was also achieved. Experimental results demonstrated this system can achieve superior performance for seizure prediction by leveraging the fusion of EEG spatiotemporal features without the need of feature engineering.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    研究证据表明,医学专家规定的身体康复锻炼可以帮助恢复身体功能,提高生活质量,促进身体残疾人士的独立。针对缺乏对所执行行动的即时专家反馈的情况,开发人类行为评估(HAE)系统成为一种有价值的自动化解决方案,解决在身体康复期间对锻炼和指导的准确评估的需要。先前为康复练习开发的HAE系统专注于开发利用骨架数据作为输入来计算患者执行的每个动作的质量分数的模型。然而,现有的研究集中在提高评分性能,同时往往忽视计算效率。在这项研究中,我们提出了LightPRA(轻型身体康复评估)系统,基于时间卷积网络(TCN)的创新架构解决方案,它利用扩张因果卷积神经网络(CNN)的功能。这种方法以更低的计算复杂度有效地捕获复杂的时间特征和骨架数据的特征,使其适用于物联网(IoT)设备和边缘计算框架等资源受限设备上提供的实时反馈。通过对爱达荷州大学身体康复运动数据(UI-PRMD)和运动运动的KInematic评估进行实证分析,以远程监测身体康复(KIMORE)数据集,我们提出的LightPRA模型在对人类活动性能进行评分方面,与几种最先进的方法相比,如时空图卷积网络(STGCN)和基于长短期记忆(LSTM)的模型,同时表现出更低的计算成本和复杂性。
    Research evidence shows that physical rehabilitation exercises prescribed by medical experts can assist in restoring physical function, improving life quality, and promoting independence for physically disabled individuals. In response to the absence of immediate expert feedback on performed actions, developing a Human Action Evaluation (HAE) system emerges as a valuable automated solution, addressing the need for accurate assessment of exercises and guidance during physical rehabilitation. Previous HAE systems developed for the rehabilitation exercises have focused on developing models that utilize skeleton data as input to compute a quality score for each action performed by the patient. However, existing studies have focused on improving scoring performance while often overlooking computational efficiency. In this research, we propose LightPRA (Light Physical Rehabilitation Assessment) system, an innovative architectural solution based on a Temporal Convolutional Network (TCN), which harnesses the capabilities of dilated causal Convolutional Neural Networks (CNNs). This approach efficiently captures complex temporal features and characteristics of the skeleton data with lower computational complexity, making it suitable for real-time feedback provided on resource-constrained devices such as Internet of Things (IoT) devices and Edge computing frameworks. Through empirical analysis performed on the University of Idaho-Physical Rehabilitation Movement Data (UI-PRMD) and KInematic assessment of MOvement for remote monitoring of physical REhabilitation (KIMORE) datasets, our proposed LightPRA model demonstrates superior performance over several state-of-the-art approaches such as Spatial-Temporal Graph Convolutional Network (STGCN) and Long Short-Term Memory (LSTM)-based models in scoring human activity performance, while exhibiting lower computational cost and complexity.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    脑机接口(BCI)是一种非常有前途的人机交互方法,可以利用大脑信号来控制外部设备。基于功能近红外光谱(fNIRS)的BCI被认为是一种相对较新且有前途的范例。fNIRS是一种测量脑血流动力学功能变化的技术。它通过测量氧合血红蛋白和脱氧血红蛋白(HbR)浓度来检测大脑皮层血液动力学活动的变化,并反向预测大脑的神经活动。目前,深度学习(DL)方法尚未广泛用于fNIRS解码,考虑fNIRS分类的空间和时间维度的研究较少。为了解决这些问题,提出了一种用于fNIRS特征提取的端到端混合神经网络。该方法利用时空卷积层自动提取时间上的有效信息,并利用空间注意力机制提取空间定位信息。时间卷积网络(TCN)用于在全连接层之前进一步利用fNIRS的时间信息。我们在包括29名受试者的公开数据集上验证了我们的方法,包括左手和右手运动图像(MI),心算(MA),和基线任务。结果表明,该方法训练参数少,准确度高,为BCI的发展提供有意义的参考。
    Brain Computer Interface (BCI) is a highly promising human-computer interaction method that can utilize brain signals to control external devices. BCI based on functional near-infrared spectroscopy (fNIRS) is considered a relatively new and promising paradigm. fNIRS is a technique of measuring functional changes in cerebral hemodynamics. It detects changes in the hemodynamic activity of the cerebral cortex by measuring oxyhemoglobin and deoxyhemoglobin (HbR) concentrations and inversely predicts the neural activity of the brain. At the present time, Deep learning (DL) methods have not been widely used in fNIRS decoding, and there are fewer studies considering both spatial and temporal dimensions for fNIRS classification. To solve these problems, we proposed an end-to-end hybrid neural network for feature extraction of fNIRS. The method utilizes a spatial-temporal convolutional layer for automatic extraction of temporally valid information and uses a spatial attention mechanism to extract spatially localized information. A temporal convolutional network (TCN) is used to further utilize the temporal information of fNIRS before the fully connected layer. We validated our approach on a publicly available dataset including 29 subjects, including left-hand and right-hand motor imagery (MI), mental arithmetic (MA), and a baseline task. The results show that the method has few training parameters and high accuracy, providing a meaningful reference for BCI development.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    对于各种故障类型和不确定的故障发生,单个网络模型在旋转机械的寿命预测中表现出局限性。因此,提出了一种结合多域特征融合(MDFF)和分布式TCN-Attention-BiGRU(DITCN-ABiGRU)的网络预测模型,以实现更准确的旋转机械寿命预测。首先,从多个传感器采集的振动信号在时间上提取特征,频率,和时频域。随后,对这些多域特征进行降维优化,以消除无用的信息特征。构建时间卷积网络(TCN)模型,通过注意力机制捕获反映旋转机械故障特征的关键信息,整个训练过程的依赖关系由BiGRU网络捕获。最后,通过构建健康指标曲线(HI),实现了对旋转机械寿命的精确预测。通过IEEEPHMChallenge2012数据集的滚动轴承和设计实验的滚珠丝杠副的寿命预测,验证了所提出的方法。实验结果表明,与卷积神经网络(CNN)和GRU模型相比,提出的MDFF和DITCN-AbiGRU模型具有更好的得分和更低的误差。
    A single network model exhibits limitations in the life prediction of rotating machinery for the various fault types and uncertain fault occurrence. Therefore, a network prediction model combining multi-domain feature fusion (MDFF) and distributed TCN-Attention-BiGRU (DITCN-ABiGRU) is proposed to enable a more accurate life prediction of rotating machinery. Firstly, the features of vibration signals collected from multiple sensors are extracted in the time, frequency, and time-frequency domains. Subsequently, dimensionality reduction optimization is conducted on these multi-domain features to eliminate useless information features. The temporal convolutional network (TCN) model is constructed to capture the critical information reflecting the fault characteristics of rotating machinery through the attention mechanism, and the dependencies of the whole training process are captured by the BiGRU network. Finally, precise prediction of the lifespan of rotating machinery is achieved by constructing a health indicator curve (HI). The proposed methods are verified through the life prediction of rolling bearings from the IEEE PHM Challenge 2012 dataset and ball screw pairs from a designed experiment. The experimental results show that the proposed MDFF and DITCN-ABiGRU model achieves a better score and lower error than the convolutional neural network (CNN) and GRU models.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    心房颤动,全球最常见的持续性心律失常之一,以其快速和不规则的心房节律而闻名。这项研究集成了时间卷积网络(TCN)和残差网络(ResNet)框架,以有效地对单导联心电图中的心房颤动进行分类,从而增强了神经网络在该领域的应用。我们的模型在检测心房颤动方面取得了显著成功,实验结果显示准确率为97%,F1评分为87%。这些数字表明该模型在识别多数阶级和少数阶级方面的出色表现,反映了其平衡和准确的分类能力。这项研究为心脏病学的诊断和治疗提供了新的视角和工具,以先进的神经网络技术为基础。
    Atrial fibrillation, one of the most common persistent cardiac arrhythmias globally, is known for its rapid and irregular atrial rhythms. This study integrates the temporal convolutional network (TCN) and residual network (ResNet) frameworks to effectively classify atrial fibrillation in single-lead ECGs, thereby enhancing the application of neural networks in this field. Our model demonstrated significant success in detecting atrial fibrillation, with experimental results showing an accuracy rate of 97% and an F1 score of 87%. These figures indicate the model\'s exceptional performance in identifying both majority and minority classes, reflecting its balanced and accurate classification capability. This research offers new perspectives and tools for diagnosis and treatment in cardiology, grounded in advanced neural network technology.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号