Temporal convolutional network

时间卷积网络
  • 文章类型: Journal Article
    在本文中,给出了现实汽车场景中麦克风虚拟化的实验结果。设计了一种时间卷积网络(TCN),以便基于监视不同位置的麦克风信号的知识来估计驾驶员耳朵位置的声信号-一种称为虚拟麦克风的技术。在流行的B段汽车上实施了实验设置,以获取机舱内的声场,同时以可变速度在光滑的沥青上行驶。为了测试TCN的潜力,麦克风信号记录在两种不同的场景中,有或没有前排乘客。我们的实验结果表明,当在这两种情况下进行训练时,所采用的TCN能够稳健地适应不同的条件,并保证良好的平均性能。此外,提出了对神经网络(NN)参数的研究,这些参数保证了虚拟麦克风信号估计的足够准确性,同时保持了较低的计算复杂度。
    In this paper, the experimental results on microphone virtualization in realistic automotive scenarios are presented. A Temporal Convolutional Network (TCN) was designed in order to estimate the acoustic signal at the driver\'s ear positions based on the knowledge of monitoring microphone signals at different positions-a technique known as virtual microphone. An experimental setup was implemented on a popular B-segment car to acquire the acoustic field within the cabin while running on smooth asphalt at variable speeds. In order to test the potentiality of the TCN, microphone signals were recorded in two different scenarios, either with or without the front passenger. Our experimental results show that, when training is performed in both scenarios, the adopted TCN is able to robustly adapt to different conditions and guarantee a good average performance. Furthermore, an investigation on the parameters of the Neural Network (NN) that guarantee the sufficient accuracy of the estimation of the virtual microphone signals while maintaining a low computational complexity is presented.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    时间干扰深脑磁刺激(TI-DMS)在海马中诱导节律电场(EF)以使认知功能正常化。海马EF的节律性时间序列对于评估TI-DMS至关重要。然而,有限元方法(FEM)需要几个小时才能获得EF的时间序列。为了减少时间成本,采用时间卷积网络(TCN)模型对TI-DMS诱导的海马EF时间序列进行预测。它以线圈配置和加载电流作为输入,并预测左右海马EF的最大值和平均值的时间序列。预测只需要几秒钟。通过交叉验证方法优化选择核大小和层数的模型参数组合。对多个受试者的实验结果表明,该模型预测的所有时间序列的R2均超过0.98。随着输入参数接近训练集,预测精度甚至更高。这些结果表明,所采用的模型可以快速预测TI-DMS诱导的海马EF的时间序列,并具有较高的准确性。有利于今后的临床应用。
    Temporal interference deep-brain magnetic stimulation (TI-DMS) induces rhythmic electric field (EF) in the hippocampus to normalize cognitive function. The rhythmic time series of the hippocampal EF is essential for the assessment of TI-DMS. However, the finite element method (FEM) takes several hours to obtain the time series of EF. In order to reduce the time cost, the temporal convolutional network (TCN) model is adopted to predict the time series of hippocampal EF induced by TI-DMS. It takes coil configuration and loaded current as input and predicts the time series of maximum and mean values of the left and right hippocampal EF. The prediction takes only a few seconds. The model parameter combination of kernel size and layers is selected optimally by cross-validation method. The experimental results for multiple subjects show that the R2 of all the time series predicted by the model exceed 0.98. And the prediction accuracy is even higher as the input parameters approach the training set. These results demonstrate that the adopted model can quickly predict the time series of hippocampal EF induced by TI-DMS with relatively high accuracy, which is beneficial for future clinical applications.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    在隧道掘进机(TBM)施工中,准确的穿透率预测提高了破岩效率并减少了圆盘刀具的损坏。然而,该过程面临着巨大的挑战,例如地面条件的高度不确定性以及在大型和大型隧道中保持最佳TBM操作的复杂性。为了应对这些挑战,我们提出TCN-SENet++,一种新颖的混合多步实时渗透率预测模型,该模型结合了时间卷积网络(TCN)和挤压和激励(SENet)块,用于辅助隧穿。本研究旨在展示TCN-SENet++的应用,以及其他模型,如RNN,LSTM,GRU,和TCN,用于TBM渗透率预测。该模型是使用从Yin-Song引水项目中收集的实际数据集开发的。我们采用30秒的时间步长来预测渗透率的未来时间步长(1st,3rd,5th,Seven,和9th)。影响渗透率的特征,例如刀盘扭矩,推力,和刀盘功率,被考虑。使用平均绝对误差和均方误差进行比较分析,发现TCN-SENet++模型优于其他模型,包括RNN,LSTM,GRU,TCN,和TCN-SENet+。相比之下,TCN-SENet++实现了18%的平均MSE降低,6%,3%,1%,2%,分别。TCN-SENet++模型在新项目中显示出更少的错误,验证其在TBM施工中实时渗透率预测的有效性和适用性。
    Accurate penetration rate prediction enhances rock-breaking efficiency and reduces disc cutter damage in tunnel boring machine (TBM) construction. However, this process faces significant challenges such as the high uncertainty of ground conditions and the complexity of maintaining optimal TBM operation in long and large tunnels. To address these challenges, we propose TCN-SENet++, a novel hybrid multistep real-time penetration rate prediction model that combines a temporal convolutional network (TCN) and a squeeze-and-excitation (SENet) block for aided tunneling. This study aims to demonstrate the application of TCN-SENet++, as well as other models such as RNN, LSTM, GRU, and TCN, for TBM penetration rate prediction. The model was developed using actual datasets collected from the Yin-Song diversion project. We employ a 30-s time step to predict the future time steps of the penetration rate (1st, 3rd, 5th, 7th, and 9th). The features that influence the penetration rate, such as the cutterhead torque, thrust, and cutterhead power, were considered. A comparative analysis using the mean absolute error and mean squared error revealed that the TCN-SENet++ model outperformed the other models, including RNN, LSTM, GRU, TCN, and TCN-SENet+. In comparison, TCN-SENet++ achieved average MSE reductions of 18%, 6%, 3%, 1%, and 2%, respectively. The TCN-SENet++ model demonstrated fewer errors in the new project, validating its effectiveness and suitability for real-time penetration rate prediction in TBM construction.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    准确的电力负荷预测对智能电网的可持续运行至关重要。然而,负载的复杂性和不确定性,随着大规模和高维的能源信息,在处理复杂的动态功能和长期依赖关系方面面临挑战。本文提出了一种计算方法来解决短期电力负荷预测和能源信息管理中的这些挑战,以准确预测未来负荷需求为目标。该研究引入了一种混合方法,该方法结合了多个深度学习模型,门控递归单元(GRU)用于捕获时间序列数据中的长期依赖性,而时间卷积网络(TCN)有效地学习加载数据中的模式和特征。此外,引入了注意力机制,以自动专注于与负载预测任务最相关的输入组件,进一步提高模型性能。根据对四个公共数据集进行的实验评估,包括GEFCom2014,所提出的算法在预测精度、效率,和稳定性。值得注意的是,在GEFCom2014数据集上,FLOP减少超过48.8%,推理时间缩短了46.7%以上,MAPE提高了39%。该方法显著提高了可靠性,稳定性,以及智能电网的成本效益,这有助于在智能电网系统信息管理的背景下进行风险评估优化和运营规划。
    Accurate power load forecasting is crucial for the sustainable operation of smart grids. However, the complexity and uncertainty of load, along with the large-scale and high-dimensional energy information, present challenges in handling intricate dynamic features and long-term dependencies. This paper proposes a computational approach to address these challenges in short-term power load forecasting and energy information management, with the goal of accurately predicting future load demand. The study introduces a hybrid method that combines multiple deep learning models, the Gated Recurrent Unit (GRU) is employed to capture long-term dependencies in time series data, while the Temporal Convolutional Network (TCN) efficiently learns patterns and features in load data. Additionally, the attention mechanism is incorporated to automatically focus on the input components most relevant to the load prediction task, further enhancing model performance. According to the experimental evaluation conducted on four public datasets, including GEFCom2014, the proposed algorithm outperforms the baseline models on various metrics such as prediction accuracy, efficiency, and stability. Notably, on the GEFCom2014 dataset, FLOP is reduced by over 48.8%, inference time is shortened by more than 46.7%, and MAPE is improved by 39%. The proposed method significantly enhances the reliability, stability, and cost-effectiveness of smart grids, which facilitates risk assessment optimization and operational planning under the context of information management for smart grid systems.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    N4-乙酰半胱氨酸(ac4C)是mRNA中的化学修饰,其通过向胞嘧啶的N4位置添加乙酰基来改变mRNA的结构和功能。研究表明,ac4C与各种癌症的发生和发展密切相关。因此,准确预测人mRNA上的ac4C修饰位点对于揭示其在疾病中的作用以及开发新的诊断和治疗策略至关重要。然而,现有的深度学习模型在预测精度和泛化能力方面仍然存在局限性,这限制了它们处理复杂生物序列数据的有效性。本文介绍了一种基于深度学习的模型,STM-ac4C,用于预测人mRNA上的ac4C修饰位点。该模型结合了选择性核卷积的优点,时间卷积网络,和多头自我注意机制,有效地提取和整合RNA序列的多层次特征,从而实现了对ac4C位点的高精度预测。在独立测试数据集上,STM-ac4C显示改善1.81%,3.5%,准确率为0.37%,马修斯相关系数,和曲线下的面积,分别,与现有的最先进的技术相比。此外,它在其他平衡和不平衡数据集上的表现也证实了模型的鲁棒性和泛化能力。各种实验结果表明,STM-ac4C在预测性能方面优于现有方法。总之,STM-ac4C擅长预测人mRNA上的ac4C修饰位点,为深入了解mRNA修饰和癌症治疗的生物学意义提供了强大的新工具。此外,该模型通过序列区域影响分析揭示了影响ac4C位点预测的关键序列特征,为未来的研究提供了新的视角。源代码和实验数据可在https://github.com/ymy12341/STM-ac4C获得。
    N4-acetylcysteine (ac4C) is a chemical modification in mRNAs that alters the structure and function of mRNA by adding an acetyl group to the N4 position of cytosine. Researchers have shown that ac4C is closely associated with the occurrence and development of various cancers. Therefore, accurate prediction of ac4C modification sites on human mRNA is crucial for revealing its role in diseases and developing new diagnostic and therapeutic strategies. However, existing deep learning models still have limitations in prediction accuracy and generalization ability, which restrict their effectiveness in handling complex biological sequence data. This paper introduces a deep learning-based model, STM-ac4C, for predicting ac4C modification sites on human mRNA. The model combines the advantages of selective kernel convolution, temporal convolutional networks, and multi-head self-attention mechanisms to effectively extract and integrate multi-level features of RNA sequences, thereby achieving high-precision prediction of ac4C sites. On the independent test dataset, STM-ac4C showed improvements of 1.81%, 3.5%, and 0.37% in accuracy, Matthews correlation coefficient, and area under the curve, respectively, compared to the existing state-of-the-art technologies. Moreover, its performance on additional balanced and imbalanced datasets also confirmed the model\'s robustness and generalization ability. Various experimental results indicate that STM-ac4C outperforms existing methods in predictive performance. In summary, STM-ac4C excels in predicting ac4C modification sites on human mRNA, providing a powerful new tool for a deeper understanding of the biological significance of mRNA modifications and cancer treatment. Additionally, the model reveals key sequence features that influence the prediction of ac4C sites through sequence region impact analysis, offering new perspectives for future research. The source code and experimental data are available at https://github.com/ymy12341/STM-ac4C.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    对于各种故障类型和不确定的故障发生,单个网络模型在旋转机械的寿命预测中表现出局限性。因此,提出了一种结合多域特征融合(MDFF)和分布式TCN-Attention-BiGRU(DITCN-ABiGRU)的网络预测模型,以实现更准确的旋转机械寿命预测。首先,从多个传感器采集的振动信号在时间上提取特征,频率,和时频域。随后,对这些多域特征进行降维优化,以消除无用的信息特征。构建时间卷积网络(TCN)模型,通过注意力机制捕获反映旋转机械故障特征的关键信息,整个训练过程的依赖关系由BiGRU网络捕获。最后,通过构建健康指标曲线(HI),实现了对旋转机械寿命的精确预测。通过IEEEPHMChallenge2012数据集的滚动轴承和设计实验的滚珠丝杠副的寿命预测,验证了所提出的方法。实验结果表明,与卷积神经网络(CNN)和GRU模型相比,提出的MDFF和DITCN-AbiGRU模型具有更好的得分和更低的误差。
    A single network model exhibits limitations in the life prediction of rotating machinery for the various fault types and uncertain fault occurrence. Therefore, a network prediction model combining multi-domain feature fusion (MDFF) and distributed TCN-Attention-BiGRU (DITCN-ABiGRU) is proposed to enable a more accurate life prediction of rotating machinery. Firstly, the features of vibration signals collected from multiple sensors are extracted in the time, frequency, and time-frequency domains. Subsequently, dimensionality reduction optimization is conducted on these multi-domain features to eliminate useless information features. The temporal convolutional network (TCN) model is constructed to capture the critical information reflecting the fault characteristics of rotating machinery through the attention mechanism, and the dependencies of the whole training process are captured by the BiGRU network. Finally, precise prediction of the lifespan of rotating machinery is achieved by constructing a health indicator curve (HI). The proposed methods are verified through the life prediction of rolling bearings from the IEEE PHM Challenge 2012 dataset and ball screw pairs from a designed experiment. The experimental results show that the proposed MDFF and DITCN-ABiGRU model achieves a better score and lower error than the convolutional neural network (CNN) and GRU models.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    心房颤动,全球最常见的持续性心律失常之一,以其快速和不规则的心房节律而闻名。这项研究集成了时间卷积网络(TCN)和残差网络(ResNet)框架,以有效地对单导联心电图中的心房颤动进行分类,从而增强了神经网络在该领域的应用。我们的模型在检测心房颤动方面取得了显著成功,实验结果显示准确率为97%,F1评分为87%。这些数字表明该模型在识别多数阶级和少数阶级方面的出色表现,反映了其平衡和准确的分类能力。这项研究为心脏病学的诊断和治疗提供了新的视角和工具,以先进的神经网络技术为基础。
    Atrial fibrillation, one of the most common persistent cardiac arrhythmias globally, is known for its rapid and irregular atrial rhythms. This study integrates the temporal convolutional network (TCN) and residual network (ResNet) frameworks to effectively classify atrial fibrillation in single-lead ECGs, thereby enhancing the application of neural networks in this field. Our model demonstrated significant success in detecting atrial fibrillation, with experimental results showing an accuracy rate of 97% and an F1 score of 87%. These figures indicate the model\'s exceptional performance in identifying both majority and minority classes, reflecting its balanced and accurate classification capability. This research offers new perspectives and tools for diagnosis and treatment in cardiology, grounded in advanced neural network technology.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:在临床医学中,使用心电图(CTG)监测胎儿心率(FHR)是评估胎儿酸中毒最常用的方法之一.然而,由于CTG的视觉解释取决于临床医生的主观判断,这导致了观察者间和观察者内的高度可变性,这使得有必要引入自动诊断技术。
    方法:在本研究中,我们提出了一种针对胎儿酸中毒的计算机辅助诊断算法(Hybrid-FHR),以帮助医师做出客观决策并及时采取干预措施.混合动力FHR使用多模态特征,包括一维FHR信号和基于先验知识设计的三种类型的专家特征(形态学时域,频域,和非线性)。为了提取一维FHR信号的时空特征表示,设计了一种基于扩张因果卷积的多尺度挤压激励时间卷积网络(SE-TCN)骨干模型,通过扩展每层卷积核的感受场,同时保持相对较小的参数大小,可以有效地捕获FHR信号的长期依赖性。此外,我们提出了一种跨模态特征融合(CMFF)方法,该方法使用多头注意机制来探索不同模态之间的关系,获得更多的信息特征表示和提高诊断的准确性。
    结果:我们的消融实验表明,混合FHR优于传统的先前方法,平均精度,特异性,灵敏度,精度,F1得分为96.8、97.5、96、97.5和96.7%,分别。
    结论:我们的算法实现了自动CTG分析,协助医疗保健专业人员早期发现胎儿酸中毒并及时实施干预措施。
    BACKGROUND: In clinical medicine, fetal heart rate (FHR) monitoring using cardiotocography (CTG) is one of the most commonly used methods for assessing fetal acidosis. However, as the visual interpretation of CTG depends on the subjective judgment of the clinician, this has led to high inter-observer and intra-observer variability, making it necessary to introduce automated diagnostic techniques.
    METHODS: In this study, we propose a computer-aided diagnostic algorithm (Hybrid-FHR) for fetal acidosis to assist physicians in making objective decisions and taking timely interventions. Hybrid-FHR uses multi-modal features, including one-dimensional FHR signals and three types of expert features designed based on prior knowledge (morphological time domain, frequency domain, and nonlinear). To extract the spatiotemporal feature representation of one-dimensional FHR signals, we designed a multi-scale squeeze and excitation temporal convolutional network (SE-TCN) backbone model based on dilated causal convolution, which can effectively capture the long-term dependence of FHR signals by expanding the receptive field of each layer\'s convolution kernel while maintaining a relatively small parameter size. In addition, we proposed a cross-modal feature fusion (CMFF) method that uses multi-head attention mechanisms to explore the relationships between different modalities, obtaining more informative feature representations and improving diagnostic accuracy.
    RESULTS: Our ablation experiments show that the Hybrid-FHR outperforms traditional previous methods, with average accuracy, specificity, sensitivity, precision, and F1 score of 96.8, 97.5, 96, 97.5, and 96.7%, respectively.
    CONCLUSIONS: Our algorithm enables automated CTG analysis, assisting healthcare professionals in the early identification of fetal acidosis and the prompt implementation of interventions.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    步态分析在早期检测和监测各种神经和肌肉骨骼疾病中起着至关重要的作用。本文对利用三维视觉自动检测异常步态进行了全面的研究,专注于适合日常环境的非侵入性和实用的数据采集方法。我们探索各种配置,包括放置在不同距离和角度的多摄像机设置,以及在不同方向进行日常活动。我们研究的一个组成部分包括将步态分析与日常生活活动(ADL)的监测相结合,鉴于这种整合在环境辅助生活的背景下至关重要。为了实现这一点,我们研究了前沿的深度神经网络方法,例如时间卷积网络,门控经常性股,和长短期记忆自动编码器。此外,我们仔细检查不同的数据表示格式,包括基于欧几里得的表示,角邻接矩阵,和旋转矩阵。我们系统的绩效评估利用了公开可用的数据集和我们自己收集的数据,同时考虑了个体差异和环境因素。结果强调了我们提出的配置在准确分类异常步态,从而为非侵入性和有效的数据收集提供了最佳设置。
    Gait analysis plays a crucial role in detecting and monitoring various neurological and musculoskeletal disorders early. This paper presents a comprehensive study of the automatic detection of abnormal gait using 3D vision, with a focus on non-invasive and practical data acquisition methods suitable for everyday environments. We explore various configurations, including multi-camera setups placed at different distances and angles, as well as performing daily activities in different directions. An integral component of our study involves combining gait analysis with the monitoring of activities of daily living (ADLs), given the paramount relevance of this integration in the context of Ambient Assisted Living. To achieve this, we investigate cutting-edge Deep Neural Network approaches, such as the Temporal Convolutional Network, Gated Recurrent Unit, and Long Short-Term Memory Autoencoder. Additionally, we scrutinize different data representation formats, including Euclidean-based representations, angular adjacency matrices, and rotation matrices. Our system\'s performance evaluation leverages both publicly available datasets and data we collected ourselves while accounting for individual variations and environmental factors. The results underscore the effectiveness of our proposed configurations in accurately classifying abnormal gait, thus shedding light on the optimal setup for non-invasive and efficient data collection.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    动态功能连接(dFC),它可以在静息状态功能磁共振成像(rs-fMRI)数据中捕获大脑活动随时间的异常,在揭示注意力缺陷/多动障碍(ADHD)患者的大脑活动异常机制方面具有天然的优势。已经提出了几种深度学习方法来从rs-fMRI中学习动态变化以进行FC分析,并取得了优于那些使用静态FC。然而,大多数现有方法只考虑两个相邻时间戳的依赖关系,当更改与许多时间戳的过程有关时,这是有限的。
    在本文中,我们提出了一种新颖的时间依赖神经网络(TDNet),用于从rs-fMRI时间序列中进行FC表示学习和时间依赖关系跟踪,以进行自动ADHD识别。具体来说,我们首先将rs-fMRI时间序列划分为一系列连续且不重叠的片段。对于每个段,我们设计了一个FC生成模块来学习更多的判别表示来构造动态FC。然后,我们采用时间卷积网络(TCN)来有效地捕获具有扩张卷积的远程时间模式,其次是三个完全连接的层用于疾病预测。
    作为结果,我们发现考虑rs-fMRI时间序列数据的动态特征有利于获得更好的诊断性能。此外,以数据驱动方式生成的动态FC网络比由皮尔逊相关系数构建的网络更有信息量。
    我们通过在公共ADHD-200数据库上的大量实验验证了所提出方法的有效性,结果表明,所提出的模型在ADHD识别中优于最先进的方法。
    UNASSIGNED: Dynamic functional connectivity (dFC), which can capture the abnormality of brain activity over time in resting-state functional magnetic resonance imaging (rs-fMRI) data, has a natural advantage in revealing the abnormal mechanism of brain activity in patients with Attention Deficit/Hyperactivity Disorder (ADHD). Several deep learning methods have been proposed to learn dynamic changes from rs-fMRI for FC analysis, and achieved superior performance than those using static FC. However, most existing methods only consider dependencies of two adjacent timestamps, which is limited when the change is related to the course of many timestamps.
    UNASSIGNED: In this paper, we propose a novel Temporal Dependence neural Network (TDNet) for FC representation learning and temporal-dependence relationship tracking from rs-fMRI time series for automated ADHD identification. Specifically, we first partition rs-fMRI time series into a sequence of consecutive and non-overlapping segments. For each segment, we design an FC generation module to learn more discriminative representations to construct dynamic FCs. Then, we employ the Temporal Convolutional Network (TCN) to efficiently capture long-range temporal patterns with dilated convolutions, followed by three fully connected layers for disease prediction.
    UNASSIGNED: As the results, we found that considering the dynamic characteristics of rs-fMRI time series data is beneficial to obtain better diagnostic performance. In addition, dynamic FC networks generated in a data-driven manner are more informative than those constructed by Pearson correlation coefficients.
    UNASSIGNED: We validate the effectiveness of the proposed approach through extensive experiments on the public ADHD-200 database, and the results demonstrate the superiority of the proposed model over state-of-the-art methods in ADHD identification.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号