Long short-term memory

长期短期记忆
  • 文章类型: Journal Article
    四旋翼无人机(QUAV)由于其出色的垂直起降(VTOL)能力而吸引了大量研究热点。这项研究解决了在面对外部干扰时在QUAV系统中保持精确轨迹跟踪的挑战,基于滑模技术的双层控制系统。对于位置控制,这种方法利用虚拟滑动模式控制信号来提高跟踪精度,并包括自适应机制来调整质量和外部干扰的变化。在控制姿态子系统时,该方法采用滑模控制框架,确保系统稳定性和对中间命令的遵从性,消除了对惯性矩阵精确模型的依赖。此外,这项研究采用了一种深度学习方法,该方法将粒子群优化(PSO)与长短期记忆(LSTM)网络相结合,以预见和减轻轨迹跟踪误差,从而大大提高了任务行动的可靠性和安全性。通过全面的数值仿真验证了该创新控制策略的鲁棒性和有效性。
    Quadrotor unmanned aerial vehicles (QUAVs) have attracted significant research focus due to their outstanding Vertical Take-Off and Landing (VTOL) capabilities. This research addresses the challenge of maintaining precise trajectory tracking in QUAV systems when faced with external disturbances by introducing a robust, two-tier control system based on sliding mode technology. For position control, this approach utilizes a virtual sliding mode control signal to enhance tracking precision and includes adaptive mechanisms to adjust for changes in mass and external disruptions. In controlling the attitude subsystem, the method employs a sliding mode control framework that secures system stability and compliance with intermediate commands, eliminating the reliance on precise models of the inertia matrix. Furthermore, this study incorporates a deep learning approach that combines Particle Swarm Optimization (PSO) with the Long Short-Term Memory (LSTM) network to foresee and mitigate trajectory tracking errors, thereby significantly enhancing the reliability and safety of mission operations. The robustness and effectiveness of this innovative control strategy are validated through comprehensive numerical simulations.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    紫外可见(UV-Vis)吸收光谱,由于其高灵敏度和实时在线监测能力,是雨水管网外部水快速识别最有前途的工具之一。然而,获取实际样品的困难导致实际样品不足,废水成分复杂,影响雨水管网外部水的准确溯源分析。在这项研究中,提出了一种识别少量样本雨水管网外部水的新方法。在这种方法中,生成对抗网络(GAN)算法最初用于从水样的吸收光谱中生成光谱数据;随后,应用乘法散射校正(MSC)算法处理不同类型水样的紫外-可见吸收光谱,采用变分模态分解(VMD)算法对MSC后的光谱进行分解和重组;利用长短期记忆(LSTM)算法建立重组光谱与水源类型的识别模型,研究结果表明,当分解光谱数K为5时,对于不同来源的生活污水,地表水,工业废水最高,总体准确率为98.81%。此外,通过混合水样(雨水和生活污水的组合,雨水和地表水,以及雨水和工业废水)。结果表明,该方法识别雨水外部水源的准确率达到98.99%,检测时间在10s内。因此,所提出的方法可以成为雨水管网外部水的快速识别和可追溯性分析的潜在方法。
    Ultraviolet-visible (UV-Vis) absorption spectroscopy, due to its high sensitivity and capability for real-time online monitoring, is one of the most promising tools for the rapid identification of external water in rainwater pipe networks. However, difficulties in obtaining actual samples lead to insufficient real samples, and the complex composition of wastewater can affect the accurate traceability analysis of external water in rainwater pipe networks. In this study, a new method for identifying external water in rainwater pipe networks with a small number of samples is proposed. In this method, the Generative Adversarial Network (GAN) algorithm was initially used to generate spectral data from the absorption spectra of water samples; subsequently, the multiplicative scatter correction (MSC) algorithm was applied to process the UV-Vis absorption spectra of different types of water samples; following this, the Variational Mode Decomposition (VMD) algorithm was employed to decompose and recombine the spectra after MSC; and finally, the long short-term memory (LSTM) algorithm was used to establish the identification model between the recombined spectra and the water source types, and to determine the optimal number of decomposed spectra K. The research results show that when the number of decomposed spectra K is 5, the identification accuracy for different sources of domestic sewage, surface water, and industrial wastewater is the highest, with an overall accuracy of 98.81%. Additionally, the performance of this method was validated by mixed water samples (combinations of rainwater and domestic sewage, rainwater and surface water, and rainwater and industrial wastewater). The results indicate that the accuracy of the proposed method in identifying the source of external water in rainwater reaches 98.99%, with detection time within 10 s. Therefore, the proposed method can become a potential approach for rapid identification and traceability analysis of external water in rainwater pipe networks.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    近年来矿井透水事故频发,矿井涌水量预测是最关键的洪水预警指标之一。Further,矿井涌水量具有非线性和不稳定性的特点,使其难以预测。因此,提出了一种基于融合Transformer算法的时间序列预测模型,这依赖于自我注意力,和LSTM算法,它捕获了长期的依赖关系。在本文中,以黑龙江省宝泰隆矿井涌水量为样本数据,将样本数据划分为不同比例的训练集和测试集,以获得最佳的预测结果。在这项研究中,我们证明,当比率为7:3时,LSTM-Transformer模型表现出最高的训练精度。为了提高搜索效率,采用随机搜索和贝叶斯优化相结合的方法确定网络模型参数和正则化参数。最后,为了验证LSTM-Transformer模型的准确性,将LSTM-Transformer模型与LSTM进行了比较,CNN,变压器和CNN-LSTM模型。结果表明,LSTM-Transformer具有最高的预测精度,并且其模型的所有指标都得到了很好的改善。
    Mine flooding accidents have occurred frequently in recent years, and the predicting of mine water inflow is one of the most crucial flood warning indicators. Further, the mine water inflow is characterized by non-linearity and instability, making it difficult to predict. Accordingly, we propose a time series prediction model based on the fusion of the Transformer algorithm, which relies on self-attention, and the LSTM algorithm, which captures long-term dependencies. In this paper, Baotailong mine water inflow in Heilongjiang Province is used as sample data, and the sample data is divided into different ratios of the training set and test set in order to obtain optimal prediction results. In this study, we demonstrate that the LSTM-Transformer model exhibits the highest training accuracy when the ratio is 7:3. To improve the efficiency of search, the combination of random search and Bayesian optimization is used to determine the network model parameters and regularization parameters. Finally, in order to verify the accuracy of the LSTM-Transformer model, the LSTM-Transformer model is compared with LSTM, CNN, Transformer and CNN-LSTM models. The results prove that LSTM-Transformer has the highest prediction accuracy, and all the indicators of its model are well improved.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    估计认知工作量水平是认知神经科学领域的一个新兴研究课题,因为参与者的表现受到认知过载或欠载结果的高度影响。不同的生理措施,如脑电图(EEG),功能磁共振成像,功能近红外光谱,呼吸活动,和眼睛活动被有效地用于在机器学习或深度学习技术的帮助下估计工作负载水平。一些评论仅关注使用机器学习分类器或用于工作量估计的不同生理度量的多模态融合的基于EEG的工作量估计。然而,仍然需要对估计认知工作量水平的所有生理指标进行详细分析。因此,这项调查强调了对评估认知工作量的所有生理指标的深入分析.这项调查强调了认知工作量的基础知识,开放存取数据集,认知任务的实验范式,以及估算工作量水平的不同衡量标准。最后,我们强调这次审查的重要结果,并确定了悬而未决的挑战。此外,我们还指定了研究人员克服这些挑战的未来范围。
    Estimating cognitive workload levels is an emerging research topic in the cognitive neuroscience domain, as participants\' performance is highly influenced by cognitive overload or underload results. Different physiological measures such as Electroencephalography (EEG), Functional Magnetic Resonance Imaging, Functional near-infrared spectroscopy, respiratory activity, and eye activity are efficiently used to estimate workload levels with the help of machine learning or deep learning techniques. Some reviews focus only on EEG-based workload estimation using machine learning classifiers or multimodal fusion of different physiological measures for workload estimation. However, a detailed analysis of all physiological measures for estimating cognitive workload levels still needs to be discovered. Thus, this survey highlights the in-depth analysis of all the physiological measures for assessing cognitive workload. This survey emphasizes the basics of cognitive workload, open-access datasets, the experimental paradigm of cognitive tasks, and different measures for estimating workload levels. Lastly, we emphasize the significant findings from this review and identify the open challenges. In addition, we also specify future scopes for researchers to overcome those challenges.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    循环利尿剂是治疗心力衰竭中液体超负荷的常用药物。然而,由于缺乏利尿剂指南,调整循环利尿剂的剂量是艰苦的。因此,我们开发了一种新型的临床医生决策支持系统,该系统使用时间序列EMR,通过长短期记忆(LSTM)算法来调整环路利尿剂剂量.重量测量值用作评估利尿剂治疗期间的流体损失的目标。我们设计了TSFD-LSTM,具有注意力机制的双向LSTM模型,预测心力衰竭患者注射loop利尿剂后48h体重变化。该模型利用了65个变量,包括疾病状况,同时用药,实验室结果,生命体征,和EMR的物理测量。框架同时处理四个序列作为输入。对注意力机制进行了消融研究,并以变压器模型为基准进行了比较。TSFD-LSTM优于其他型号,MAE和MSE值分别为0.56和1.45,可实现85%的预测精度。因此,TSFD-LSTM模型可以帮助个性化循环利尿剂治疗并预防不良药物事件,有助于改善心力衰竭患者的医疗效果。
    Loop diuretics are prevailing drugs to manage fluid overload in heart failure. However, adjusting to loop diuretic doses is strenuous due to the lack of a diuretic guideline. Accordingly, we developed a novel clinician decision support system for adjusting loop diuretics dosage with a Long Short-Term Memory (LSTM) algorithm using time-series EMRs. Weight measurements were used as the target to estimate fluid loss during diuretic therapy. We designed the TSFD-LSTM, a bi-directional LSTM model with an attention mechanism, to forecast weight change 48 h after heart failure patients were injected with loop diuretics. The model utilized 65 variables, including disease conditions, concurrent medications, laboratory results, vital signs, and physical measurements from EMRs. The framework processed four sequences simultaneously as inputs. An ablation study on attention mechanisms and a comparison with the transformer model as a baseline were conducted. The TSFD-LSTM outperformed the other models, achieving 85% predictive accuracy with MAE and MSE values of 0.56 and 1.45, respectively. Thus, the TSFD-LSTM model can aid in personalized loop diuretic treatment and prevent adverse drug events, contributing to improved healthcare efficacy for heart failure patients.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    泰国的医院面临人满为患,特别是非传染性疾病(NCD)患者,由于医生短缺和人口老龄化。大多数文献显示仅在网络或移动应用程序上实施,以与医生进行远程咨询。相反,在这项工作中,我们开发并实施了一种远程医疗健康亭系统,该系统嵌入了非侵入性生物传感器和时间序列预测因子,以在8个月内改善NCD指标.随机选择两个队列:常规护理的对照组和远程医疗使用组。远程医疗组的平均空腹血糖(148至130mg/dL)和收缩压(152至138mmHg)显着改善。利用Apriori算法进行数据挖掘,揭示疾病之间的相关性,职业,和环境因素,宣传公共卫生政策。信息亭和服务器之间的通信使用LoRa,5G,和IEEE802.11,它们是根据距离和信号可用性选择的。结果支持远程医疗亭对NCD管理有效,显著改善非传染性疾病关键指标,平均血糖,还有血压.
    Thailand\'s hospitals face overcrowding, particularly with non-communicable disease (NCD) patients, due to a doctor shortage and an aging population. Most literature showed implementation merely on web or mobile application to teleconsult with physicians. Instead, in this work, we developed and implemented a telemedicine health kiosk system embedded with non-invasive biosensors and time-series predictors to improve NCD indicators over an eight-month period. Two cohorts were randomly selected: a control group with usual care and a telemedicine-using group. The telemedicine-using group showed significant improvements in average fasting blood glucose (148 to 130 mg/dL) and systolic blood pressure (152 to 138 mmHg). Data mining with the Apriori algorithm revealed correlations between diseases, occupations, and environmental factors, informing public health policies. Communication between kiosks and servers used LoRa, 5G, and IEEE802.11, which are selected based on the distance and signal availability. The results support telemedicine kiosks as effective for NCD management, significantly improving key NCD indicators, average blood glucose, and blood pressure.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    为了确保低压分布式光伏(PV)配电网(PDN)的安全运行和调度控制,本文研究了PDN的负荷预测问题。基于深度学习技术,本文提出了一种基于增强型长短期记忆(LSTM)的低压分布式光伏配电网机器人辅助负荷预测方法。该方法采用频域分解(FDD)来获得边界点,并在LSTM层之后加入密集层,以更好地提取数据特征。LSTM用于分别预测低频和高频分量,使模型能够精确捕获不同频率分量的电压变化模式,从而实现高精度的电压预测。通过对广东省某低压分布式PV-PDN的历史运行数据集进行验证,实验结果表明,所提出的“FDDLSTM”模型在1h和4h的时间尺度上的预测精度均优于递归神经网络和支持向量机模型。对PDN及相关技术产业链的发展具有一定的推动价值。
    To ensure the safe operation and dispatching control of a low-voltage distributed photovoltaic (PV) power distribution network (PDN), the load forecasting problem of the PDN is studied in this study. Based on deep learning technology, this paper proposes a robot-assisted load forecasting method for low-voltage distributed photovoltaic power distribution networks using enhanced long short-term memory (LSTM). This method employs the frequency domain decomposition (FDD) to obtain boundary points and incorporates a dense layer following the LSTM layer to better extract data features. The LSTM is used to predict low-frequency and high-frequency components separately, enabling the model to precisely capture the voltage variation patterns across different frequency components, thereby achieving high-precision voltage prediction. By verifying the historical operation data set of a low-voltage distributed PV-PDN in Guangdong Province, experimental results demonstrate that the proposed \"FDD+LSTM\" model outperforms both recurrent neural network and support vector machine models in terms of prediction accuracy on both time scales of 1 h and 4 h. Precisely forecast the voltage in different seasons and time scales, which has a certain value in promoting the development of the PDN and related technology industry chain.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    小蛋白(SP)在各种细胞功能,如免疫,防御,和沟通。尽管意义重大,识别它们仍处于起步阶段。现有的计算工具是为特定的真核生物物种量身定制的,在原核生物中只剩下一些SP识别的选择。此外,这些现有工具在SP识别方面仍然存在次优性能。为了填补这个空白,我们介绍PSPI,一种基于深度学习的方法,专门用于预测原核SPs。我们表明,PSPI在预测原核SP的广义集和人宏基因组特异性集上具有很高的准确性。与现有的三种工具相比,PSPI速度更快,精度更高,灵敏度,不仅对原核SP而且对真核SP都具有特异性。我们还观察到(n,k)-mers大大提高了PSPI的性能,这表明许多SP可能包含短线性基序。PSPI工具,可在https://www上免费获得。UCF.edu/joxiaoman/工具/PSPI/,将有助于研究SPs作为鉴定原核SPs的工具,它也可以被训练来鉴定其他类型的SPs。
    Small Proteins (SPs) are pivotal in various cellular functions such as immunity, defense, and communication. Despite their significance, identifying them is still in its infancy. Existing computational tools are tailored to specific eukaryotic species, leaving only a few options for SP identification in prokaryotes. In addition, these existing tools still have suboptimal performance in SP identification. To fill this gap, we introduce PSPI, a deep learning-based approach designed specifically for predicting prokaryotic SPs. We showed that PSPI had a high accuracy in predicting generalized sets of prokaryotic SPs and sets specific to the human metagenome. Compared with three existing tools, PSPI was faster and showed greater precision, sensitivity, and specificity not only for prokaryotic SPs but also for eukaryotic ones. We also observed that the incorporation of (n, k)-mers greatly enhances the performance of PSPI, suggesting that many SPs may contain short linear motifs. The PSPI tool, which is freely available at https://www.cs.ucf.edu/∼xiaoman/tools/PSPI/, will be useful for studying SPs as a tool for identifying prokaryotic SPs and it can be trained to identify other types of SPs as well.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    由于商品销售成本的不断增加,制药业面临着几个挑战,数据驱动决策的正确首次原则对于维持竞争力变得更加紧迫。因此,在这项工作中,开发了三种不同类型的人工神经网络(ANN)模型,比较,并通过分析来自实际药品制片生产过程的开放获取数据集来解释。首先,多层感知器(MLP)模型用于根据20个原材料属性和25个统计描述符描述整个制表过程中收集的时间序列数据的总废物(例如,压片速度和压缩力)。然后使用除了原材料属性之外的10个过程时间序列数据,累积的废物,制造过程中还通过长期短期记忆(LSTM)和双向LSTM(biLSTM)递归神经网络(RNN)进行预测.LSTM网络用于预测废物产生情况,以采取预防措施。结果表明,RNN能够预测废物轨迹,最佳模型导致1096和2174片训练和测试均方根误差,分别。为了更好地理解这个过程,和模型,并帮助决策支持系统和控制策略,对所有ANN实施了解释方法,通过识别最有影响力的材料属性和工艺参数,增加了对工艺的理解。所提出的方法适用于制药多个领域的各种关键质量属性,因此是实现Pharma4.0概念的有用工具。
    Due to the continuously increasing Cost of Goods Sold, the pharmaceutical industry has faced several challenges, and the Right First-Time principle with data-driven decision-making has become more pressing to sustain competitiveness. Thus, in this work, three different types of artificial neural network (ANN) models were developed, compared, and interpreted by analyzing an open-access dataset from a real pharmaceutical tableting production process. First, the multilayer perceptron (MLP) model was used to describe the total waste based on 20 raw material properties and 25 statistical descriptors of the time series data collected throughout the tableting (e.g., tableting speed and compression force). Then using 10 process time series data in addition to the raw material properties, the cumulative waste, during manufacturing was also predicted by long short-term memory (LSTM) and bidirectional LSTM (biLSTM) recurrent neural networks (RNN). The LSTM network was used to forecast the waste production profile to allow preventive actions. The results showed that RNNs were able to predict the waste trajectory, the best model resulting in 1096 and 2174 tablets training and testing root mean squared errors, respectively. For a better understanding of the process, and the models and to help the decision-support systems and control strategies, interpretation methods were implemented for all ANNs, which increased the process understanding by identifying the most influential material attributes and process parameters. The presented methodology is applicable to various critical quality attributes in several fields of pharmaceutics and therefore is a useful tool for realizing the Pharma 4.0 concept.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    中国经济正在进行的转型在塑造文化和创意产业(CCI)的格局中发挥着关键作用。以其环境可持续属性而闻名,再加上高生产率,CCI在不同的社会阶层中引起了相当大的关注。本研究试图描绘影响CCI发展轨迹的决定因素,以城市A为主要调查对象,与城市G并列,D,B,H,和X进行比较分析,利用2021年的发展数据。最初,该研究阐明了支撑CCI的概念框架及其在促进城市变态中的内在意义。随后,强调了CCI通过深度学习和信息管理技术的积极影响,构建了基于LSTM算法的文化创意推荐模型。通过绩效评估,文创项目推荐准确率达94.74%。然后通过对相关影响者的细致因子分析,构建了一个稳健的CCI发展评估模型。采用因子分析技术,该研究确定了影响CCI发展的两个主要决定因素:可持续盈利能力因素和文化影响因素。影响A市CCI发展的因素中值得注意的是固定资产投资,文化产业融资,大学研究机构的激增,居民人均文化支出。其中,固定资产投资,文化产业融资,大学研究机构的密度显著影响了可持续盈利能力,在CCI开发的评估框架中,可识别的影响权重为0.738,从而显著塑造了它的轨迹。此外,消费者心理因素,特别是市场消费模式,观察到对CCI演化产生明显的影响。这项研究预示着对CCI发展领域的新见解,注入新的生机和活力。此外,它强调了各种研究因素之间固有的相互依存和正相关,提供与城市CCI发展密切相关的新颖观点和方法。
    The ongoing transition within the Chinese economy assumes a pivotal role in shaping the landscape of the cultural and creative industries (CCI). Renowned for its environmentally sustainable attributes, coupled with high productivity, CCI has garnered considerable attention across diverse societal strata. This study endeavors to delineate the determinants influencing the developmental trajectory of CCI, with a focal point on City A as the primary subject of investigation, juxtaposed against Cities G, D, B, H, and X for comparative analysis, leveraging developmental data from the year 2021. Initially, the study elucidates the conceptual framework underpinning CCI and its intrinsic significance in facilitating urban metamorphosis. Subsequently, the positive impact of CCI through deep learning and information management technology is emphasized, and a cultural and creative recommendation model based on LSTM algorithm is constructed. Through performance evaluation, the recommendation accuracy for cultural and creative projects reaches 94.74 %. A robust developmental assessment model for CCI is then constructed via meticulous factor analysis of pertinent influencers. Employing factor analysis techniques, the study identifies two primary determinants exerting sway over CCI development: sustainable profitability factors and cultural influence factors. Noteworthy among the factors influencing CCI development within City A are fixed asset investment, cultural industry financing, the proliferation of university-based research institutions, and per capita cultural expenditure by residents. Of these, fixed asset investment, cultural industry financing, and the density of university research institutions prominently impinge upon sustainable profitability, with a discernible impact weight of 0.738 in the evaluative framework of CCI development, thus significantly shaping its trajectory. Moreover, consumer psychological factors, particularly market consumption patterns, are observed to exert a discernible influence on CCI evolution. This study augurs fresh insights into the realm of CCI development, infusing it with renewed vigor and vitality. Moreover, it underscores the inherent interdependence and positive correlation among the various research factors, offering novel perspectives and methodologies germane to the advancement of urban CCI.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号