Long short-term memory

长期短期记忆
  • 文章类型: Journal Article
    四旋翼无人机(QUAV)由于其出色的垂直起降(VTOL)能力而吸引了大量研究热点。这项研究解决了在面对外部干扰时在QUAV系统中保持精确轨迹跟踪的挑战,基于滑模技术的双层控制系统。对于位置控制,这种方法利用虚拟滑动模式控制信号来提高跟踪精度,并包括自适应机制来调整质量和外部干扰的变化。在控制姿态子系统时,该方法采用滑模控制框架,确保系统稳定性和对中间命令的遵从性,消除了对惯性矩阵精确模型的依赖。此外,这项研究采用了一种深度学习方法,该方法将粒子群优化(PSO)与长短期记忆(LSTM)网络相结合,以预见和减轻轨迹跟踪误差,从而大大提高了任务行动的可靠性和安全性。通过全面的数值仿真验证了该创新控制策略的鲁棒性和有效性。
    Quadrotor unmanned aerial vehicles (QUAVs) have attracted significant research focus due to their outstanding Vertical Take-Off and Landing (VTOL) capabilities. This research addresses the challenge of maintaining precise trajectory tracking in QUAV systems when faced with external disturbances by introducing a robust, two-tier control system based on sliding mode technology. For position control, this approach utilizes a virtual sliding mode control signal to enhance tracking precision and includes adaptive mechanisms to adjust for changes in mass and external disruptions. In controlling the attitude subsystem, the method employs a sliding mode control framework that secures system stability and compliance with intermediate commands, eliminating the reliance on precise models of the inertia matrix. Furthermore, this study incorporates a deep learning approach that combines Particle Swarm Optimization (PSO) with the Long Short-Term Memory (LSTM) network to foresee and mitigate trajectory tracking errors, thereby significantly enhancing the reliability and safety of mission operations. The robustness and effectiveness of this innovative control strategy are validated through comprehensive numerical simulations.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    紫外可见(UV-Vis)吸收光谱,由于其高灵敏度和实时在线监测能力,是雨水管网外部水快速识别最有前途的工具之一。然而,获取实际样品的困难导致实际样品不足,废水成分复杂,影响雨水管网外部水的准确溯源分析。在这项研究中,提出了一种识别少量样本雨水管网外部水的新方法。在这种方法中,生成对抗网络(GAN)算法最初用于从水样的吸收光谱中生成光谱数据;随后,应用乘法散射校正(MSC)算法处理不同类型水样的紫外-可见吸收光谱,采用变分模态分解(VMD)算法对MSC后的光谱进行分解和重组;利用长短期记忆(LSTM)算法建立重组光谱与水源类型的识别模型,研究结果表明,当分解光谱数K为5时,对于不同来源的生活污水,地表水,工业废水最高,总体准确率为98.81%。此外,通过混合水样(雨水和生活污水的组合,雨水和地表水,以及雨水和工业废水)。结果表明,该方法识别雨水外部水源的准确率达到98.99%,检测时间在10s内。因此,所提出的方法可以成为雨水管网外部水的快速识别和可追溯性分析的潜在方法。
    Ultraviolet-visible (UV-Vis) absorption spectroscopy, due to its high sensitivity and capability for real-time online monitoring, is one of the most promising tools for the rapid identification of external water in rainwater pipe networks. However, difficulties in obtaining actual samples lead to insufficient real samples, and the complex composition of wastewater can affect the accurate traceability analysis of external water in rainwater pipe networks. In this study, a new method for identifying external water in rainwater pipe networks with a small number of samples is proposed. In this method, the Generative Adversarial Network (GAN) algorithm was initially used to generate spectral data from the absorption spectra of water samples; subsequently, the multiplicative scatter correction (MSC) algorithm was applied to process the UV-Vis absorption spectra of different types of water samples; following this, the Variational Mode Decomposition (VMD) algorithm was employed to decompose and recombine the spectra after MSC; and finally, the long short-term memory (LSTM) algorithm was used to establish the identification model between the recombined spectra and the water source types, and to determine the optimal number of decomposed spectra K. The research results show that when the number of decomposed spectra K is 5, the identification accuracy for different sources of domestic sewage, surface water, and industrial wastewater is the highest, with an overall accuracy of 98.81%. Additionally, the performance of this method was validated by mixed water samples (combinations of rainwater and domestic sewage, rainwater and surface water, and rainwater and industrial wastewater). The results indicate that the accuracy of the proposed method in identifying the source of external water in rainwater reaches 98.99%, with detection time within 10 s. Therefore, the proposed method can become a potential approach for rapid identification and traceability analysis of external water in rainwater pipe networks.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    近年来矿井透水事故频发,矿井涌水量预测是最关键的洪水预警指标之一。Further,矿井涌水量具有非线性和不稳定性的特点,使其难以预测。因此,提出了一种基于融合Transformer算法的时间序列预测模型,这依赖于自我注意力,和LSTM算法,它捕获了长期的依赖关系。在本文中,以黑龙江省宝泰隆矿井涌水量为样本数据,将样本数据划分为不同比例的训练集和测试集,以获得最佳的预测结果。在这项研究中,我们证明,当比率为7:3时,LSTM-Transformer模型表现出最高的训练精度。为了提高搜索效率,采用随机搜索和贝叶斯优化相结合的方法确定网络模型参数和正则化参数。最后,为了验证LSTM-Transformer模型的准确性,将LSTM-Transformer模型与LSTM进行了比较,CNN,变压器和CNN-LSTM模型。结果表明,LSTM-Transformer具有最高的预测精度,并且其模型的所有指标都得到了很好的改善。
    Mine flooding accidents have occurred frequently in recent years, and the predicting of mine water inflow is one of the most crucial flood warning indicators. Further, the mine water inflow is characterized by non-linearity and instability, making it difficult to predict. Accordingly, we propose a time series prediction model based on the fusion of the Transformer algorithm, which relies on self-attention, and the LSTM algorithm, which captures long-term dependencies. In this paper, Baotailong mine water inflow in Heilongjiang Province is used as sample data, and the sample data is divided into different ratios of the training set and test set in order to obtain optimal prediction results. In this study, we demonstrate that the LSTM-Transformer model exhibits the highest training accuracy when the ratio is 7:3. To improve the efficiency of search, the combination of random search and Bayesian optimization is used to determine the network model parameters and regularization parameters. Finally, in order to verify the accuracy of the LSTM-Transformer model, the LSTM-Transformer model is compared with LSTM, CNN, Transformer and CNN-LSTM models. The results prove that LSTM-Transformer has the highest prediction accuracy, and all the indicators of its model are well improved.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    为了确保低压分布式光伏(PV)配电网(PDN)的安全运行和调度控制,本文研究了PDN的负荷预测问题。基于深度学习技术,本文提出了一种基于增强型长短期记忆(LSTM)的低压分布式光伏配电网机器人辅助负荷预测方法。该方法采用频域分解(FDD)来获得边界点,并在LSTM层之后加入密集层,以更好地提取数据特征。LSTM用于分别预测低频和高频分量,使模型能够精确捕获不同频率分量的电压变化模式,从而实现高精度的电压预测。通过对广东省某低压分布式PV-PDN的历史运行数据集进行验证,实验结果表明,所提出的“FDDLSTM”模型在1h和4h的时间尺度上的预测精度均优于递归神经网络和支持向量机模型。对PDN及相关技术产业链的发展具有一定的推动价值。
    To ensure the safe operation and dispatching control of a low-voltage distributed photovoltaic (PV) power distribution network (PDN), the load forecasting problem of the PDN is studied in this study. Based on deep learning technology, this paper proposes a robot-assisted load forecasting method for low-voltage distributed photovoltaic power distribution networks using enhanced long short-term memory (LSTM). This method employs the frequency domain decomposition (FDD) to obtain boundary points and incorporates a dense layer following the LSTM layer to better extract data features. The LSTM is used to predict low-frequency and high-frequency components separately, enabling the model to precisely capture the voltage variation patterns across different frequency components, thereby achieving high-precision voltage prediction. By verifying the historical operation data set of a low-voltage distributed PV-PDN in Guangdong Province, experimental results demonstrate that the proposed \"FDD+LSTM\" model outperforms both recurrent neural network and support vector machine models in terms of prediction accuracy on both time scales of 1 h and 4 h. Precisely forecast the voltage in different seasons and time scales, which has a certain value in promoting the development of the PDN and related technology industry chain.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    中国经济正在进行的转型在塑造文化和创意产业(CCI)的格局中发挥着关键作用。以其环境可持续属性而闻名,再加上高生产率,CCI在不同的社会阶层中引起了相当大的关注。本研究试图描绘影响CCI发展轨迹的决定因素,以城市A为主要调查对象,与城市G并列,D,B,H,和X进行比较分析,利用2021年的发展数据。最初,该研究阐明了支撑CCI的概念框架及其在促进城市变态中的内在意义。随后,强调了CCI通过深度学习和信息管理技术的积极影响,构建了基于LSTM算法的文化创意推荐模型。通过绩效评估,文创项目推荐准确率达94.74%。然后通过对相关影响者的细致因子分析,构建了一个稳健的CCI发展评估模型。采用因子分析技术,该研究确定了影响CCI发展的两个主要决定因素:可持续盈利能力因素和文化影响因素。影响A市CCI发展的因素中值得注意的是固定资产投资,文化产业融资,大学研究机构的激增,居民人均文化支出。其中,固定资产投资,文化产业融资,大学研究机构的密度显著影响了可持续盈利能力,在CCI开发的评估框架中,可识别的影响权重为0.738,从而显著塑造了它的轨迹。此外,消费者心理因素,特别是市场消费模式,观察到对CCI演化产生明显的影响。这项研究预示着对CCI发展领域的新见解,注入新的生机和活力。此外,它强调了各种研究因素之间固有的相互依存和正相关,提供与城市CCI发展密切相关的新颖观点和方法。
    The ongoing transition within the Chinese economy assumes a pivotal role in shaping the landscape of the cultural and creative industries (CCI). Renowned for its environmentally sustainable attributes, coupled with high productivity, CCI has garnered considerable attention across diverse societal strata. This study endeavors to delineate the determinants influencing the developmental trajectory of CCI, with a focal point on City A as the primary subject of investigation, juxtaposed against Cities G, D, B, H, and X for comparative analysis, leveraging developmental data from the year 2021. Initially, the study elucidates the conceptual framework underpinning CCI and its intrinsic significance in facilitating urban metamorphosis. Subsequently, the positive impact of CCI through deep learning and information management technology is emphasized, and a cultural and creative recommendation model based on LSTM algorithm is constructed. Through performance evaluation, the recommendation accuracy for cultural and creative projects reaches 94.74 %. A robust developmental assessment model for CCI is then constructed via meticulous factor analysis of pertinent influencers. Employing factor analysis techniques, the study identifies two primary determinants exerting sway over CCI development: sustainable profitability factors and cultural influence factors. Noteworthy among the factors influencing CCI development within City A are fixed asset investment, cultural industry financing, the proliferation of university-based research institutions, and per capita cultural expenditure by residents. Of these, fixed asset investment, cultural industry financing, and the density of university research institutions prominently impinge upon sustainable profitability, with a discernible impact weight of 0.738 in the evaluative framework of CCI development, thus significantly shaping its trajectory. Moreover, consumer psychological factors, particularly market consumption patterns, are observed to exert a discernible influence on CCI evolution. This study augurs fresh insights into the realm of CCI development, infusing it with renewed vigor and vitality. Moreover, it underscores the inherent interdependence and positive correlation among the various research factors, offering novel perspectives and methodologies germane to the advancement of urban CCI.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    当前的洪水预报模型严重依赖历史实测数据,由于测量成本高和数据稀缺等实际挑战,这通常不足以进行稳健的预测。这项研究引入了一种新颖的混合方法,该方法将传统的基于物理的模型的输出与历史数据协同结合起来,以训练长短期记忆(LSTM)网络。具体来说,NAM水文模型和HD水力模型用于模拟洪水过程。围绕金华盆地,中国典型的平原河流地区,这项研究评估了在测量的基础上训练的LSTM模型的有效性,混合,和模拟数据集。LSTM架构包括多个层,具有为洪水预报量身定制的优化超参数。关键性能指标,如均方根误差(RMSE),平均绝对误差(MAE),和峰值相对误差(PRE)用于评估模型的预测准确性。研究结果表明,在模拟数据与测量数据之比小于2:1的混合数据集上训练的LSTM模型始终实现卓越的性能,与在具有更大数据比率的混合数据上训练的模型相比,表现出显著更低的RMSE和MAE值。这突出了集成测量和模拟数据的优势,利用这两种数据类型的优势来提高模型的准确性。尽管有其优势,这种方法有局限性,包括对模拟数据质量和潜在计算复杂性的依赖。然而,这种混合模型的发展标志着洪水预报的重大进步,为计算效率和数据稀缺的挑战提供了一个有前途的解决方案。这种方法的潜在应用包括实时洪水预测和其他洪水易发地区的风险管理,提供一个强大的框架,用于集成不同的数据源,以提高预测准确性。
    The current flood forecasting models heavily rely on historical measured data, which is often insufficient for robust predictions due to practical challenges such as high measurement costs and data scarcity. This study introduces a novel hybrid approach that synergistically combines the outputs of traditional physical-based models with historical data to train Long Short-Term Memory (LSTM) networks. Specifically, the NAM hydrological model and the HD hydraulic model are employed to simulate flood processes. Focusing on the Jinhua basin, a typical plains river area in China, this research evaluates the efficacy of LSTM models trained on measured, mixed, and simulated datasets. The LSTM architecture includes multiple layers, with optimized hyperparameters tailored for flood forecasting. Key performance indicators such as Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and Peak-relative Error (PRE) are employed to assess the predictive accuracy of the models. The findings demonstrate that LSTM models trained on mixed datasets with a simulated-to-measured data ratio of less than 2:1 consistently achieve superior performance, exhibiting significantly lower RMSE and MAE values compared to models trained on mixed data with larger data ratios. This highlights the advantage of integrating measured and simulated data, leveraging the strengths of both data types to enhance model accuracy. Despite its advantages, the approach has limitations, including dependence on the quality of simulated data and potential computational complexity. However, the development of this hybrid model marks a significant advancement in flood forecasting, offering a promising solution to the challenges of computational efficiency and data scarcity. Potential applications of this approach include real-time flood prediction and risk management in other flood-prone regions, providing a robust framework for integrating diverse data sources to improve forecasting accuracy.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    分娩期间的胎儿心率监测可以帮助医疗保健专业人员识别心率模式的变化。然而,指南和产科医生专业知识的差异在解释胎儿心率方面提出了挑战,包括未能承认调查结果或误解。人工智能有可能支持产科医生诊断胎儿心率异常。
    采用预处理技术来减轻丢失信号和伪影对模型的影响,利用数据增强方法来解决数据不平衡问题。介绍一种用各种时间尺度数据训练的多尺度长短期记忆神经网络,用于自动对胎儿心率进行分类。在单尺度和多尺度模型上进行了实验。
    结果表明,多尺度LSTM模型在各种性能度量方面优于常规LSTM模型。具体来说,在测试的单个模型中,采样率为10的模型显示出最高的分类精度。该模型的准确率达到85.73%,特异性为85.32%,CTU-UHB数据集上的精度为85.53%。此外,0.918的接受者工作曲线下面积表明我们的模型具有较高的可信度.
    与以前的研究相比,我们的方法在各种评估指标中表现出卓越的性能。通过将替代采样率纳入模型,我们观察到所有绩效指标的改善,包括ACC(85.73%与83.28%),SP(85.32%与82.47%),PR(85.53%与82.84%),召回(86.13%与84.09%),F1得分(85.79%vs.83.42%),和AUC(0.9180vs.0.8667)。这项研究的局限性包括对孕妇临床特征的考虑有限,以及忽略不同孕周的潜在影响。
    UNASSIGNED: Fetal heart rate monitoring during labor can aid healthcare professionals in identifying alterations in the heart rate pattern. However, discrepancies in guidelines and obstetrician expertise present challenges in interpreting fetal heart rate, including failure to acknowledge findings or misinterpretation. Artificial intelligence has the potential to support obstetricians in diagnosing abnormal fetal heart rates.
    UNASSIGNED: Employ preprocessing techniques to mitigate the effects of missing signals and artifacts on the model, utilize data augmentation methods to address data imbalance. Introduce a multi-scale long short-term memory neural network trained with a variety of time-scale data for automatically classifying fetal heart rate. Carried out experimental on both single and multi-scale models.
    UNASSIGNED: The results indicate that multi-scale LSTM models outperform regular LSTM models in various performance metrics. Specifically, in the single models tested, the model with a sampling rate of 10 exhibited the highest classification accuracy. The model achieves an accuracy of 85.73%, a specificity of 85.32%, and a precision of 85.53% on CTU-UHB dataset. Furthermore, the area under the receiver operating curve of 0.918 suggests that our model demonstrates a high level of credibility.
    UNASSIGNED: Compared to previous research, our methodology exhibits superior performance across various evaluation metrics. By incorporating alternative sampling rates into the model, we observed improvements in all performance indicators, including ACC (85.73% vs. 83.28%), SP (85.32% vs. 82.47%), PR (85.53% vs. 82.84%), recall (86.13% vs. 84.09%), F1-score (85.79% vs. 83.42%), and AUC(0.9180 vs. 0.8667). The limitations of this research include the limited consideration of pregnant women\'s clinical characteristics and disregard the potential impact of varying gestational weeks.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    桥梁交通荷载识别对于车辆超载控制以及桥梁工程的结构管理和维护具有重要意义。与传统的载荷识别方法在逆求解运动方程时总是遇到病态和同时识别多参数困难的问题不同,提出了一种基于智能传感结合智能算法的实时交通负荷监测策略。一系列钛酸铅锆传感器用于捕获梁桥的动态响应,采用长短期记忆(LSTM)神经网络,通过数据挖掘建立桥梁动态响应与交通荷载之间的映射关系。结果表明,通过将实时应变响应馈送到LSTM网络中,例如,当与实际施加的负载相比时,移动负载的速度和大小可以以高精度同时被识别。当前方法可以促进移动负载的时变特性的高效识别,并且可以提供用于服务中的桥梁的长期交通负载监测和交通控制的有用工具。
    Traffic load identification for bridges is of great significance for overloaded vehicle control as well as the structural management and maintenance in bridge engineering. Unlike the conventional load identification methods that always encounter problems of ill-condition and difficulties in identifying multi parameters simultaneously when solving the motion equations inversely, a novel strategy is proposed based on smart sensing combing intelligent algorithm for real-time traffic load monitoring. An array of lead zirconium titanate sensors is applied to capture the dynamic responses of a beam bridge, while the Long Short-Term Memory (LSTM) neural network is employed to establish the mapping relations between the dynamic responses of the bridge and the traffic load through data mining. The results reveal that, with the real-time strain responses fed into the LSTM network, the speed and magnitude of the moving load may be identified simultaneously with high accuracy when compared to the practically applied load. The current method may facilitate highly efficient identification of the time-varying characteristics of moving loads and may provide a useful tool for long-term traffic load monitoring and traffic control for in-service bridges.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    在大的空间尺度上提供准确的作物产量估算和了解极端气候胁迫下的产量损失是维持全球粮食安全的紧迫挑战。虽然数据驱动的深度学习方法在预测产量模式方面表现出了很大的能力,它检测和归因于极端气候对产量的影响的能力仍然未知。在这项研究中,我们开发了一个基于深度神经网络的多任务学习框架,以估计2006年至2018年美国玉米带县级玉米产量的变化,并特别关注2012年的极端产量损失.我们发现,我们的深度学习模型在2006-2018年(R2=0.81)具有良好的准确性,并很好地再现了2012年的极端产量异常(R2=0.79)。进一步的归因分析表明,极端热胁迫是产量损失的主要原因,造成72.5%的产量损失,其次是蒸气压不足(17.6%)和降水(10.8%)的异常。我们的深度学习模型还能够估计气候因素对玉米产量的累积影响,并确定2012年蚕丝期是影响产量对极端气候胁迫的最关键阶段。我们的研究结果提供了一个新的时空深度学习框架,以评估和归因于数据丰富时代的作物产量对气候变化的响应。
    Providing accurate crop yield estimations at large spatial scales and understanding yield losses under extreme climate stress is an urgent challenge for sustaining global food security. While the data-driven deep learning approach has shown great capacity in predicting yield patterns, its capacity to detect and attribute the impacts of climatic extremes on yields remains unknown. In this study, we developed a deep neural network based multi-task learning framework to estimate variations of maize yield at the county level over the US Corn Belt from 2006 to 2018, with a special focus on the extreme yield loss in 2012. We found that our deep learning model hindcasted the yield variations with good accuracy for 2006-2018 (R2 = 0.81) and well reproduced the extreme yield anomalies in 2012 (R2 = 0.79). Further attribution analysis indicated that extreme heat stress was the major cause for yield loss, contributing to 72.5% of the yield loss, followed by anomalies of vapor pressure deficit (17.6%) and precipitation (10.8%). Our deep learning model was also able to estimate the accumulated impact of climatic factors on maize yield and identify that the silking phase was the most critical stage shaping the yield response to extreme climate stress in 2012. Our results provide a new framework of spatio-temporal deep learning to assess and attribute the crop yield response to climate variations in the data rich era.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    这项研究建立了长期短期记忆(LSTM),卷积神经网络长短期记忆(CNN_LSTM),基于优化的鱼眼液激发发射矩阵(EEM)和径向基函数神经网络(RBFNN)预测非等温储存条件下虹鳟鱼新鲜度的变化。残差分析法,核心一致性诊断,并采用平行因子分析的分半分析来优化EEM数据,并提取了两个特征成分。LSTM,CNN_LSTM,和基于EEM特征分量的RBFNN模型用于预测新鲜度指数。结果表明,RBFNN模型的相对误差大于0.96,K值的相对误差小于10%,总可行计数,和挥发性碱氮,比LSTM和CNN_LSTM模型更好。本研究提出了一种在非等温储存条件下预测虹鳟鱼新鲜度的新方法。
    This study established long short-term memory (LSTM), convolution neural network long short-term memory (CNN_LSTM), and radial basis function neural network (RBFNN) based on optimized excitation-emission matrix (EEM) from fish eye fluid to predict freshness changes of rainbow trout under nonisothermal storage conditions. The method of residual analysis, core consistency diagnostics, and split-half analysis of parallel factor analysis was used to optimize EEM data, and two characteristic components were extracted. LSTM, CNN_LSTM, and RBFNN models based on characteristic components of EEM used to predict the freshness indices. The results demonstrated the relative errors of RBFNN models with an R2 above 0.96 and relative errors less than 10% for K-value, total viable counts, and volatile base nitrogen, which were better than those of LSTM and CNN_LSTM models. This study presents a novel approach for predicting the freshness of rainbow trout under nonisothermal storage conditions.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

公众号