Mine flooding accidents have occurred frequently in recent years, and the predicting of mine water inflow is one of the most crucial flood warning indicators. Further, the mine water inflow is characterized by non-linearity and instability, making it difficult to predict. Accordingly, we propose a time series prediction model based on the fusion of the Transformer algorithm, which relies on self-attention, and the LSTM algorithm, which captures long-term dependencies. In this paper, Baotailong mine water inflow in Heilongjiang Province is used as sample data, and the sample data is divided into different ratios of the training set and test set in order to obtain optimal prediction results. In this study, we demonstrate that the LSTM-Transformer model exhibits the highest training accuracy when the ratio is 7:3. To improve the efficiency of search, the combination of random search and Bayesian optimization is used to determine the network model parameters and regularization parameters. Finally, in order to verify the accuracy of the LSTM-Transformer model, the LSTM-Transformer model is compared with LSTM, CNN, Transformer and CNN-LSTM models. The results prove that LSTM-Transformer has the highest prediction accuracy, and all the indicators of its model are well improved.

Estimating cognitive workload levels is an emerging research topic in the cognitive neuroscience domain, as participants\' performance is highly influenced by cognitive overload or underload results. Different physiological measures such as Electroencephalography (EEG), Functional Magnetic Resonance Imaging, Functional near-infrared spectroscopy, respiratory activity, and eye activity are efficiently used to estimate workload levels with the help of machine learning or deep learning techniques. Some reviews focus only on EEG-based workload estimation using machine learning classifiers or multimodal fusion of different physiological measures for workload estimation. However, a detailed analysis of all physiological measures for estimating cognitive workload levels still needs to be discovered. Thus, this survey highlights the in-depth analysis of all the physiological measures for assessing cognitive workload. This survey emphasizes the basics of cognitive workload, open-access datasets, the experimental paradigm of cognitive tasks, and different measures for estimating workload levels. Lastly, we emphasize the significant findings from this review and identify the open challenges. In addition, we also specify future scopes for researchers to overcome those challenges.

Loop diuretics are prevailing drugs to manage fluid overload in heart failure. However, adjusting to loop diuretic doses is strenuous due to the lack of a diuretic guideline. Accordingly, we developed a novel clinician decision support system for adjusting loop diuretics dosage with a Long Short-Term Memory (LSTM) algorithm using time-series EMRs. Weight measurements were used as the target to estimate fluid loss during diuretic therapy. We designed the TSFD-LSTM, a bi-directional LSTM model with an attention mechanism, to forecast weight change 48 h after heart failure patients were injected with loop diuretics. The model utilized 65 variables, including disease conditions, concurrent medications, laboratory results, vital signs, and physical measurements from EMRs. The framework processed four sequences simultaneously as inputs. An ablation study on attention mechanisms and a comparison with the transformer model as a baseline were conducted. The TSFD-LSTM outperformed the other models, achieving 85% predictive accuracy with MAE and MSE values of 0.56 and 1.45, respectively. Thus, the TSFD-LSTM model can aid in personalized loop diuretic treatment and prevent adverse drug events, contributing to improved healthcare efficacy for heart failure patients.

Thailand\'s hospitals face overcrowding, particularly with non-communicable disease (NCD) patients, due to a doctor shortage and an aging population. Most literature showed implementation merely on web or mobile application to teleconsult with physicians. Instead, in this work, we developed and implemented a telemedicine health kiosk system embedded with non-invasive biosensors and time-series predictors to improve NCD indicators over an eight-month period. Two cohorts were randomly selected: a control group with usual care and a telemedicine-using group. The telemedicine-using group showed significant improvements in average fasting blood glucose (148 to 130 mg/dL) and systolic blood pressure (152 to 138 mmHg). Data mining with the Apriori algorithm revealed correlations between diseases, occupations, and environmental factors, informing public health policies. Communication between kiosks and servers used LoRa, 5G, and IEEE802.11, which are selected based on the distance and signal availability. The results support telemedicine kiosks as effective for NCD management, significantly improving key NCD indicators, average blood glucose, and blood pressure.

To ensure the safe operation and dispatching control of a low-voltage distributed photovoltaic (PV) power distribution network (PDN), the load forecasting problem of the PDN is studied in this study. Based on deep learning technology, this paper proposes a robot-assisted load forecasting method for low-voltage distributed photovoltaic power distribution networks using enhanced long short-term memory (LSTM). This method employs the frequency domain decomposition (FDD) to obtain boundary points and incorporates a dense layer following the LSTM layer to better extract data features. The LSTM is used to predict low-frequency and high-frequency components separately, enabling the model to precisely capture the voltage variation patterns across different frequency components, thereby achieving high-precision voltage prediction. By verifying the historical operation data set of a low-voltage distributed PV-PDN in Guangdong Province, experimental results demonstrate that the proposed \"FDD+LSTM\" model outperforms both recurrent neural network and support vector machine models in terms of prediction accuracy on both time scales of 1 h and 4 h. Precisely forecast the voltage in different seasons and time scales, which has a certain value in promoting the development of the PDN and related technology industry chain.

Small Proteins (SPs) are pivotal in various cellular functions such as immunity, defense, and communication. Despite their significance, identifying them is still in its infancy. Existing computational tools are tailored to specific eukaryotic species, leaving only a few options for SP identification in prokaryotes. In addition, these existing tools still have suboptimal performance in SP identification. To fill this gap, we introduce PSPI, a deep learning-based approach designed specifically for predicting prokaryotic SPs. We showed that PSPI had a high accuracy in predicting generalized sets of prokaryotic SPs and sets specific to the human metagenome. Compared with three existing tools, PSPI was faster and showed greater precision, sensitivity, and specificity not only for prokaryotic SPs but also for eukaryotic ones. We also observed that the incorporation of (n, k)-mers greatly enhances the performance of PSPI, suggesting that many SPs may contain short linear motifs. The PSPI tool, which is freely available at https://www.cs.ucf.edu/∼xiaoman/tools/PSPI/, will be useful for studying SPs as a tool for identifying prokaryotic SPs and it can be trained to identify other types of SPs as well.

The ongoing transition within the Chinese economy assumes a pivotal role in shaping the landscape of the cultural and creative industries (CCI). Renowned for its environmentally sustainable attributes, coupled with high productivity, CCI has garnered considerable attention across diverse societal strata. This study endeavors to delineate the determinants influencing the developmental trajectory of CCI, with a focal point on City A as the primary subject of investigation, juxtaposed against Cities G, D, B, H, and X for comparative analysis, leveraging developmental data from the year 2021. Initially, the study elucidates the conceptual framework underpinning CCI and its intrinsic significance in facilitating urban metamorphosis. Subsequently, the positive impact of CCI through deep learning and information management technology is emphasized, and a cultural and creative recommendation model based on LSTM algorithm is constructed. Through performance evaluation, the recommendation accuracy for cultural and creative projects reaches 94.74 %. A robust developmental assessment model for CCI is then constructed via meticulous factor analysis of pertinent influencers. Employing factor analysis techniques, the study identifies two primary determinants exerting sway over CCI development: sustainable profitability factors and cultural influence factors. Noteworthy among the factors influencing CCI development within City A are fixed asset investment, cultural industry financing, the proliferation of university-based research institutions, and per capita cultural expenditure by residents. Of these, fixed asset investment, cultural industry financing, and the density of university research institutions prominently impinge upon sustainable profitability, with a discernible impact weight of 0.738 in the evaluative framework of CCI development, thus significantly shaping its trajectory. Moreover, consumer psychological factors, particularly market consumption patterns, are observed to exert a discernible influence on CCI evolution. This study augurs fresh insights into the realm of CCI development, infusing it with renewed vigor and vitality. Moreover, it underscores the inherent interdependence and positive correlation among the various research factors, offering novel perspectives and methodologies germane to the advancement of urban CCI.

The current flood forecasting models heavily rely on historical measured data, which is often insufficient for robust predictions due to practical challenges such as high measurement costs and data scarcity. This study introduces a novel hybrid approach that synergistically combines the outputs of traditional physical-based models with historical data to train Long Short-Term Memory (LSTM) networks. Specifically, the NAM hydrological model and the HD hydraulic model are employed to simulate flood processes. Focusing on the Jinhua basin, a typical plains river area in China, this research evaluates the efficacy of LSTM models trained on measured, mixed, and simulated datasets. The LSTM architecture includes multiple layers, with optimized hyperparameters tailored for flood forecasting. Key performance indicators such as Root Mean Square Error (RMSE), Mean Absolute Error (MAE), and Peak-relative Error (PRE) are employed to assess the predictive accuracy of the models. The findings demonstrate that LSTM models trained on mixed datasets with a simulated-to-measured data ratio of less than 2:1 consistently achieve superior performance, exhibiting significantly lower RMSE and MAE values compared to models trained on mixed data with larger data ratios. This highlights the advantage of integrating measured and simulated data, leveraging the strengths of both data types to enhance model accuracy. Despite its advantages, the approach has limitations, including dependence on the quality of simulated data and potential computational complexity. However, the development of this hybrid model marks a significant advancement in flood forecasting, offering a promising solution to the challenges of computational efficiency and data scarcity. Potential applications of this approach include real-time flood prediction and risk management in other flood-prone regions, providing a robust framework for integrating diverse data sources to improve forecasting accuracy.

Sentiment analysis also referred to as opinion mining, plays a significant role in automating the identification of negative, positive, or neutral sentiments expressed in textual data. The proliferation of social networks, review sites, and blogs has rendered these platforms valuable resources for mining opinions. Sentiment analysis finds applications in various domains and languages, including English and Arabic. However, Arabic presents unique challenges due to its complex morphology characterized by inflectional and derivation patterns. To effectively analyze sentiment in Arabic text, sentiment analysis techniques must account for this intricacy. This paper proposes a model designed using the transformer model and deep learning (DL) techniques. The word embedding is represented by Transformer-based Model for Arabic Language Understanding (ArabBert), and then passed to the AraBERT model. The output of AraBERT is subsequently fed into a Long Short-Term Memory (LSTM) model, followed by feedforward neural networks and an output layer. AraBERT is used to capture rich contextual information and LSTM to enhance sequence modeling and retain long-term dependencies within the text data. We compared the proposed model with machine learning (ML) algorithms and DL algorithms, as well as different vectorization techniques: term frequency-inverse document frequency (TF-IDF), ArabBert, Continuous Bag-of-Words (CBOW), and skipGrams using four Arabic benchmark datasets. Through extensive experimentation and evaluation of Arabic sentiment analysis datasets, we showcase the effectiveness of our approach. The results underscore significant improvements in sentiment analysis accuracy, highlighting the potential of leveraging transformer models for Arabic Sentiment Analysis. The outcomes of this research contribute to advancing Arabic sentiment analysis, enabling more accurate and reliable sentiment analysis in Arabic text. The findings reveal that the proposed framework exhibits exceptional performance in sentiment classification, achieving an impressive accuracy rate of over 97%.

Huge waves caused by typhoons often induce severe disasters along coastal areas, making the effective prediction of typhoon-induced waves a crucial research issue for researchers. In recent years, the development of the Internet of Underwater Things (IoUT) has rapidly increased the prediction of oceanic environmental disasters. Past studies have utilized meteorological data and feedforward neural networks (e.g., BPNN) with static network structures to establish short lead time (e.g., 1 h) typhoon wave prediction models for the coast of Taiwan. However, sufficient lead time for prediction remains essential for preparedness, early warning, and response to minimize the loss of lives and properties during typhoons. The aim of this research is to construct a novel long lead time typhoon-induced wave prediction model using Long Short-Term Memory (LSTM), which incorporates a dynamic network structure. LSTM can capture long-term information through its recurrent structure and selectively retain necessary signals using memory gates. Compared to earlier studies, this method extends the prediction lead time and significantly improves the learning and generalization capability, thereby enhancing prediction accuracy markedly.