CircRNAs play vital roles in biological system mainly through binding RNA-binding protein (RBP), which is essential for regulating physiological processes in vivo and for identifying causal disease variants. Therefore, predicting interactions between circRNA and RBP is a critical step for the discovery of new therapeutic agents. Application of various deep-learning models in bioinformatics has significantly improved prediction and classification performance. However, most of existing prediction models are only applicable to specific type of RNA or RNA with simple characteristics. In this study, we proposed an attractive deep learning model, MSTCRB, based on transformer and attention mechanism for extracting multi-scale features to predict circRNA-RBP interactions. Therein, K-mer and KNF encoding are employed to capture the global sequence features of circRNA, NCP and DPCP encoding are utilized to extract local sequence features, and the CDPfold method is applied to extract structural features. In order to improve prediction performance, optimized transformer framework and attention mechanism were used to integrate these multi-scale features. We compared our model\'s performance with other five state-of-the-art methods on 37 circRNA datasets and 31 linear RNA datasets. The results show that the average AUC value of MSTCRB reaches 98.45 %, which is better than other comparative methods. All of above datasets are deposited in https://github.com/chy001228/MSTCRB_database.git and source code are available from https://github.com/chy001228/MSTCRB.git.

Vehicular edge computing (VEC), a promising paradigm for the development of emerging intelligent transportation systems, can provide lower service latency for vehicular applications. However, it is still a challenge to fulfill the requirements of such applications with stringent latency requirements in the VEC system with limited resources. In addition, existing methods focus on handling the offloading task in a certain time slot with statically allocated resources, but ignore the heterogeneous tasks\' different resource requirements, resulting in resource wastage. To solve the real-time task offloading and heterogeneous resource allocation problem in VEC system, we propose a decentralized solution based on the attention mechanism and recurrent neural networks (RNN) with a multi-agent distributed deep deterministic policy gradient (AR-MAD4PG). First, to address the partial observability of agents, we construct a shared agent graph and propose a periodic communication mechanism that enables edge nodes to aggregate information from other edge nodes. Second, to help agents better understand the current system state, we design an RNN-based feature extraction network to capture the historical state and resource allocation information of the VEC system. Thirdly, to tackle the challenges of excessive joint observation-action space and ineffective information interference, we adopt the multi-head attention mechanism to compress the dimension of the observation-action space of agents. Finally, we build a simulation model based on the actual vehicle trajectories, and the experimental results show that our proposed method outperforms the existing approaches.

Radar observation variables reflect the precipitation amount of strong convective precipitation processes, which accurate forecast is an important difficulty in weather forecasting. Current forecasting methods are mostly based on radar echo extrapolation, which has the insufficiency of input information and the ineffectiveness of model architecture. This paper presents a Bidirectional Long Short-Term Memory forecasting method for strong convective precipitation based on the attention mechanism and residual neural network (ResNet-Attention-BiLSTM). First, this paper uses ResNet to effectively extract the key information of extreme weather and solves the problem of regression to the mean of the prediction model by learning the residuals of the radar observation data. Second, this paper uses the attention mechanism to adaptively weight the fusion of the features to enhance the extraction of the important features of the precipitation image data. On this basis, this paper presents a novel spatio-temporal reasoning method for radar observations and establishes a precipitation forecasting model, which captures the past and future time-order relationship of the sequence data. Finally, this paper conducts experiments based on the real collected data of a strong convective precipitation process and compares its performance with the existing models, the mean absolute percentage error of this model was reduced by 15.94% (1 km), 18.72% (3 km), and 14.91% (7 km), and the coefficient of determination ( R 2 ) was increased by 10.89% (1 km), 9.61% (3 km), and 9.29% (7 km), which proves the state of the art and effectiveness of this forecasting model.

Identification of high consequence areas is an important task in pipeline integrity management. However, traditional identification methods are generally characterized by low efficiency, high cost and low accuracy. For this reason, this paper proposes a recognition method based on the improved algorithm Mask Region-based Convolutional Neural Network. Coordinate attention mechanism module is introduced into the traditional Mask R-CNN algorithm to improve the recognition accuracy and reduce the training time. For the identification results, GIS tools are utilized to establish high consequence zones along both sides of the pipeline, and the grade and scope of the high consequence zones are determined according to relevant specifications.In this paper, this method is used to identify the high-consequence area of a pipeline section in Guangdong Province, the results show that: 1, the improved algorithm in the identification of densely populated, geologic hazards, flammable and explosive high consequence zones of the average accuracy of the identification of 1.7%, 3.4%, 3.9%. 2, The method in this paper identifies 8 more building elements and 0.311 more kilometers of pipeline mileage compared to traditional identification methods. The method of this paper can provide a reference for the early identification of high consequence areas of pipelines.

OBJECTIVE: Myocardial contrast echocardiography (MCE) plays a crucial role in diagnosing ischemia, infarction, masses and other cardiac conditions. In the realm of MCE image analysis, accurate and consistent myocardial segmentation results are essential for enabling automated analysis of various heart diseases. However, current manual diagnostic methods in MCE suffer from poor repeatability and limited clinical applicability. MCE images often exhibit low quality and high noise due to the instability of ultrasound signals, while interference structures can further disrupt segmentation consistency.
METHODS: To overcome these challenges, we proposed a deep-learning network for the segmentation of MCE. This architecture leverages dilated convolutions to capture high-scale information without sacrificing positional accuracy and modifies multi-head self-attention to enhance global context and ensure consistency, effectively overcoming issues related to low image quality and interference. Furthermore, we also adapted the cascade application of transformers with convolutional neural networks for improved segmentation in MCE.
RESULTS: In our experiments, our architecture achieved the best Dice score of 84.35% for standard MCE views compared with that of several state-of-the-art segmentation models. For non-standard views and frames with interfering structures (mass), our models also attained the best Dice scores of 83.33% and 83.97%, respectively.
CONCLUSIONS: These studies proved that our architecture is of excellent shape consistency and robustness, which allows it to deal with segmentation of various types of MCE. Our relatively precise and consistent myocardial segmentation results provide fundamental conditions for the automated analysis of various heart diseases, with the potential to discover underlying pathological features and reduce healthcare costs.

UNASSIGNED: Plant height is a significant indicator of maize phenotypic morphology, and is closely related to crop growth, biomass, and lodging resistance. Obtaining the maize plant height accurately is of great significance for cultivating high-yielding maize varieties. Traditional measurement methods are labor-intensive and not conducive to data recording and storage. Therefore, it is very essential to implement the automated reading of maize plant height from measurement scales using object detection algorithms.
UNASSIGNED: This study proposed a lightweight detection model based on the improved YOLOv5. The MobileNetv3 network replaced the YOLOv5 backbone network, and the Normalization-based Attention Module attention mechanism module was introduced into the neck network. The CioU loss function was replaced with the EioU loss function. Finally, a combined algorithm was used to achieve the automatic reading of maize plant height from measurement scales.
UNASSIGNED: The improved model achieved an average precision of 98.6%, a computational complexity of 1.2 GFLOPs, and occupied 1.8 MB of memory. The detection frame rate on the computer was 54.1 fps. Through comparisons with models such as YOLOv5s, YOLOv7 and YOLOv8s, it was evident that the comprehensive performance of the improved model in this study was superior. Finally, a comparison between the algorithm\'s 160 plant height data obtained from the test set and manual readings demonstrated that the relative error between the algorithm\'s results and manual readings was within 0.2 cm, meeting the requirements of automatic reading of maize height measuring scale.

In this paper, the degradation of PEMFC under different operating conditions in dynamic cycle condition is studied. Firstly, according to the failure mechanism of PEMFC, various operating conditions in dynamic cycle condition are classified, and the health indexes are established. Simultaneously, the rates and degrees of the output voltage decline of the PEMFC under different operating conditions during the dynamic cycling process were compared. Then, a model based on variational mode decomposition and long short-term memory with attention mechanism (VMD-LSTM-ATT) is proposed. Aiming at the performance of PEMFC is affected by the external operation, VMD is used to capture the global information and details, and filter out interference information. To improve the prediction accuracy, ATT is used to assign weight to the features. Finally, in order to verify the effectiveness and superiority of VMD-LSTM-ATT, we respectively apply it to three current conditions under dynamic cycle conditions. The experimental results show that under the same test conditions, RMSE of VMD-LSTM-ATT is increased by 56.11 % and MAE is increased by 28.26 % compared with GRU attention. Compared with SVM, RNN, LSTM and LSTM-ATT, RMSE of VMD-LSTM-ATT is at least 17.26 % higher and MAE is at least 5.65 % higher.

UNASSIGNED: The automated classification of histological images is crucial for the diagnosis of cancer. The limited availability of well-annotated datasets, especially for rare cancers, poses a significant challenge for deep learning methods due to the small number of relevant images. This has led to the development of few-shot learning approaches, which bear considerable clinical importance, as they are designed to overcome the challenges of data scarcity in deep learning for histological image classification. Traditional methods often ignore the challenges of intraclass diversity and interclass similarities in histological images. To address this, we propose a novel mutual reconstruction network model, aimed at meeting these challenges and improving the few-shot classification performance of histological images.
UNASSIGNED: The key to our approach is the extraction of subtle and discriminative features. We introduce a feature enhancement module (FEM) and a mutual reconstruction module to increase differences between classes while reducing variance within classes. First, we extract features of support and query images using a feature extractor. These features are then processed by the FEM, which uses a self-attention mechanism for self-reconstruction of features, enhancing the learning of detailed features. These enhanced features are then input into the mutual reconstruction module. This module uses enhanced support features to reconstruct enhanced query features and vice versa. The classification of query samples is based on weighted calculations of the distances between query features and reconstructed query features and between support features and reconstructed support features.
UNASSIGNED: We extensively evaluated our model using a specially created few-shot histological image dataset. The results showed that in a 5-way 10-shot setup, our model achieved an impressive accuracy of 92.09%. This is a 23.59% improvement in accuracy compared to the model-agnostic meta-learning (MAML) method, which does not focus on fine-grained attributes. In the more challenging, 5-way 1-shot setting, our model also performed well, demonstrating a 18.52% improvement over the ProtoNet, which does not address this challenge. Additional ablation studies indicated the effectiveness and complementary nature of each module and confirmed our method\'s ability to parse small differences between classes and large variations within classes in histological images. These findings strongly support the superiority of our proposed method in the few-shot classification of histological images.
UNASSIGNED: The mutual reconstruction network provides outstanding performance in the few-shot classification of histological images, successfully overcoming the challenges of similarities between classes and diversity within classes. This marks a significant advancement in the automated classification of histological images.

UNASSIGNED: Brain diseases, particularly the classification of gliomas and brain metastases and the prediction of HT in strokes, pose significant challenges in healthcare. Existing methods, relying predominantly on clinical data or imaging-based techniques such as radiomics, often fall short in achieving satisfactory classification accuracy. These methods fail to adequately capture the nuanced features crucial for accurate diagnosis, often hindered by noise and the inability to integrate information across various scales.
UNASSIGNED: We propose a novel approach that mask attention mechanisms with multi-scale feature fusion for Multimodal brain disease classification tasks, termed M 3, which aims to extract features highly relevant to the disease. The extracted features are then dimensionally reduced using Principal Component Analysis (PCA), followed by classification with a Support Vector Machine (SVM) to obtain the predictive results.
UNASSIGNED: Our methodology underwent rigorous testing on multi-parametric MRI datasets for both brain tumors and strokes. The results demonstrate a significant improvement in addressing critical clinical challenges, including the classification of gliomas, brain metastases, and the prediction of hemorrhagic stroke transformations. Ablation studies further validate the effectiveness of our attention mechanism and feature fusion modules.
UNASSIGNED: These findings underscore the potential of our approach to meet and exceed current clinical diagnostic demands, offering promising prospects for enhancing healthcare outcomes in the diagnosis and treatment of brain diseases.

The heavy metal content in edible oils is intricately associated with their suitability for human consumption. In this study, standard soybean oil was used as a sample to quantify the specified concentration of heavy metals using microwave sensing technique. In addition, an attention-based deep residual neural network model was developed as an alternative to traditional modeling methods for predicting heavy metals in edible oils. In the process of microwave data processing, this work continued to discuss the impact of depth on convolutional neural networks. The results demonstrated that the proposed attention-based residual network model outperforms all other deep learning models in all metrics. The performance of this model was characterized by a coefficient of determination (R2) of 0.9605, a relative prediction deviation (RPD) of 5.0479, and a root mean square error (RMSE) of 3.1654 mg/kg. The research findings indicate that the combination of microwave detection technology and chemometrics holds significant potential for assessing heavy metal levels in edible oils.