Prostate cancer is one of the most common and fatal diseases among men, and its early diagnosis can have a significant impact on the treatment process and prevent mortality. Since it does not have apparent clinical symptoms in the early stages, it is difficult to diagnose. In addition, the disagreement of experts in the analysis of magnetic resonance images is also a significant challenge. In recent years, various research has shown that deep learning, especially convolutional neural networks, has appeared successfully in machine vision (especially in medical image analysis). In this research, a deep learning approach was used on multi-parameter magnetic resonance images, and the synergistic effect of clinical and pathological data on the accuracy of the model was investigated. The data were collected from Trita Hospital in Tehran, which included 343 patients (data augmentation and learning transfer methods were used during the process). In the designed model, four different types of images are analyzed with four separate ResNet50 deep convolutional networks, and their extracted features are transferred to a fully connected neural network and combined with clinical and pathological features. In the model without clinical and pathological data, the maximum accuracy reached 88%, but by adding these data, the accuracy increased to 96%, which shows the significant impact of clinical and pathological data on the accuracy of diagnosis.

Segmentation of the temporomandibular joint (TMJ) disc and condyle from magnetic resonance imaging (MRI) is a crucial task in TMJ internal derangement research. The automatic segmentation of the disc structure presents challenges due to its intricate and variable shapes, low contrast, and unclear boundaries. Existing TMJ segmentation methods often overlook spatial and channel information in features and neglect overall topological considerations, with few studies exploring the interaction between segmentation and topology preservation. To address these challenges, we propose a Three-Branch Jointed Feature and Topology Decoder (TFTD) for the segmentation of TMJ disc and condyle in MRI. This structure effectively preserves the topological information of the disc structure and enhances features. We introduce a cross-dimensional spatial and channel attention mechanism (SCIA) to enhance features. This mechanism captures spatial, channel, and cross-dimensional information of the decoded features, leading to improved segmentation performance. Moreover, we explore the interaction between topology preservation and segmentation from the perspective of game theory. Based on this interaction, we design the Joint Loss Function (JLF) to fully leverage the features of segmentation, topology preservation, and joint interaction branches. Results on the TMJ MRI dataset demonstrate the superior performance of our TFTD compared to existing methods.

Alzheimer\'s Disease is the most common cause of dementia, whose progression spans in different stages, from very mild cognitive impairment to mild and severe conditions. In clinical trials, Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) are mostly used for the early diagnosis of neurodegenerative disorders since they provide volumetric and metabolic function information of the brain, respectively. In recent years, Deep Learning (DL) has been employed in medical imaging with promising results. Moreover, the use of the deep neural networks, especially Convolutional Neural Networks (CNNs), has also enabled the development of DL-based solutions in domains characterized by the need of leveraging information coming from multiple data sources, raising the Multimodal Deep Learning (MDL). In this paper, we conduct a systematic analysis of MDL approaches for dementia severity assessment exploiting MRI and PET scans. We propose a Multi Input-Multi Output 3D CNN whose training iterations change according to the characteristic of the input as it is able to handle incomplete acquisitions, in which one image modality is missed. Experiments performed on OASIS-3 dataset show the satisfactory results of the implemented network, which outperforms approaches exploiting both single image modality and different MDL fusion techniques.

BACKGROUND: Breast Cancer (BC) is a highly heterogeneous and complex disease. Personalized treatment options require the integration of multi-omic data and consideration of phenotypic variability. Radiogenomics aims to merge medical images with genomic measurements but encounter challenges due to unpaired data consisting of imaging, genomic, or clinical outcome data. In this study, we propose the utilization of a well-trained conditional generative adversarial network (cGAN) to address the unpaired data issue in radiogenomic analysis of BC. The generated images will then be used to predict the mutations status of key driver genes and BC subtypes.
METHODS: We integrated the paired MRI and multi-omic (mRNA gene expression, DNA methylation, and copy number variation) profiles of 61 BC patients from The Cancer Imaging Archive (TCIA) and The Cancer Genome Atlas (TCGA). To facilitate this integration, we employed a Bayesian Tensor Factorization approach to factorize the multi-omic data into 17 latent features. Subsequently, a cGAN model was trained based on the matched side-view patient MRIs and their corresponding latent features to predict MRIs for BC patients who lack MRIs. Model performance was evaluated by calculating the distance between real and generated images using the Fréchet Inception Distance (FID) metric. BC subtype and mutation status of driver genes were obtained from the cBioPortal platform, where 3 genes were selected based on the number of mutated patients. A convolutional neural network (CNN) was constructed and trained using the generated MRIs for mutation status prediction. Receiver operating characteristic area under curve (ROC-AUC) and precision-recall area under curve (PR-AUC) were used to evaluate the performance of the CNN models for mutation status prediction. Precision, recall and F1 score were used to evaluate the performance of the CNN model in subtype classification.
RESULTS: The FID of the images from the well-trained cGAN model based on the test set is 1.31. The CNN for TP53, PIK3CA, and CDH1 mutation prediction yielded ROC-AUC values 0.9508, 0.7515, and 0.8136 and PR-AUC are 0.9009, 0.7184, and 0.5007, respectively for the three genes. Multi-class subtype prediction achieved precision, recall and F1 scores of 0.8444, 0.8435 and 0.8336 respectively. The source code and related data implemented the algorithms can be found in the project GitHub at https://github.com/mattthuang/BC_RadiogenomicGAN .
CONCLUSIONS: Our study establishes cGAN as a viable tool for generating synthetic BC MRIs for mutation status prediction and subtype classification to better characterize the heterogeneity of BC in patients. The synthetic images also have the potential to significantly augment existing MRI data and circumvent issues surrounding data sharing and patient privacy for future BC machine learning studies.

This study proposes a deep convolutional neural network for the automatic segmentation of glioblastoma brain tumors, aiming sat replacing the manual segmentation method that is both time-consuming and labor-intensive. There are many challenges for automatic segmentation to finely segment sub-regions from multi-sequence magnetic resonance images because of the complexity and variability of glioblastomas, such as the loss of boundary information, misclassified regions, and subregion size. To overcome these challenges, this study introduces a spatial pyramid module and attention mechanism to the automatic segmentation algorithm, which focuses on multi-scale spatial details and context information. The proposed method has been tested in the public benchmarks BraTS 2018, BraTS 2019, BraTS 2020 and BraTS 2021 datasets. The Dice score on the enhanced tumor, whole tumor, and tumor core were respectively 79.90 %, 89.63 %, and 85.89 % on the BraTS 2018 dataset, respectively 77.14 %, 89.58 %, and 83.33 % on the BraTS 2019 dataset, and respectively 77.80 %, 90.04 %, and 83.18 % on the BraTS 2020 dataset, and respectively 83.48 %, 90.70 %, and 88.94 % on the BraTS 2021 dataset offering performance on par with that of state-of-the-art methods with only 1.90 M parameters. In addition, our approach significantly reduced the requirements for experimental equipment, and the average time taken to segment one case was only 1.48 s; these two benefits rendered the proposed network intensely competitive for clinical practice.

Alzheimer\'s disease (AD) is a degenerative neurologic condition that results in the deterioration of several brain processes (e.g. memory loss). The most notable physical alteration in AD is the impairment of brain cells. An accurate examination of brain pictures may help to find the disease earlier because early diagnosis is crucial to enhancing patient care and treatment outcomes. Therefore, an easy and error-free system for AD diagnosis has recently received much research attention. Conventional image processing techniques sometimes cannot observe the significant features. As a result, the objective of this research is to develop an accurate and efficient method for identifying AD using magnetic resonance imaging (MRI). To begin with, the brain regions in the MRI images are segmented using a powerful Deep ResUnet-based approach. Then, the global and local features from the segmented images are recovered using a Multi-Scale Attention Siamese Network (MASNet)-based network. After extracting the features, the Slime Mould Algorithm-based feature selection process is conducted. Finally, the stages of AD are categorized using the EfficientNetB7 model. The efficacy of the presented method has been tested using brain MRI scans from the Kaggle dataset and the AD Neuroimaging Initiative (ADNI) dataset, and it achieves 99.31% and 99.38% accuracy, respectively. Finally, the study results show that the suggested method is helpful for accurate AD categorization.Communicated by Ramaswamy H. Sarma.

Accurate segmentation of the hippocampus from the brain magnetic resonance images (MRIs) is a crucial task in the neuroimaging research, since its structural integrity is strongly related to several neurodegenerative disorders, such as Alzheimer\'s disease (AD). Automatic segmentation of the hippocampus structures is challenging due to the small volume, complex shape, low contrast and discontinuous boundaries of hippocampus. Although some methods have been developed for the hippocampus segmentation, most of them paid too much attention to the hippocampus shape and volume instead of considering the spatial information. Additionally, the extracted features are independent of each other, ignoring the correlation between the global and local information. In view of this, here we proposed a novel cross-layer dual Encoding-Shared Decoding network framework with Spatial self-Attention mechanism (called ESDSA) for hippocampus segmentation in human brains. Considering that the hippocampus is a relatively small part in MRI, we introduced the spatial self-attention mechanism in ESDSA to capture the spatial information of hippocampus for improving the segmentation accuracy. We also designed a cross-layer dual encoding-shared decoding network to effectively extract the global information of MRIs and the spatial information of hippocampus. The spatial features of hippocampus and the features extracted from the MRIs were combined to realize the hippocampus segmentation. Results on the baseline T1-weighted structural MRI data show that the performance of our ESDSA is superior to other state-of-the-art methods, and the dice similarity coefficient of ESDSA achieves 89.37%. In addition, the dice similarity coefficient of the Spatial Self-Attention mechanism (SSA) strategy and the dual Encoding-Shared Decoding (ESD) strategy is 9.47%, 5.35% higher than that of the baseline U-net, respectively, indicating that the strategies of SSA and ESD can effectively enhance the segmentation accuracy of human brain hippocampus.

The main goal of this retrospective study was to examine the morphology of the interthalamic adhesion (ITA) in normal children aged between 1 and 18 years.
The study universe consisted of magnetic resonance images of 180 healthy pediatric subjects (age, 9.50 ± 5.20 years, sex, 90 girls and 90 boys). The cross-sectional area (CSA), vertical diameter (VD), and horizontal diameter (HD) of the ITA were measured and in addition, its location was noted.
HD, VD, and CSA of the ITA were measured as 8.47 ± 1.64 mm, 7.59 ± 1.57 mm, and 52.06 ± 18.51 mm2, respectively. HD did not change from infancy until postpubescence, but then significantly decreased (P < 0.001). VD increased up to early childhood but then did not alter until the end of prepubescence. After that period, it decreased in postpubescence (P < 0.001). CSA tended to decrease in an irregular pattern according to pediatric age periods (P < 0.001). The ITA was located at the anterosuperior quadrant in 138 individuals (76.70%), at the anteroinferior quadrant in 7 individuals (3.90%), and the center of the lateral wall of the third ventricle in 35 individuals (19.40%). Linear functions were calculated as y = 9.490-0.107 × age (years) for HD, y = 8.453-0.091 × age (years) for VD, and y = 63.559-1.211 × age (years) for CSA.
ITA size irregularly decreases with advancing age from 1 to 18 years. Our calculated linear functions, showing the growth dynamics of the ITA by pediatric ages, may be helpful in estimating its dimension.

UNASSIGNED: The severity assessment of lumbar disc herniation (LDH) on MR images is crucial for selecting suitable surgical candidates. However, the interpretation of MR images is time-consuming and requires repetitive work. This study aims to develop and evaluate a deep learning-based diagnostic model for automated LDH detection and classification on lumbar axial T2-weighted MR images.
UNASSIGNED: A total of 1115 patients were analyzed in this retrospective study; both a development dataset (1015 patients, 15 249 images) and an external test dataset (100 patients, 1273 images) were utilized. According to the Michigan State University (MSU) classification criterion, experts labeled all images with consensus, and the final labeled results were regarded as the reference standard. The automated diagnostic model comprised Faster R-CNN and ResNeXt101 as the detection and classification network, respectively. The deep learning-based diagnostic performance was evaluated by calculating mean intersection over union (IoU), accuracy, precision, sensitivity, specificity, F1 score, the area under the receiver operating characteristics curve (AUC), and intraclass correlation coefficient (ICC) with 95% confidence intervals (CIs).
UNASSIGNED: High detection consistency was obtained in the internal test dataset (mean IoU = 0.82, precision = 98.4%, sensitivity = 99.4%) and external test dataset (mean IoU = 0.70, precision = 96.3%, sensitivity = 97.8%). Overall accuracy for LDH classification was 87.70% (95% CI: 86.59%-88.86%) and 74.23% (95% CI: 71.83%-76.75%) in the internal and external test datasets, respectively. For internal testing, the proposed model achieved a high agreement in classification (ICC = 0.87, 95% CI: 0.86-0.88, P < 0.001), which was higher than that of external testing (ICC = 0.79, 95% CI: 0.76-0.81, P < 0.001). The AUC for model classification was 0.965 (95% CI: 0.962-0.968) and 0.916 (95% CI: 0.908-0.925) in the internal and external test datasets, respectively.
UNASSIGNED: The automated diagnostic model achieved high performance in detecting and classifying LDH and exhibited considerable consistency with experts\' classification.

Precise segmentation of the hippocampus is essential for various human brain activity and neurological disorder studies. To overcome the small size of the hippocampus and the low contrast of MR images, a dual multilevel constrained attention GAN for MRI-based hippocampus segmentation is proposed in this paper, which is used to provide a relatively effective balance between suppressing noise interference and enhancing feature learning. First, we design the dual-GAN backbone to effectively compensate for the spatial information damage caused by multiple pooling operations in the feature generation stage. Specifically, dual-GAN performs joint adversarial learning on the multiscale feature maps at the end of the generator, which yields an average Dice coefficient (DSC) gain of 5.95% over the baseline. Next, to suppress MRI high-frequency noise interference, a multilayer information constraint unit is introduced before feature decoding, which improves the sensitivity of the decoder to forecast features by 5.39% and effectively alleviates the network overfitting problem. Then, to refine the boundary segmentation effects, we construct a multiscale feature attention restraint mechanism, which forces the network to concentrate more on effective multiscale details, thus improving the robustness. Furthermore, the dual discriminators D1 and D2 also effectively prevent the negative migration phenomenon. The proposed DMCA-GAN obtained a DSC of 90.53% on the Medical Segmentation Decathlon (MSD) dataset with tenfold cross-validation, which is superior to the backbone by 3.78%.