OBJECTIVE: Low-field (LF) MRI scanners are common in many Low- and middle-Income countries, but they provide images with worse spatial resolution and contrast than high-field (HF) scanners. Image Quality Transfer (IQT) is a machine learning framework to enhance images based on high-quality references that has recently adapted to LF MRI. In this study we aim to assess if it can improve lesion visualisation compared to LF MRI scans in children with epilepsy.
METHODS: T1-weighted, T2-weighted and FLAIR were acquired from 12 patients (5 to 18 years old, 7 males) with clinical diagnosis of intractable epilepsy on a 0.36T (LF) and a 1.5T scanner (HF). LF images were enhanced with IQT. Seven radiologists blindly evaluated the differentiation between normal grey matter (GM) and white matter (WM) and the extension and definition of epileptogenic lesions in LF, HF and IQT-enhanced images.
RESULTS: When images were evaluated independently, GM-WM differentiation scores of IQT outputs were 26% higher, 17% higher and 12% lower than LF for T1, T2 and FLAIR. Lesion definition scores were 8-34% lower than LF, but became 3% higher than LF for FLAIR and T1 when images were seen side by side. Radiologists with expertise at HF scored IQT images higher than those with expertise at LF.
CONCLUSIONS: IQT generally improved the image quality assessments. Evaluation of pathology on IQT-enhanced images was affected by familiarity with HF/IQT image appearance. These preliminary results show that IQT could have an important impact on neuroradiology practice where HF MRI is not available.

Craniomaxillofacial (CMF) and nasal landmark detection are fundamental components in computer-assisted surgery. Medical landmark detection method includes regression-based and heatmap-based methods, and heatmap-based methods are among the main methodology branches. The method relies on high-resolution (HR) features containing more location information to reduce the network error caused by sub-pixel location. Previous studies extracted HR patches around each landmark from downsampling images via object detection and subsequently input them into the network to obtain HR features. Complex multistage tasks affect accuracy. The network error caused by downsampling and upsampling operations during training, which interpolates low-resolution features to generate HR features or predicted heatmap, is still significant. We propose standard super-resolution landmark detection networks (SRLD-Net) and super-resolution UNet (SR-UNet) to reduce network error effectively. SRLD-Net used Pyramid pooling block, Pyramid fusion block and super-resolution fusion block to combine global prior knowledge and multi-scale local features, similarly, SR-UNet adopts Pyramid pooling block and super-resolution block. They can obviously improve representation learning ability of our proposed methods. Then the super-resolution upsampling layer is utilized to generate detail predicted heatmap. Our proposed networks were compared to state-of-the-art methods using the craniomaxillofacial, nasal, and mandibular molar datasets, demonstrating better performance. The mean errors of 18 CMF, 6 nasal and 14 mandibular landmarks are 1.39 ± 1.04, 1.31 ± 1.09, 2.01 ± 4.33 mm. These results indicate that the super-resolution methods have great potential in medical landmark detection tasks. This paper provides two effective heatmap-based landmark detection networks and the code is released in https://github.com/Runshi-Zhang/SRLD-Net.

OBJECTIVE: The technological advancements in surgical robots compatible with magnetic resonance imaging (MRI) have created an indispensable demand for real-time deformable image registration (DIR) of pre- and intra-operative MRI, but there is a lack of relevant methods. Challenges arise from dimensionality mismatch, resolution discrepancy, non-rigid deformation and requirement for real-time registration.
METHODS: In this paper, we propose a real-time DIR framework called MatchMorph, specifically designed for the registration of low-resolution local intraoperative MRI and high-resolution global preoperative MRI. Firstly, a super-resolution network based on global inference is developed to enhance the resolution of intraoperative MRI to the same as preoperative MRI, thus resolving the resolution discrepancy. Secondly, a fast-matching algorithm is designed to identify the optimal position of the intraoperative MRI within the corresponding preoperative MRI to address the dimensionality mismatch. Further, a cross-attention-based dual-stream DIR network is constructed to manipulate the deformation between pre- and intra-operative MRI, real-timely.
RESULTS: We conducted comprehensive experiments on publicly available datasets IXI and OASIS to evaluate the performance of the proposed MatchMorph framework. Compared to the state-of-the-art (SOTA) network TransMorph, the designed dual-stream DIR network of MatchMorph achieved superior performance with a 1.306 mm smaller HD and a 0.07 mm smaller ASD score on the IXI dataset. Furthermore, the MatchMorph framework demonstrates an inference speed of approximately 280 ms.
CONCLUSIONS: The qualitative and quantitative registration results obtained from high-resolution global preoperative MRI and simulated low-resolution local intraoperative MRI validated the effectiveness and efficiency of the proposed MatchMorph framework.

Feature extraction plays a pivotal role in the context of single image super-resolution. Nonetheless, relying on a single feature extraction method often undermines the full potential of feature representation, hampering the model\'s overall performance. To tackle this issue, this study introduces the wide-activation feature distillation network (WFDN), which realizes single image super-resolution through dual-path learning. Initially, a dual-path parallel network structure is employed, utilizing a residual network as the backbone and incorporating global residual connections to enhance feature exploitation and expedite network convergence. Subsequently, a feature distillation block is adopted, characterized by fast training speed and a low parameter count. Simultaneously, a wide-activation mechanism is integrated to further enhance the representational capacity of high-frequency features. Lastly, a gated fusion mechanism is introduced to weight the fusion of feature information extracted from the dual branches. This mechanism enhances reconstruction performance while mitigating information redundancy. Extensive experiments demonstrate that the proposed algorithm achieves stable and superior results compared to the state-of-the-art methods, as evidenced by quantitative evaluation metrics tests conducted on four benchmark datasets. Furthermore, our WFDN excels in reconstructing images with richer detailed textures, more realistic lines, and clearer structures, affirming its exceptional superiority and robustness.

OBJECTIVE: To assess the feasibility and efficacy of a deep learning-based three-dimensional (3D) super-resolution diffusion-weighted imaging (DWI) radiomics model in predicting the prognosis of high-intensity focused ultrasound (HIFU) ablation of uterine fibroids.
METHODS: This retrospective study included 360 patients with uterine fibroids who received HIFU treatment, including Center A (training set: N = 240; internal testing set: N = 60) and Center B (external testing set: N = 60) and were classified as having a favorable or unfavorable prognosis based on the postoperative non-perfusion volume ratio. A deep transfer learning approach was used to construct super-resolution DWI (SR-DWI) based on conventional high-resolution DWI (HR-DWI), and 1198 radiomics features were extracted from manually segmented regions of interest in both image types. Following data preprocessing and feature selection, radiomics models were constructed for HR-DWI and SR-DWI using Support Vector Machine (SVM), Random Forest (RF), and Light Gradient Boosting Machine (LightGBM) algorithms, with performance evaluated using area under the curve (AUC) and decision curves.
RESULTS: All DWI radiomics models demonstrated superior AUC in predicting HIFU ablated uterine fibroids prognosis compared to expert radiologists (AUC: 0.706, 95% CI: 0.647-0.748). When utilizing different machine learning algorithms, the HR-DWI model achieved AUC values of 0.805 (95% CI: 0.679-0.931) with SVM, 0.797 (95% CI: 0.672-0.921) with RF, and 0.770 (95% CI: 0.631-0.908) with LightGBM. Meanwhile, the SR-DWI model outperformed the HR-DWI model (P < 0.05) across all algorithms, with AUC values of 0.868 (95% CI: 0.775-0.960) with SVM, 0.824 (95% CI: 0.715-0.934) with RF, and 0.821 (95% CI: 0.709-0.933) with LightGBM. And decision curve analysis further confirmed the good clinical value of the models.
CONCLUSIONS: Deep learning-based 3D SR-DWI radiomics model demonstrated favorable feasibility and effectiveness in predicting the prognosis of HIFU ablated uterine fibroids, which was superior to HR-DWI model and assessment by expert radiologists.

For convenient transmission, omnidirectional images (ODIs) usually follow the equirectangular projection (ERP) format and are low-resolution. To provide better immersive experience, omnidirectional image super resolution (ODISR) is essential. However, ERP ODIs suffer from serious geometric distortion and pixel stretching across latitudes, generating massive redundant information at high latitudes. This characteristic poses a huge challenge for the traditional SR methods, which can only obtain the suboptimal ODISR performance. To address this issue, we propose a novel position attention network (PAN) for ODISR in this paper. Specifically, a two-branch structure is introduced, in which the basic enhancement branch (BE) serves to achieve coarse deep feature enhancement for extracted shallow features. Meanwhile, the position attention enhancement branch (PAE) builds a positional attention mechanism to dynamically adjust the contribution of features at different latitudes in the ERP representation according to their positions and stretching degrees, which achieves the enhancement for the differentiated information, suppresses the redundant information, and modulate the deep features with spatial distortion. Subsequently, the features of two branches are fused effectively to achieve the further refinement and adapt the distortion characteristic of ODIs. After that, we exploit a long-term memory module (LM), promoting information interactions and fusions between the branches to enhance the perception of the distortion, aggregating the prior hierarchical features to keep the long-term memory and boosting the ODISR performance. Extensive results demonstrate the state-of-the-art performance and the high efficiency of our PAN in ODISR.

Recently, multi-resolution pyramid-based techniques have emerged as the prevailing research approach for image super-resolution. However, these methods typically rely on a single mode of information transmission between levels. In our approach, a wavelet pyramid recursive neural network (WPRNN) based on wavelet energy entropy (WEE) constraint is proposed. This network transmits previous-level wavelet coefficients and additional shallow coefficient features to capture local details. Besides, the parameter of low- and high-frequency wavelet coefficients within each pyramid level and across pyramid levels is shared. A multi-resolution wavelet pyramid fusion (WPF) module is devised to facilitate information transfer across network pyramid levels. Additionally, a wavelet energy entropy loss is proposed to constrain the reconstruction of wavelet coefficients from the perspective of signal energy distribution. Finally, our method achieves the competitive reconstruction performance with the minimal parameters through an extensive series of experiments conducted on publicly available datasets, which demonstrates its practical utility.

Label-free super-resolution (LFSR) imaging relies on light-scattering processes in nanoscale objects without a need for fluorescent (FL) staining required in super-resolved FL microscopy. The objectives of this Roadmap are to present a comprehensive vision of the developments, the state-of-the-art in this field, and to discuss the resolution boundaries and hurdles which need to be overcome to break the classical diffraction limit of the LFSR imaging. The scope of this Roadmap spans from the advanced interference detection techniques, where the diffraction-limited lateral resolution is combined with unsurpassed axial and temporal resolution, to techniques with true lateral super-resolution capability which are based on understanding resolution as an information science problem, on using novel structured illumination, near-field scanning, and nonlinear optics approaches, and on designing superlenses based on nanoplasmonics, metamaterials, transformation optics, and microsphere-assisted approaches. To this end, this Roadmap brings under the same umbrella researchers from the physics and biomedical optics communities in which such studies have often been developing separately. The ultimate intent of this paper is to create a vision for the current and future developments of LFSR imaging based on its physical mechanisms and to create a great opening for the series of articles in this field.

BACKGROUND: In dental clinical practice, cone-beam computed tomography (CBCT) is commonly used to assist practitioners to recognize the complex morphology of root canal systems; however, because of its resolution limitations, certain small anatomical structures still cannot be accurately recognized on CBCT. The purpose of this study was to perform image super-resolution (SR) processing on CBCT images of extracted human teeth with the help of a deep learning model, and to compare the differences among CBCT, super-resolution computed tomography (SRCT), and micro-computed tomography (Micro-CT) images through three-dimensional reconstruction.
METHODS: The deep learning model (Basicvsr++) was selected and modified. The dataset consisted of 171 extracted teeth that met inclusion criteria, with 40 maxillary first molars as the training set and 40 maxillary first molars as well as 91 teeth from other tooth positions as the external test set. The corresponding CBCT, SRCT, and Micro-CT images of each tooth in test sets were reconstructed using Mimics Research 17.0, and the root canal recognition rates in the 3 groups were recorded. The following parameters were measured: volume of hard tissue (V1), volume of pulp chamber and root canal system (V2), length of visible root canals under orifice (VL-X, where X represents the specific root canal), and intersection angle between coronal axis of canal and long axis of tooth (∠X, where X represents the specific root canal). Data were statistically analyzed between CBCT and SRCT images using paired sample t-test and Wilcoxon test analysis, with the measurement from Micro-CT images as the gold standard.
RESULTS: Images from all tested teeth were successfully processed with the SR program. In 4-canal maxillary first molar, identification of MB2 was 72% (18/25) in CBCT group, 92% (23/25) in SRCT group, and 100% (25/25) in Micro-CT group. The difference of hard tissue volume between SRCT and Micro-CT was significantly smaller than that between CBCT and Micro-CT in all tested teeth except 4-canal mandibular first molar (P < .05). Similar results were obtained in volume of pulp chamber and root canal system in all tested teeth (P < .05). As for length of visible root canals under orifice, the difference between SRCT and Micro-CT was significantly smaller than that between CBCT and Micro-CT (P < .05) in most root canals.
CONCLUSIONS: The deep learning model developed in this study helps to optimize the root canal morphology of extracted teeth in CBCT. And it may be helpful for the identification of MB2 in the maxillary first molar.

The emergence of convolutional neural network (CNN) and transformer has recently facilitated significant advances in image super-resolution (SR) tasks. However, these networks commonly construct complex structures, having huge model parameters and high computational costs, to boost reconstruction performance. In addition, they do not consider the structural prior well, which is not conducive to high-quality image reconstruction. In this work, we devise a lightweight interactive feature inference network (IFIN), complementing the strengths of CNN and Transformer, for effective image SR reconstruction. Specifically, the interactive feature aggregation module (IFAM), implemented by structure-aware attention block (SAAB), Swin Transformer block (SWTB), and enhanced spatial adaptive block (ESAB), serves as the network backbone, progressively extracts more dedicated features to facilitate the reconstruction of high-frequency details in the image. SAAB adaptively recalibrates local salient structural information, and SWTB effectively captures rich global information. Further, ESAB synergetically complements local and global priors to ensure the consistent fusion of diverse features, achieving high-quality reconstruction of images. Comprehensive experiments reveal that our proposed networks attain state-of-the-art reconstruction accuracy on benchmark datasets while maintaining low computational demands. Our code and results are available at: https://github.com/wwaannggllii/IFIN .