Multi-spectral imaging by unoccupied aerial vehicles provides a non-destructive, high throughput approach to measuring biomass accumulation over successive alfalfa (Medicago sativa L. subsp. sativa) harvests. Information from estimated growth curves can be used to infer harvest biomass and to gain insights into the relationship between growth dynamics and forage biomass stability across cuttings and years. In this study, multi-spectral imaging and several common vegetation indices were used to estimate genetic parameters and model growth of alfalfa cultivars to determine the longitudinal relationship between vegetation indices and forage biomass. Results showed moderate heritability for vegetation indices, with median plot level heritability ranging from 0.11-0.64, across multiple cuttings in three trials planted in Ithaca, NY, and Las Cruces, NM. Genetic correlations between the normalized difference vegetation index and forage biomass were moderate to high across trials, cuttings, and the timing of multi-spectral image capture. To evaluate the relationship between growth parameters and forage biomass stability across cuttings and environmental conditions, random regression modeling approaches were used to estimate the growth parameters of cultivars for each cutting and the variance in growth was compared to the variance in genetic estimates of forage biomass yield across cuttings. These analyses revealed high correspondence between stability in growth parameters and stability of forage yield. The results of this study indicate that vegetation indices are effective at modeling genetic components of biomass accumulation, presenting opportunities for more efficient screening of cultivars and new longitudinal modeling approaches that can provide insights into temporal factors influencing cultivar stability.

With rising melanoma incidence and mortality, early detection and surgical removal of primary lesions is essential. Multispectral imaging is a new, non-invasive technique that can facilitate skin cancer detection by measuring the reflectance spectra of biological tissues. Currently, incident illumination allows little light to be reflected from deeper skin layers due to high surface reflectance. A pilot study was conducted at the University Hospital Basel to evaluate, whether multispectral imaging with direct light coupling could extract more information from deeper skin layers for more accurate dignity classification of melanocytic lesions. 27 suspicious pigmented lesions from 23 patients were included (6 melanomas, 6 dysplastic nevi, 12 melanocytic nevi, 3 other). Lesions were imaged before excision using a prototype snapshot mosaic multispectral camera with incident and direct illumination with subsequent dignity classification by a pre-trained multispectral image analysis model. Using incident light, a sensitivity of 83.3% and a specificity of 58.8% were achieved compared to dignity as determined by histopathological examination. Direct light coupling resulted in a superior sensitivity of 100% and specificity of 82.4%. Convolutional neural network classification of corresponding red, green, and blue lesion images resulted in 16.7% lower sensitivity (83.3%, 5/6 malignant lesions detected) and 20.9% lower specificity (61.5%) compared to direct light coupling with multispectral image classification. Our results show that incorporating direct light multispectral imaging into the melanoma detection process could potentially increase the accuracy of dignity classification. This newly evaluated illumination method could improve multispectral applications in skin cancer detection. Further larger studies are needed to validate the camera prototype.

Chlorophyll monitoring is an important topic in phenotypic research. For fruit trees, chlorophyll content can reflect the real-time photosynthetic capacity, which is a great reference for nutrient status assessment. Traditional in situ estimation methods are labor- and time-consuming. Remote sensing spectral imagery has been widely applied in agricultural research. This study aims to explore a transferable model to estimate canopy SPAD across growth stages and tree species. Unmanned aerial vehicle (UAV) system was applied for multispectral images acquisition. The results showed that the univariate model yielded with Green Normalized Difference Vegetation Index (GNDVI) gave valuable prediction results, providing a simple and effective method for chlorophyll monitoring for single species. Reflection features (RF) and texture features (TF) were extracted for multivariate modeling. Gaussian Process Regression (GPR) models yielded better performance for mixed species research than other algorithm models, and the R 2 of the RF+TF+GPR model was approximately 0.7 in both single and mixed species. In addition, this method can also be used to predict canopy SPAD over various growth stages, especially in the third and fourth stages with R 2 higher than 0.6. This paper highlights the importance of using RF+TF for canopy feature expression and deep connection exploration between canopy features with GPR algorithm. This research provides a universal model for canopy SPAD inversion which can promote the growth status monitoring and management of fruit trees.

Spinal cord injury (SCI) is a debilitating neurological and pathological condition that results in significant impairments in motor, sensory, and autonomic functions. By integrating multispectral imaging (MSI) with Raman spectroscopy, a label-free optical methodology was developed for achieving a non-invasive in vivo understanding on the pathological features of SCI evolution. Under the guidance of captured the spectral imaging data cube with a rigid endoscope based MSI system, a special designed fiber probe passed through the instrumental channel for acquiring the finger-print spectral information from compression rat SCI models. After identifying the main visual features of injured spinal cord tissue in all Sham, 0-, 3- and 7-days post injury (0 DPI, 3 DPI, and 7 DPI) groups, the blood volume and oxygen content were visualized to describe hemorrhage, hypoxia and inflammatory state after acute injury. The averaged reflectance spectra, which were deduced from MSI data cubes, were utilized for describing oxygen saturation and hemoglobin concentration in living tissue. The results of Raman spectroscopy addressed complex compositional and conformational phenomena during SCI progression, correlated with the well-known event like neuronal apoptosis, hemorrhage, demyelination, and even the upregulation of chondroitin sulfate proteoglycans (CSPGs). A principal component analysis and linear discriminate algorithm (PCA-LDA) based discriminate model was introduced for categorizing spectral features in different injury stages, which was applicable for intraoperative interpretations on the complex pathological courses of SCI and therapeutic outcomes.

BACKGROUND: Pepper Phytophthora blight is a devastating disease during the growth process of peppers, significantly affecting their yield and quality. Accurate, rapid, and non-destructive early detection of pepper Phytophthora blight is of great importance for pepper production management. This study investigated the possibility of using multispectral imaging combined with machine learning to detect Phytophthora blight in peppers. Peppers were divided into two groups: one group was inoculated with Phytophthora blight, and the other was left untreated as a control. Multispectral images were collected at 0-h samples before inoculation and at 48, 60, 72, and 84 h after inoculation. The supporting software of the multispectral imaging system was used to extract spectral features from 19 wavelengths, and textural features were extracted using a gray-level co-occurrence matrix (GLCM) and a local binary pattern (LBP). The principal component analysis (PCA), successive projection algorithm (SPA), and genetic algorithm (GA) were used for feature selection from the extracted spectral and textural features. Two classification models were established based on effective single spectral features and significant spectral textural fusion features: a partial least squares discriminant analysis (PLS_DA) and one-dimensional convolutional neural network (1D-CNN). A two-dimensional convolutional neural network (2D-CNN) was constructed based on five principal component (PC) coefficients extracted from the spectral data using PCA, weighted, and summed with 19-channel multispectral images to create new PC images.
RESULTS: The results indicated that the models using PCA for feature selection exhibit relatively stable classification performance. The accuracy of PLS-DA and 1D-CNN based on single spectral features is 82.6% and 83.3%, respectively, at the 48h mark. In contrast, the accuracy of PLS-DA and 1D-CNN based on spectral texture fusion reached 85.9% and 91.3%, respectively, at the same 48h mark. The accuracy of the 2D-CNN based on 5 PC images is 82%.
CONCLUSIONS: The research indicates that Phytophthora blight infection can be detected 48 h after inoculation (36 h before visible symptoms). This study provides an effective method for the early detection of Phytophthora blight in peppers.

BACKGROUND: Melanocytic nevi (MN), warts, seborrheic keratoses (SK), and psoriasis are four common types of skin surface lesions that typically require dermatoscopic examination for definitive diagnosis in clinical dermatology settings. This process is labor-intensive and resource-consuming. Traditional methods for diagnosing skin lesions rely heavily on the subjective judgment of dermatologists, leading to issues in diagnostic accuracy and prolonged detection times.
OBJECTIVE: This study aims to introduce a multispectral imaging (MSI)-based method for the early screening and detection of skin surface lesions. By capturing image data at multiple wavelengths, MSI can detect subtle spectral variations in tissues, significantly enhancing the differentiation of various skin conditions.
METHODS: The proposed method utilizes a pixel-level mosaic imaging spectrometer to capture multispectral images of lesions, followed by reflectance calibration and standardization. Regions of interest were manually extracted, and the spectral data were subsequently exported for analysis. An improved one-dimensional convolutional neural network is then employed to train and classify the data.
RESULTS: The new method achieves an accuracy of 96.82 % on the test set, demonstrating its efficacy.
CONCLUSIONS: This multispectral imaging approach provides a non-contact and non-invasive method for early screening, effectively addressing the subjective identification of lesions by dermatologists and the prolonged detection times associated with conventional methods. It offers enhanced diagnostic accuracy for a variety of skin lesions, suggesting new avenues for dermatological diagnostics.

The assessment of the transformation zone is a critical step toward diagnosis of cervical cancer. This work involves the development of a portable, label-free transvaginal multispectral diffuse optical imaging (MDOI) imaging probe to estimate the transformation zone. The images were acquired from N = 5 (N = 1 normal, N = 2 premalignant, and N = 2 malignant) patients. Key parameters such as spectral contrast ratio (ρ) at 545 and 450 nm were higher in premalignant (0.29, 0.25 for 450 nm and 0.30, 0.17 for 545 nm) as compared to the normal patients (0.13 and 0.14 for 450 and 545 nm, respectively). The threshold for the spectral intensity ratio R610/R450 and R610/R545 can also be used as a marker to correlate with the new and original squamous columnar junction (SCJ), respectively. The pilot study highlights the use of new markers such as spectral contrast ratio (ρ) and spectral intensity ratio (R610/R450 and R610/R545) images.

Food fraud is widespread in the aquatic food market, hence fast and non-destructive methods of identification of fish flesh are needed. In this study, multispectral imaging (MSI) was used to screen flesh slices from 20 edible fish species commonly found in the sea around Yantai, China, by combining identification based on the mitochondrial COI gene. We found that nCDA images transformed from MSI data showed significant differences in flesh splices of the 20 fish species. We then employed eight models to compare their prediction performances based on the hold-out method with 70% training and 30% test sets. Convolutional neural network (CNN), quadratic discriminant analysis (QDA), support vector machine (SVM), and linear discriminant analysis (LDA) models perform well on cross-validation and test data. CNN and QDA achieved more than 99% accuracy on the test set. By extracting the CNN features for optimization, a very high degree of separation was obtained for all species. Furthermore, based on the Gini index in RF, 11 bands were selected as key classification features for CNN, and an accuracy of 98% was achieved. Our study developed a successful pipeline for employing machine learning models (especially CNN) on MSI identification of fish flesh, and provided a convenient and non-destructive method to determine the marketing of fish flesh in the future.

UNASSIGNED: Imaging blood oxygen saturation ( SO 2 ) in the skin can be of clinical value when studying ischemic tissue. Emerging multispectral snapshot cameras enable real-time imaging but are limited by slow analysis when using inverse Monte Carlo (MC), the gold standard for analyzing multispectral data. Using artificial neural networks (ANNs) facilitates a significantly faster analysis but requires a large amount of high-quality training data from a wide range of tissue types for a precise estimation of SO 2 .
UNASSIGNED: We aim to develop a framework for training ANNs that estimates SO 2 in real time from multispectral data with a precision comparable to inverse MC.
UNASSIGNED: ANNs are trained using synthetic data from a model that includes MC simulations of light propagation in tissue and hardware characteristics. The model includes physiologically relevant variations in optical properties, unique sensor characteristics, variations in illumination spectrum, and detector noise. This approach enables a rapid way of generating high-quality training data that covers different tissue types and skin pigmentation.
UNASSIGNED: The ANN implementation analyzes an image in 0.11 s, which is at least 10,000 times faster than inverse MC. The hardware modeling is significantly improved by an in-house calibration of the sensor spectral response. An in-vivo example shows that inverse MC and ANN give almost identical SO 2 values with a mean absolute deviation of 1.3%-units.
UNASSIGNED: ANN can replace inverse MC and enable real-time imaging of microcirculatory SO 2 in the skin if detailed and precise modeling of both tissue and hardware is used when generating training data.

UNASSIGNED: Adaptive optics fluorescence lifetime ophthalmoscopy (AOFLIO) provides a label-free approach to observe functional and molecular changes at cellular scale in vivo. Adding multispectral capabilities improves interpretation of lifetime fluctuations due to individual fluorophores in the retinal pigment epithelium (RPE).
UNASSIGNED: To quantify the cellular-scale changes in autofluorescence with age and eccentricity due to variations in lipofuscin, melanin, and melanolipofuscin in RPE using multispectral AOFLIO.
UNASSIGNED: AOFLIO was performed on six subjects at seven eccentricities. Four imaging channels ( λ ex / λ em ) were used: 473/SSC, 473/LSC, 532/LSC, and 765/NIR. Cells were segmented and the timing signals of each pixel in a cell were combined into a single histogram, which were then used to compute the lifetime and phasor parameters. An ANOVA was performed to investigate eccentricity and spectral effects on each parameter.
UNASSIGNED: A repeatability analysis revealed < 11.8 % change in lifetime parameters in repeat visits for 532/LSC. The 765/NIR and 532/LSC had eccentricity and age effects similar to previous reports. The 473/LSC had a change in eccentricity with mean lifetime and a phasor component. Both the 473/LSC and 473/SSC had changes in eccentricity in the short lifetime component and its relative contribution. The 473/SSC had no trend in eccentricity in phasor. The comparison across the four channels showed differences in lifetime and phasor parameters.
UNASSIGNED: Multispectral AOFLIO can provide a more comprehensive picture of changes with age and eccentricity. These results indicate that cell segmentation has the potential to allow investigations in low-photon scenarios such as in older or diseased subjects with the co-capture of an NIR channel (such as 765/NIR) with the desired spectral channel. This work represents the first multispectral, cellular-scale fluorescence lifetime comparison in vivo in the human RPE and may be a useful method for tracking diseases.