transfer learning

迁移学习
  • 文章类型: Journal Article
    背景:发生,发展,和茶叶病虫害的爆发对茶叶的质量和产量构成了重大挑战,需要迅速的识别和控制措施。鉴于大量的茶叶病虫害,再加上错综复杂的茶叶种植环境,准确和快速的诊断仍然难以捉摸。在解决这个问题时,本研究探讨了利用迁移学习卷积神经网络识别茶叶病虫害的方法。我们的目标是促进在其复杂的生态位范围内准确,快速地检测影响云南大叶茶的病虫害。
    结果:最初,我们收集了1878年的图像数据,包括来自茶园内复杂环境的10种流行类型的茶病虫害,编制一个全面的数据集。此外,我们采用数据增强技术来丰富样本多样性。利用ImageNet预训练模型,我们进行了全面评估,并确定Xception架构是最有效的模型。值得注意的是,在Xeption模型中整合注意力机制并没有提高识别性能.随后,通过迁移学习和冻结核心策略,测试准确率为98.58%,验证准确率为98.2310%。
    结论:这些结果意味着朝着准确及时的检测迈出了重要的一步,对提高云南茶叶的可持续性和生产力抱有希望。研究结果为云南茶叶病虫害在线检测技术的发展提供了理论基础和技术指导。
    BACKGROUND: The occurrence, development, and outbreak of tea diseases and pests pose a significant challenge to the quality and yield of tea, necessitating prompt identification and control measures. Given the vast array of tea diseases and pests, coupled with the intricacies of the tea planting environment, accurate and rapid diagnosis remains elusive. In addressing this issue, the present study investigates the utilization of transfer learning convolution neural networks for the identification of tea diseases and pests. Our objective is to facilitate the accurate and expeditious detection of diseases and pests affecting the Yunnan Big leaf kind of tea within its complex ecological niche.
    RESULTS: Initially, we gathered 1878 image data encompassing 10 prevalent types of tea diseases and pests from complex environments within tea plantations, compiling a comprehensive dataset. Additionally, we employed data augmentation techniques to enrich the sample diversity. Leveraging the ImageNet pre-trained model, we conducted a comprehensive evaluation and identified the Xception architecture as the most effective model. Notably, the integration of an attention mechanism within the Xeption model did not yield improvements in recognition performance. Subsequently, through transfer learning and the freezing core strategy, we achieved a test accuracy rate of 98.58% and a verification accuracy rate of 98.2310%.
    CONCLUSIONS: These outcomes signify a significant stride towards accurate and timely detection, holding promise for enhancing the sustainability and productivity of Yunnan tea. Our findings provide a theoretical foundation and technical guidance for the development of online detection technologies for tea diseases and pests in Yunnan.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    $目的。$域适应已被认为是解决脑电图(EEG)分类任务的有限训练数据挑战的有效解决方案。现有的研究主要集中在同质环境上,然而,设备多样性引起的EEG数据的异构特性不容忽视。这激发了异构域适应方法的发展,该方法可以充分利用来自辅助异构域的知识进行EEG分类。$方法。$在这篇文章中,我们提出了一种名为信息表示融合(IRF)的新模型,以解决脑电图数据上下文中的无监督异构域自适应问题。在IRF中,我们考虑不同的数据视角,即,独立同分布(iid)和非iid,学习不同的表述。具体来说,从非iid的角度来看,IRF通过超图对数据之间的高阶相关性进行建模,并开发超图编码器以获得每个域的数据表示。从非iid的角度来看,通过将多层感知器网络应用于源和目标域数据,我们为这两个域实现了另一种类型的表示。随后,注意机制用于融合这两种类型的表示以产生信息特征。要学习可转让的陈述,最大平均差异用于根据融合特征对源域和目标域的分布进行对齐。$Main~结果。$在几个真实数据集上的实验结果证明了所提出模型的有效性。$意义。$本文处理EEG分类情况,其中源和目标EEG数据位于不同的空间,更重要的是,在无监督的学习环境下。这种情况在现实世界中是可行的,但在文献中很少研究。该模型具有较高的分类精度,这项研究对于基于EEG的BCI的商业应用具有重要意义。
    $Objective.$ Domain adaptation has been recognized as a potent solution to the challenge of limited training data for electroencephalography (EEG) classification tasks. Existing studies primarily focus on homogeneous environments, however, the heterogeneous properties of EEG data arising from device diversity cannot be overlooked. This motivates the development of heterogeneous domain adaptation methods that can fully exploit the knowledge from an auxiliary heterogeneous domain for EEG classification. $Approach.$ In this article, we propose a novel model named Informative Representation Fusion (IRF) to tackle the problem of unsupervised heterogeneous domain adaptation in the context of EEG data. In IRF, we consider different perspectives of data, i.e., independent identically distributed (iid) and non-iid, to learn different representations. Specifically, from the non-iid perspective, IRF models high-order correlations among data by hypergraphs and develops hypergraph encoders to obtain data representations of each domain. From the non-iid perspective, by applying multi-layer perceptron networks to the source and target domain data, we achieve another type of representation for both domains. Subsequently, an attention mechanism is used to fuse these two types of representations to yield informative features. To learn transferable representations, the Maximum Mean Discrepancy is utilized to align the distributions of the source and target domains based on the fused features. $Main~results.$ Experimental results on several real-world datasets demonstrate the effectiveness of the proposed model. $Significance.$ This article handles an EEG classification situation where the source and target EEG data lie in different spaces, and what\'s more, under an unsupervised learning setting. This situation is practical in the real world but barely studied in the literature. The proposed model achieves high classification accuracy, and this study is important for the commercial applications of EEG-based BCIs.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    棉花产量估算在农业过程中至关重要,絮凝期棉铃检测的准确性会显着影响棉田的产量估算。无人机(UAV)由于其成本效益和适应性而经常用于植物检测和计数。
    应对小目标棉铃和无人机分辨率低的挑战,本文介绍了一种基于YOLOv8框架的迁移学习方法,名为YOLO小规模金字塔深度感知检测(SSPD)。该方法结合了空间到深度和非跨步卷积(SPD-Conv)和小型目标探测器头,并且还集成了一个简单的,无参数注意机制(SimAM),显著提高目标铃铛检测精度。
    YOLOSSPD在无人机尺度图像上实现了0.874的棉铃检测精度。它还记录了测定系数(R2)为0.86,均方根误差(RMSE)为12.38,相对均方根误差(RRMSE)为11.19%。
    研究结果表明,YOLOSSPD可以显着提高无人机图像上棉铃检测的准确性,从而支持棉花生产过程。该方法为高精度棉花监测提供了一个可靠的解决方案,提高棉花产量估算的可靠性。
    UNASSIGNED: Cotton yield estimation is crucial in the agricultural process, where the accuracy of boll detection during the flocculation period significantly influences yield estimations in cotton fields. Unmanned Aerial Vehicles (UAVs) are frequently employed for plant detection and counting due to their cost-effectiveness and adaptability.
    UNASSIGNED: Addressing the challenges of small target cotton bolls and low resolution of UAVs, this paper introduces a method based on the YOLO v8 framework for transfer learning, named YOLO small-scale pyramid depth-aware detection (SSPD). The method combines space-to-depth and non-strided convolution (SPD-Conv) and a small target detector head, and also integrates a simple, parameter-free attentional mechanism (SimAM) that significantly improves target boll detection accuracy.
    UNASSIGNED: The YOLO SSPD achieved a boll detection accuracy of 0.874 on UAV-scale imagery. It also recorded a coefficient of determination (R2) of 0.86, with a root mean square error (RMSE) of 12.38 and a relative root mean square error (RRMSE) of 11.19% for boll counts.
    UNASSIGNED: The findings indicate that YOLO SSPD can significantly improve the accuracy of cotton boll detection on UAV imagery, thereby supporting the cotton production process. This method offers a robust solution for high-precision cotton monitoring, enhancing the reliability of cotton yield estimates.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目的:心脏灌注MRI对疾病诊断至关重要,治疗计划,和风险分层,异常可作为潜在缺血性病变的标志。AI辅助方法和工具可在所有DCE-MRI时间范围内实现准确有效的左心室(LV)心肌分割,为数据的多维性质带来的挑战提供了解决方案。本研究旨在开发和评估根据当地医院的DCE-MRI数据进行LV心肌分割的自动化方法。
    方法:该研究包括来自当地医院使用1.5TMRI扫描仪采集的55名受试者的回顾性DCE-MRI数据。数据集包括有和没有心脏异常的受试者。参考帧(对比后LV心肌)的时间点使用跨时间序列的标准偏差来识别。使用麦克斯韦恶魔算法执行其他时间图像相对于该参考图像的迭代图像配准。将配准的堆栈馈送到使用U-Net框架构建的模型,用于在DCE-MRI的所有时间帧预测LV心肌。
    结果:使用预训练网络Net_cine进行心肌分割的骰子相似系数(DSC)的平均值和标准偏差为0.78±0.04,而对于微调网络Net_dyn则分别预测所有时间帧的掩码,它是0.78±0.03。Net_dyn的DSC范围为0.71至0.93。参照系的平均DSC为0.82±0.06。
    结论:该研究提出了一种快速且全自动的AI辅助方法,以在DCE-MRI数据的所有时间范围内分割LV心肌。该方法是稳健的,并且其性能与时间内序列注册无关,并且可以轻松适应具有潜在注册错误的时间帧。
    OBJECTIVE: Cardiac perfusion MRI is vital for disease diagnosis, treatment planning, and risk stratification, with anomalies serving as markers of underlying ischemic pathologies. AI-assisted methods and tools enable accurate and efficient left ventricular (LV) myocardium segmentation on all DCE-MRI timeframes, offering a solution to the challenges posed by the multidimensional nature of the data. This study aims to develop and assess an automated method for LV myocardial segmentation on DCE-MRI data of a local hospital.
    METHODS: The study consists of retrospective DCE-MRI data from 55 subjects acquired at the local hospital using a 1.5 T MRI scanner. The dataset included subjects with and without cardiac abnormalities. The timepoint for the reference frame (post-contrast LV myocardium) was identified using standard deviation across the temporal sequences. Iterative image registration of other temporal images with respect to this reference image was performed using Maxwell\'s demons algorithm. The registered stack was fed to the model built using the U-Net framework for predicting the LV myocardium at all timeframes of DCE-MRI.
    RESULTS: The mean and standard deviation of the dice similarity coefficient (DSC) for myocardial segmentation using pre-trained network Net_cine is 0.78 ± 0.04, and for the fine-tuned network Net_dyn which predicts mask on all timeframes individually, it is 0.78 ± 0.03. The DSC for Net_dyn ranged from 0.71 to 0.93. The average DSC achieved for the reference frame is 0.82 ± 0.06.
    CONCLUSIONS: The study proposed a fast and fully automated AI-assisted method to segment LV myocardium on all timeframes of DCE-MRI data. The method is robust, and its performance is independent of the intra-temporal sequence registration and can easily accommodate timeframes with potential registration errors.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    人工智能(AI)在计算机辅助药物设计(CADD)中起着至关重要的作用。随着机器学习(ML)的使用越来越多,这种发展进一步加速。主要是深度学习(DL),以及计算硬件和软件的改进。因此,最初对人工智能在药物发现中应用的疑虑已经消除,导致药物化学的显着好处。同时,认识到人工智能仍处于起步阶段,面临着一些需要解决的限制,以充分发挥其在药物发现中的潜力。一些值得注意的限制是不够的,无标签,和不统一的数据,一些人工智能产生的分子与现有分子的相似性,缺乏不足的基准,知识产权(IPR)相关的数据共享障碍,对生物学的理解很差,专注于代理数据和配体,缺乏整体方法来表示输入(分子结构),以防止输入分子的预处理(特征工程),等。人工智能基础设施的主要组成部分是输入数据,因为人工智能驱动的改进药物发现的大部分成功都取决于数据的质量和数量,用于训练和测试人工智能算法,除了其他一些因素。此外,数据吞噬DL方法,没有足够的数据,可能会崩溃以兑现他们的诺言。目前的文献提出了几种方法,在某种程度上,在药物发现的背景下,有效处理低数据,以获得更好的AI模型输出。这些是转移学习(TL),主动学习(AL),单次或一次性学习(OSL),多任务学习(MTL)数据增强(DA),数据合成(DS),等。一种不同的方法,它允许在通用平台上共享专有数据(不影响数据隐私)以训练ML模型,是联邦学习(FL)。在这次审查中,我们比较和讨论这些方法,他们最近的应用,和局限性,同时对小分子数据进行建模,以获得药物发现中AI方法的改进输出。文章还总结了其他一些处理不足数据的新方法。
    Artificial intelligence (AI) has played a vital role in computer-aided drug design (CADD). This development has been further accelerated with the increasing use of machine learning (ML), mainly deep learning (DL), and computing hardware and software advancements. As a result, initial doubts about the application of AI in drug discovery have been dispelled, leading to significant benefits in medicinal chemistry. At the same time, it is crucial to recognize that AI is still in its infancy and faces a few limitations that need to be addressed to harness its full potential in drug discovery. Some notable limitations are insufficient, unlabeled, and non-uniform data, the resemblance of some AI-generated molecules with existing molecules, unavailability of inadequate benchmarks, intellectual property rights (IPRs) related hurdles in data sharing, poor understanding of biology, focus on proxy data and ligands, lack of holistic methods to represent input (molecular structures) to prevent pre-processing of input molecules (feature engineering), etc. The major component in AI infrastructure is input data, as most of the successes of AI-driven efforts to improve drug discovery depend on the quality and quantity of data, used to train and test AI algorithms, besides a few other factors. Additionally, data-gulping DL approaches, without sufficient data, may collapse to live up to their promise. Current literature suggests a few methods, to certain extent, effectively handle low data for better output from the AI models in the context of drug discovery. These are transferring learning (TL), active learning (AL), single or one-shot learning (OSL), multi-task learning (MTL), data augmentation (DA), data synthesis (DS), etc. One different method, which enables sharing of proprietary data on a common platform (without compromising data privacy) to train ML model, is federated learning (FL). In this review, we compare and discuss these methods, their recent applications, and limitations while modeling small molecule data to get the improved output of AI methods in drug discovery. Article also sums up some other novel methods to handle inadequate data.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    背景:虚拟和增强现实手术模拟器,与机器学习集成,对训练精神运动技能至关重要,并分析手术性能。尽管有像连接权重算法这样的方法,这些试验典型的小样本量(参与者数量少(N))挑战了模型的普适性和稳健性.诸如数据增强和来自在类似手术任务上训练的模型的迁移学习之类的方法解决了这些限制。
    目的:为了证明人工神经网络和迁移学习算法在评估虚拟手术性能方面的有效性,应用于增强和虚拟现实模拟器中的模拟斜外侧腰椎椎间融合技术。
    方法:这项研究在一个新颖的模拟器平台中开发并集成了人工神经网络算法,使用来自模拟任务的数据生成276个跨运动的性能指标,安全,和效率。创新,它从为类似的脊柱模拟器开发的预训练ANN模型应用迁移学习,加强培训过程,解决小数据集的挑战。
    方法:肌肉骨骼生物力学研究实验室;神经外科模拟和人工智能学习中心,麦吉尔大学,蒙特利尔,加拿大。
    方法:27名参与者分为3组:9名居民后,6名高级居民和12名初级居民。
    结果:两种模型,一个从头开始训练的独立模型和另一个利用迁移学习的模型,对9个选定的手术指标进行了培训,分别达到75%和87.5%的测试准确率。
    结论:本研究通过策略使用迁移学习和数据增强,为解决手术模拟中的有限数据集提供了新的蓝图。它还评估并加强了我们以前出版物中连接权重算法的应用。一起,这些方法不仅提高了性能分类的准确性,而且促进了手术训练平台的验证。
    BACKGROUND: Virtual and augmented reality surgical simulators, integrated with machine learning, are becoming essential for training psychomotor skills, and analyzing surgical performance. Despite the promise of methods like the Connection Weights Algorithm, the small sample sizes (small number of participants (N)) typical of these trials challenge the generalizability and robustness of models. Approaches like data augmentation and transfer learning from models trained on similar surgical tasks address these limitations.
    OBJECTIVE: To demonstrate the efficacy of artificial neural network and transfer learning algorithms in evaluating virtual surgical performances, applied to a simulated oblique lateral lumbar interbody fusion technique in an augmented and virtual reality simulator.
    METHODS: The study developed and integrated artificial neural network algorithms within a novel simulator platform, using data from the simulated tasks to generate 276 performance metrics across motion, safety, and efficiency. Innovatively, it applies transfer learning from a pre-trained ANN model developed for a similar spinal simulator, enhancing the training process, and addressing the challenge of small datasets.
    METHODS: Musculoskeletal Biomechanics Research Lab; Neurosurgical Simulation and Artificial Intelligence Learning Centre, McGill University, Montreal, Canada.
    METHODS: Twenty-seven participants divided into 3 groups: 9 post-residents, 6 senior and 12 junior residents.
    RESULTS: Two models, a stand-alone model trained from scratch and another leveraging transfer learning, were trained on nine selected surgical metrics achieving 75 % and 87.5 % testing accuracy respectively.
    CONCLUSIONS: This study presents a novel blueprint for addressing limited datasets in surgical simulations through the strategic use of transfer learning and data augmentation. It also evaluates and reinforces the application of the Connection Weights Algorithm from our previous publication. Together, these methodologies not only enhance the precision of performance classification but also advance the validation of surgical training platforms.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    目的:脑机接口(BCI)技术的最新进展已经看到了向合并复杂解码模型(如深度神经网络(DNN))以提高性能的重大转变。这些模型对于复杂的任务尤其重要,例如用于解码任意运动的回归。然而,这些针对个体数据进行训练和测试的BCI模型通常面临挑战,在不同受试者中的表现和泛化能力有限.这种限制主要是由于DNN模型的大量参数。训练复杂的模型需要大量的数据集。然而,来自许多受试者的组数据可能无法产生足够的解码性能,因为神经信号在个体之间和随着时间的推移固有的变异性方法:为了解决这些挑战,这项研究提出了一种迁移学习方法,该方法可以有效地适应皮层区域的受试者特异性变异性。我们的方法涉及训练两个单独的运动解码模型:一个在单个数据上,另一个在汇集的组数据上。然后,我们从单个模型中为每个皮质区域创建了一个显着性图,这有助于我们确定输入的各个主题的贡献方差。根据贡献方差,我们使用修改后的知识蒸馏框架将个体和群体模型组合在一起。这种方法通过为输入数据分配更大的权重,使群体模型具有普遍适用性,虽然对个体模型进行了微调,以关注具有显著个体差异的区域。结果:我们的组合模型有效地封装了个体差异。我们用9名受试者进行手臂延伸任务来验证这种方法,我们的方法表现优于(平均相关系数,r=0.75)在解码性能方面的个体(r=0.70)和组模型(r=0.40)。特别是,在个别模型表现较低的情况下,有显著的改善(例如,单个解码器中的r=0.50到所提出的解码器中的r=0.61)结论:这些结果不仅证明了我们的方法用于鲁棒BCI的潜力,而且强调了其概括单个数据以更广泛适用性的能力。
    OBJECTIVE: Recent advancements in brain-computer interface (BCI) technology have seen a significant shift towards incorporating complex decoding models such as deep neural networks (DNNs) to enhance performance. These models are particularly crucial for sophisticated tasks such as regression for decoding arbitrary movements. However, these BCI models trained and tested on individual data often face challenges with limited performance and generalizability across different subjects. This limitation is primarily due to a tremendous number of parameters of DNN models. Training complex models demands extensive datasets. Nevertheless, group data from many subjects may not produce sufficient decoding performance because of inherent variability in neural signals both across individuals and over time METHODS: To address these challenges, this study proposed a transfer learning approach that could effectively adapt to subject-specific variability in cortical regions. Our method involved training two separate movement decoding models: one on individual data and another on pooled group data. We then created a salience map for each cortical region from the individual model, which helped us identify the input\'s contribution variance across subjects. Based on the contribution variance, we combined individual and group models using a modified knowledge distillation framework. This approach allowed the group model to be universally applicable by assigning greater weights to input data, while the individual model was fine-tuned to focus on areas with significant individual variance RESULTS: Our combined model effectively encapsulated individual variability. We validated this approach with nine subjects performing arm-reaching tasks, with our method outperforming (mean correlation coefficient, r = 0.75) both individual (r = 0.70) and group models (r = 0.40) in decoding performance. In particular, there were notable improvements in cases where individual models showed low performances (e.g., r = 0.50 in the individual decoder to r = 0.61 in the proposed decoder) CONCLUSIONS: These results not only demonstrate the potential of our method for robust BCI, but also underscore its ability to generalize individual data for broader applicability.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    使用超声评估甲状腺结节取决于放射科医生的经验,但深度学习(DL)模型可以改善读者内部协议。使用小数据集进行医学成像的DL模型开发可能具有挑战性。迁移学习是DL模型开发中使用的一种技术,用于在数据有限的场景中提高模型性能。这里,我们研究了使用特定领域的RadImageNet数据集和非医学ImageNet进行迁移学习对将甲状腺结节分为良性和恶性的稳健性的影响.我们回顾性收集了在我们研究所接受细针抽吸的甲状腺结节患者的822张超声图像。我们拆分了我们的数据,并在测试集中使用了101个案例和721个案例进行交叉验证。训练Resnet-18模型以将甲状腺结节分为良性和恶性。然后,我们使用来自ImageNet和RadImageNet的转移权重训练了相同的模型架构。无迁移学习的甲状腺结节分类模型的AUROC为0.69。我们的模型在使用ImageNet预训练权重进行迁移学习后的AUROC为0.79。我们的模型从RadImageNet预训练权重的迁移学习中获得了0.83的AUROC。在使用ImageNet(p值=0.03)和RadImageNet迁移学习(p值<0.01)进行迁移学习之后,来自没有迁移学习的分类模型的AUROC显著改善。使用RadImageNet迁移学习的模型和使用ImageNet迁移学习的模型在性能上存在统计学上的显著差异(p值<0.01)。我们证明了RadImageNet作为甲状腺结节分类中迁移学习的特定领域来源的潜力。
    Thyroid nodule evaluation using ultrasound is dependent on radiologist experience, but deep learning (DL) models can improve intra-reader agreements. DL model development for medical imaging with small datasets can be challenging. Transfer learning is a technique used in the development of DL models to improve model performance in data-limited scenarios. Here, we investigate the impact of transfer learning with domain-specific RadImageNet dataset and non-medical ImageNet on the robustness of classifying thyroid nodules into benign and malignant. We retrospectively collected 822 ultrasound images of thyroid nodules of patients who underwent fine needle aspiration in our institute. We split our data and used 101 cases in a test set and 721 cases for cross-validation. A Resnet-18 model was trained to classify thyroid nodules into benign and malignant. Then, we trained the same model architecture with transferred weights from ImageNet and RadImageNet. The model without transfer learning for thyroid nodule classification achieved an AUROC of 0.69. The AUROC of our model after transfer learning with ImageNet pre-trained weights was 0.79. Our model achieved an AUROC of 0.83 from transfer learning of the RadImageNet pre-trained weights. The AUROC from the classification model without transfer learning significantly improved after transfer learning with ImageNet (p-value = 0.03) and RadImageNet transfer learning (p-value <0.01). There was a statistically significant distinction in performance between the model utilizing RadImageNet transfer learning and that employing ImageNet transfer learning (p-value <0.01). We demonstrate the potential of RadImageNet as a domain-specific source for transfer learning in thyroid nodule classification.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    为了了解动物行为的神经基础,在建立它们之间的关系之前,有必要监测自由运动动物的神经活动和行为。在这里,我们使用光片荧光显微镜(LSFM)结合微流控芯片,同时捕获小的自由行为果蝇幼虫的神经活动和身体运动。我们开发了一种基于迁移学习的方法,以使用具有精确界标估计网络的子区域跟踪网络同时跟踪一起移动的神经元的连续变化的身体姿势和活动,以推断目标界标轨迹。根据对每个标记神经元的跟踪,计算由荧光强度指示的神经元的活性。对于每个视频,视频中只有20帧的注释足以产生所有其他帧的人类水平的准确性。通过再现先前报道的PMSI(周期阳性中位节段中间神经元)和幼虫运动的活动模式,进一步证实了该方法的有效性。使用此方法,我们揭示了一组用R52H01-Gal4标记的未知神经元的活动中幼虫运动与左右不对称之间的相关性,并通过对这些神经元的遗传抑制进一步证实了这些神经元在幼虫爬行过程中身体收缩的双侧平衡中的作用。我们的方法为准确提取行为自由的小尺寸透明动物的神经活动和运动提供了新工具。
    To understand neural basis of animal behavior, it is necessary to monitor neural activity and behavior in freely moving animal before building relationship between them. Here we use light sheet fluorescence microscope (LSFM) combined with microfluidic chip to simultaneously capture neural activity and body movement in small freely behaving Drosophila larva. We develop a transfer learning based method to simultaneously track the continuously changing body posture and activity of neurons that move together using a sub-region tracking network with a precise landmark estimation network for the inference of target landmark trajectory. Based on the tracking of each labelled neuron, the activity of the neuron indicated by fluorescent intensity is calculated. For each video, annotation of only 20 frames in a video is sufficient to yield human-level accuracy for all other frames. The validity of this method is further confirmed by reproducing the activity pattern of PMSIs (period-positive median segmental interneurons) and larval movement as previously reported. Using this method, we disclosed the correlation between larval movement and left-right asymmetry in activity of a group of unidentified neurons labelled by R52H01-Gal4 and further confirmed the roles of these neurons in bilateral balance of body contraction during larval crawling by genetic inhibition of these neurons. Our method provides a new tool for accurate extraction of neural activities and movement of freely behaving small-size transparent animals.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    上转换纳米颗粒(UCNPs)和免疫层析的结合已成为一种广泛使用且有前途的新型检测技术,用于即时检测(POCT)。然而,它们的低发光效率,非特异性吸附,和图像噪声一直限制了它们在实际应用方面的进展。最近,人工智能(AI)在计算机视觉中展示了强大的代表性学习和泛化能力。我们首次报告了AI和基于上转换纳米颗粒的横向流测定(UCNP-LFA)的组合,用于定量检测商业物联网(IoT)设备。这种通用的UCNPs定量检测策略结合了高精度,灵敏度,以及在现场检测环境中的适用性。通过使用迁移学习在小型自建数据库中训练AI模型,我们不仅显著提高了定量检测的准确性和鲁棒性,同时也有效地解决了POCT设备数据稀缺、计算能力低的实际问题。然后,经过训练的AI模型部署在物联网设备中,从而检测过程不需要详细的数据预处理来实现定量结果的实时推断。我们在一个小数据集上使用八个迁移学习模型验证了两个检测器的定量检测。即使添加了强噪声,AI也可以快速提供超高精度的预测结果(某些模型可以达到100%的精度)。同时,该策略的高度灵活性有望成为光学生物传感器的通用定量检测方法。我们认为,这种策略和设备对于彻底改变现有的POCT技术格局并在体外诊断(IVD)行业提供出色的商业价值具有科学意义。
    The combination of upconverting nanoparticles (UCNPs) and immunochromatography has become a widely used and promising new detection technique for point-of-care testing (POCT). However, their low luminescence efficiency, non-specific adsorption, and image noise have always limited their progress toward practical applications. Recently, artificial intelligence (AI) has demonstrated powerful representational learning and generalization capabilities in computer vision. We report for the first time a combination of AI and upconversion nanoparticle-based lateral flow assays (UCNP-LFAs) for the quantitative detection of commercial internet of things (IoT) devices. This universal UCNPs quantitative detection strategy combines high accuracy, sensitivity, and applicability in the field detection environment. By using transfer learning to train AI models in a small self-built database, we not only significantly improved the accuracy and robustness of quantitative detection, but also efficiently solved the actual problems of data scarcity and low computing power of POCT equipment. Then, the trained AI model was deployed in IoT devices, whereby the detection process does not require detailed data preprocessing to achieve real-time inference of quantitative results. We validated the quantitative detection of two detectors using eight transfer learning models on a small dataset. The AI quickly provided ultra-high accuracy prediction results (some models could reach 100% accuracy) even when strong noise was added. Simultaneously, the high flexibility of this strategy promises to be a general quantitative detection method for optical biosensors. We believe that this strategy and device have a scientific significance in revolutionizing the existing POCT technology landscape and providing excellent commercial value in the in vitro diagnostics (IVD) industry.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号