Multi-modal

多模态
  • 文章类型: Journal Article
    视觉问答(VQA)是计算机视觉和自然语言处理领域中的一个重要跨学科问题,它需要计算机基于图片和基于图片提出的问题来输出自然语言答案。这就需要同时处理文本特征和视觉特征的多模态融合,确保其成功的关键任务是注意机制。引入注意力机制可以更好地将文本特征和图像特征集成到紧凑的多模态表示中。因此,有必要澄清注意机制的发展状况,了解最先进的注意力机制方法,并展望其未来的发展方向。在这篇文章中,我们首先通过CiteSpace对相关性进行文献计量分析,然后我们发现并合理推测注意机制在跨模态检索中具有巨大的发展潜力。其次,我们讨论了现有注意力机制在VQA任务中的分类和应用,分析他们的缺点,并总结目前的改进方法。最后,通过对注意力机制的不断探索,我们相信VQA将朝着更聪明,更人性化的方向发展。
    Visual Question Answering (VQA) is a significant cross-disciplinary issue in the fields of computer vision and natural language processing that requires a computer to output a natural language answer based on pictures and questions posed based on the pictures. This requires simultaneous processing of multimodal fusion of text features and visual features, and the key task that can ensure its success is the attention mechanism. Bringing in attention mechanisms makes it better to integrate text features and image features into a compact multi-modal representation. Therefore, it is necessary to clarify the development status of attention mechanism, understand the most advanced attention mechanism methods, and look forward to its future development direction. In this article, we first conduct a bibliometric analysis of the correlation through CiteSpace, then we find and reasonably speculate that the attention mechanism has great development potential in cross-modal retrieval. Secondly, we discuss the classification and application of existing attention mechanisms in VQA tasks, analysis their shortcomings, and summarize current improvement methods. Finally, through the continuous exploration of attention mechanisms, we believe that VQA will evolve in a smarter and more human direction.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    神经精神疾病的病因涉及不同组学层次的复杂生物过程,比如基因组学,转录组学,表观遗传学,蛋白质组学,和代谢组学。高通量技术的出现,以及大型开源数据集的可用性,开启了系统生物学的新纪元,需要整合各种类型的组学数据。生物机制的复杂性,综合战略的局限性,和多组学数据的异质性都对计算科学家提出了重大挑战。与早期和晚期整合相比,中间集成可以使用各种数据转换技术将每种数据类型转换为适当的中间表示,使其能够捕获每个组学中包含的更多互补信息,并突出跨组学层的新相互作用。这里,我们回顾了基于成分分析的多模态中间集成技术,矩阵分解,相似性网络,多内核学习,贝叶斯网络,人工神经网络,和图形转换,以及它们在神经精神病学领域的应用。我们描述了这些方法的进步,并比较了每种方法的优缺点。我们相信,我们的发现将有助于研究人员理解神经精神疾病中多组学数据的转化和整合。
    The etiology of neuropsychiatric disorders involves complex biological processes at different omics layers, such as genomics, transcriptomics, epigenetics, proteomics, and metabolomics. The advent of high-throughput technology, as well as the availability of large open-source datasets, has ushered in a new era in system biology, necessitating the integration of various types of omics data. The complexity of biological mechanisms, the limitations of integrative strategies, and the heterogeneity of multi-omics data have all presented significant challenges to computational scientists. In comparison to early and late integration, intermediate integration may transform each data type into appropriate intermediate representations using various data transformation techniques, allowing it to capture more complementary information contained in each omics and highlight new interactions across omics layers. Here, we reviewed multi-modal intermediate integrative techniques based on component analysis, matrix factorization, similarity network, multiple kernel learning, Bayesian network, artificial neural networks, and graph transformation, as well as their applications in neuropsychiatric domains. We depicted advancements in these approaches and compared the strengths and weaknesses of each method examined. We believe that our findings will aid researchers in their understanding of the transformation and integration of multi-omics data in neuropsychiatric disorders.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    本系统综述和荟萃分析旨在确定将物理和心理疗法结合起来的多模式疗法对由肌肉骨骼疾病引起的运动恐惧症的影响,与仅进行植物学治疗或心理治疗的单模式疗法相比。搜索词及其逻辑连接器如下:(1)标题或摘要中的“运动恐惧症”;(2)标题或摘要中的“随机化”或“随机化”;标题中的“设计”或“协议”不是(3)。它们被输入Medline(EBSCO)的数据库,PubMed,而奥维德,遵循这些数据库的不同输入规则。资格标准为:(1)患有肌肉骨骼疾病或疾病的成年人为患者;(2)结合物理和心理治疗的多模式疗法作为干预措施;(3)仅采用物理或心理治疗的单一模式疗法作为比较;(4)坦帕运动恐惧症量表17项版本的得分作为结果;(5)随机对照试验作为研究设计。因此,纳入了12项研究,其统计学意义为6.99(95%CI4.59至9.38)。尽管研究中存在很大的异质性,在总体和细分分析中,多模式疗法在减少运动恐惧症方面可能比仅进行物理或心理治疗的单峰疗法更有效.效果可能随着年龄的增长而降低。更重要的是,通过考虑Tampa运动恐惧症量表的重测信度,本综述的数学方法是可行的.
    This systematic review and meta-analysis aimed to identify the effect of multi-modal therapies that combined physical and psychological therapies for kinesiophobia caused by musculoskeletal disorders compared with uni-modal therapy of only phycological therapy or psychological therapy. The search terms and their logical connector were as following: (1) \"kinesiophobia\" at the title or abstract; and (2) \"randomized\" OR \"randomized\" at title or abstract; not (3) \"design\" OR \"protocol\" at the title. They were typed into the databases of Medline (EBSCO), PubMed, and Ovid, following the different input rules of these databases. The eligibility criteria were: (1) Adults with musculoskeletal disorders or illness as patients; (2) Multi-modal therapies combined physical and psychological therapy as interventions; (3) Uni-modal therapy of only physical or psychological therapy as a comparison; (4) The scores of the 17-items version of the Tampa Scale of Kinesiophobia as the outcome; (5) Randomized controlled trials as study design. As a result, 12 studies were included with a statistically significant polled effect of 6.99 (95% CI 4.59 to 9.38). Despite a large heterogeneity within studies, multi-modal therapies might be more effective in reducing kinesiophobia than the unimodal of only physical or psychological therapy both in the total and subdivision analysis. The effect might decrease with age. What\'s more, this review\'s mathematical methods were feasible by taking test-retest reliability of the Tampa Scale of Kinesiophobia into consideration.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    Adjuvants are medications that work synergistically with local anesthetics to help enhance the duration and quality of analgesia in regional techniques. Regional anesthesia has become more prevalent as evidence continues to show efficacy, enhancement of patient care, increased patient satisfaction, and improved patient safety. Practitioners in the perioperative setting need to not only be familiar with regional techniques but also the medications used for them. Some examples of adjuvant medications for regional techniques include dexamethasone, alpha 2 agonists such as clonidine and dexmedetomidine, midazolam, buprenorphine, NMDA antagonists, including ketamine and magnesium, neostigmine, sodium bicarbonate, epinephrine, and non-steroidal anti-inflammatory drugs. The aim of the present investigation, therefore, is to provide a comprehensive review of the most commonly used non-opioid adjuvants in clinical practice today. Regional adjuvants can improve patient safety, increase patient satisfaction, and enhance clinical efficacy. Future studies and best practice techniques can facilitate standardization of regional anesthesia adjuvant dosing when providing nerve blocks in clinical practice.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Journal Article
    Hepatocellular carcinoma (HCC) arises from a number of cirrhosis-related and non-cirrhosis-related exposures and is one of the leading causes of cancer-related deaths worldwide. Achieving a durable cure currently relies on either resection or transplantation, but since most patients will be diagnosed with inoperable disease, there is great interest in achieving more effective systemic therapies. At a molecular level, HCC is heterogeneous, but initial treatment strategies, including the use of multi-targeted tyrosine kinase inhibitors and checkpoint inhibitors, have been fairly homogenous, depending on general host factors and overall tumor burden rather than specific molecular signatures. Over the past 2 decades, however, there has been significant success in identifying key molecular targets, including driver mutations involving the telomerase reverse transcriptase, p53, and beta-catenin genes, and significant work is now being devoted to translating these discoveries into the development of robust and well-tolerated targeted therapies. Furthermore, multi-modal therapies have also begun to emerge, harnessing possible synergism amongst a variety of different treatment classes. As the findings of these landmark trials become available over the next several years, the landscape of the systemic management of advanced HCC will change significantly.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号