Investigating ligand-protein complexes is essential in the areas of chemical biology and drug discovery. However, detailed information on key reagents such as fluorescent tracers and associated data for the development of widely used bioluminescence resonance energy transfer (BRET) assays including NanoBRET, time-resolved Förster resonance energy transfer (TR-FRET) and fluorescence polarization (FP) assays are not easily accessible to the research community. We created tracerDB, a curated database of validated tracers. This resource provides an open access knowledge base and a unified system for tracer and assay validation. The database is freely available at https://www.tracerdb.org/ .

BACKGROUND: Machine learning (ML) models can yield faster and more accurate medical diagnoses; however, developing ML models is limited by a lack of high-quality labeled training data. Crowdsourced labeling is a potential solution but can be constrained by concerns about label quality.
OBJECTIVE: This study aims to examine whether a gamified crowdsourcing platform with continuous performance assessment, user feedback, and performance-based incentives could produce expert-quality labels on medical imaging data.
METHODS: In this diagnostic comparison study, 2384 lung ultrasound clips were retrospectively collected from 203 emergency department patients. A total of 6 lung ultrasound experts classified 393 of these clips as having no B-lines, one or more discrete B-lines, or confluent B-lines to create 2 sets of reference standard data sets (195 training clips and 198 test clips). Sets were respectively used to (1) train users on a gamified crowdsourcing platform and (2) compare the concordance of the resulting crowd labels to the concordance of individual experts to reference standards. Crowd opinions were sourced from DiagnosUs (Centaur Labs) iOS app users over 8 days, filtered based on past performance, aggregated using majority rule, and analyzed for label concordance compared with a hold-out test set of expert-labeled clips. The primary outcome was comparing the labeling concordance of collated crowd opinions to trained experts in classifying B-lines on lung ultrasound clips.
RESULTS: Our clinical data set included patients with a mean age of 60.0 (SD 19.0) years; 105 (51.7%) patients were female and 114 (56.1%) patients were White. Over the 195 training clips, the expert-consensus label distribution was 114 (58%) no B-lines, 56 (29%) discrete B-lines, and 25 (13%) confluent B-lines. Over the 198 test clips, expert-consensus label distribution was 138 (70%) no B-lines, 36 (18%) discrete B-lines, and 24 (12%) confluent B-lines. In total, 99,238 opinions were collected from 426 unique users. On a test set of 198 clips, the mean labeling concordance of individual experts relative to the reference standard was 85.0% (SE 2.0), compared with 87.9% crowdsourced label concordance (P=.15). When individual experts\' opinions were compared with reference standard labels created by majority vote excluding their own opinion, crowd concordance was higher than the mean concordance of individual experts to reference standards (87.4% vs 80.8%, SE 1.6 for expert concordance; P<.001). Clips with discrete B-lines had the most disagreement from both the crowd consensus and individual experts with the expert consensus. Using randomly sampled subsets of crowd opinions, 7 quality-filtered opinions were sufficient to achieve near the maximum crowd concordance.
CONCLUSIONS: Crowdsourced labels for B-line classification on lung ultrasound clips via a gamified approach achieved expert-level accuracy. This suggests a strategic role for gamified crowdsourcing in efficiently generating labeled image data sets for training ML systems.

Online participant recruitment (\"crowdsourcing\") platforms are increasingly being used for research studies. While such platforms can rapidly provide access to large samples, there are concomitant concerns around data quality. Researchers have studied and demonstrated means to reduce the prevalence of low-quality data from crowdsourcing platforms, but approaches to doing so often involve rejecting work and/or denying payment to participants, which can pose ethical dilemmas. We write this essay as an associate professor and two institutional review board (IRB) directors to provide a perspective on the competing interests of participants/workers and researchers and to propose a checklist of steps that we believe may support workers\' agency on the platform and lessen instances of unfair consequences to them while enabling researchers to definitively reject lower-quality work that might otherwise reduce the likelihood of their studies producing true results. We encourage further, explicit discussion of these issues among academics and among IRBs.

暂无摘要。

PubChem ( https://pubchem.ncbi.nlm.nih.gov ) is a public chemical information resource containing more than 100 million unique chemical structures. One of the most requested tasks in PubChem and other chemical databases is to search chemicals by name (also commonly called a \"chemical synonym\"). PubChem performs this task by looking up chemical synonym-structure associations provided by individual depositors to PubChem. In addition, these synonyms are used for many purposes, including creating links between chemicals and PubMed articles (using Medical Subject Headings (MeSH) terms). However, these depositor-provided name-structure associations are subject to substantial discrepancies within and between depositors, making it difficult to unambiguously map a chemical name to a specific chemical structure. The present paper describes PubChem\'s crowdsourcing-based synonym filtering strategy, which resolves inter- and intra-depositor discrepancies in synonym-structure associations as well as in the chemical-MeSH associations. The PubChem synonym filtering process was developed based on the analysis of four crowd-voting strategies, which differ in the consistency threshold value employed (60% vs 70%) and how to resolve intra-depositor discrepancies (a single vote vs. multiple votes per depositor) prior to inter-depositor crowd-voting. The agreement of voting was determined at six levels of chemical equivalency, which considers varying isotopic composition, stereochemistry, and connectivity of chemical structures and their primary components. While all four strategies showed comparable results, Strategy I (one vote per depositor with a 60% consistency threshold) resulted in the most synonyms assigned to a single chemical structure as well as the most synonym-structure associations disambiguated at the six chemical equivalency contexts. Based on the results of this study, Strategy I was implemented in PubChem\'s filtering process that cleans up synonym-structure associations as well as chemical-MeSH associations. This consistency-based filtering process is designed to look for a consensus in name-structure associations but cannot attest to their correctness. As a result, it can fail to recognize correct name-structure associations (or incorrect ones), for example, when a synonym is provided by only one depositor or when many contributors are incorrect. However, this filtering process is an important starting point for quality control in name-structure associations in large chemical databases like PubChem.

Citizen science is personal. Participation is contingent on the citizens\' connection to a topic or to interpersonal relationships meaningful to them. But from the peer-reviewed literature, scientists appear to have an acquisitive data-centered relationship with citizens. This has spurred ethical and pragmatic criticisms of extractive relationships with citizen scientists. We suggest five practical steps to shift citizen-science research from extractive to relational, reorienting the research process and providing reciprocal benefits to researchers and citizen scientists. By virtue of their interests and experience within their local environments, citizen scientists have expertise that, if engaged, can improve research methods and product design decisions. To boost the value of scientific outputs to society and participants, citizen-science research teams should rethink how they engage and value volunteers.

BACKGROUND: Patients may use crowdfunding to solicit donations, typically from multiple small donors using internet-based means, to offset the financial toxicity of cancer care.
OBJECTIVE: To describe crowdfunding campaigns by gynecologic cancer patients and to compare campaign characteristics and needs expressed between patients with cervical, uterine, and ovarian cancer.
METHODS: We queried the public crowdfunding forum GoFundMe.com for \"cervical cancer,\" \"uterine cancer,\" and \"ovarian cancer.\" The first 200 consecutive posts for each cancer type fundraising within the United States were analyzed. Data on campaign goals and needs expressed were manually extracted. Descriptive statistics and bivariate analyses were performed.
RESULTS: Among the 600 fundraising pages, the median campaign goal was $10,000 [IQR $5000-$23,000]. Campaigns raised a median of 28.6% of their goal with only 8.7% of campaigns reaching their goal after a median of 54 days online. On average, ovarian cancer campaigns had higher monetary goals, more donors, and larger donation amounts than cervical cancer campaigns and raised more money than both cervical and uterine cancer campaigns. Campaigns were fundraising to support medical costs (80-85%) followed by lost wages (36-56%) or living expenses (27-41%). Cervical cancer campaigns reported need for non-medical costs more frequently than uterine or ovarian cancer campaigns. States without Medicaid expansions (31% of the national population) were over-represented among cervical cancer and uterine cancer, but not ovarian cancer campaigns.
CONCLUSIONS: Crowdfunding pages reveal patients fundraising for out-of-pocket costs in the thousands of dollars and a wide range of unmet financial needs based on cancer type.

UNASSIGNED: Planners increasingly involve stakeholders in co-producing vital planning information by crowdsourcing data using online map-based commenting platforms. Few studies, however, investigate the role and impact of such online platforms on planning outcomes. We evaluate the impact of participant input via a public participation geographic information system (PPGIS), a platform to suggest the placement of new bike share stations in New York City (NY) and Chicago (IL). We conducted 2 analyses to evaluate how close planners built new bike share stations to those suggested on PPGIS platforms. According to our proximity analysis, only a small percentage of built stations were within 100 feet (30m) of suggested stations, but our geospatial analysis showed a substantial clustering of suggested and built stations in both cities that was not likely due to random distribution. We found that the PPGIS platforms have great promise for creating genuine co-production of planning knowledge and insights and that system planners did take account of the suggestions offered online. We did not, however, interview planners in either system, and both cities may be atypical, as is bike share planning; moreover, multiple factors influence where bike stations can be located, so not all suggested stations could be built.
UNASSIGNED: Planners can use PPGIS and similar platforms to help stakeholders learn by doing and to increase their own local knowledge to improve planning outcomes. Planners should work to develop better online participatory systems and to allow stakeholders to provide more and better data, continuing to evaluate PPGIS efforts to improve the transparency and legitimacy of online public involvement processes.

Low uptake of the COVID-19 vaccine in the US has been widely attributed to social media misinformation. To evaluate this claim, we introduce a framework combining lab experiments (total N = 18,725), crowdsourcing, and machine learning to estimate the causal effect of 13,206 vaccine-related URLs on the vaccination intentions of US Facebook users (N ≈ 233 million). We estimate that the impact of unflagged content that nonetheless encouraged vaccine skepticism was 46-fold greater than that of misinformation flagged by fact-checkers. Although misinformation reduced predicted vaccination intentions significantly more than unflagged vaccine content when viewed, Facebook users\' exposure to flagged content was limited. In contrast, unflagged stories highlighting rare deaths after vaccination were among Facebook\'s most-viewed stories. Our work emphasizes the need to scrutinize factually accurate but potentially misleading content in addition to outright falsehoods.

BACKGROUND: In the digital age, search engines and social media platforms are primary sources for health information, yet their commercial interests-focused algorithms often prioritize irrelevant content. Web-based health applications by reputable sources offer a solution to circumvent these biased algorithms. Despite this advantage, there remains a significant gap in research on the effective integration of content-ranking algorithms within these specialized health applications to ensure the delivery of personalized and relevant health information.
OBJECTIVE: This study introduces a generic methodology designed to facilitate the development and implementation of health information recommendation features within web-based health applications.
METHODS: We detail our proposed methodology, covering conceptual foundation and practical considerations through the stages of design, development, operation, review, and optimization in the software development life cycle. Using a case study, we demonstrate the practical application of the proposed methodology through the implementation of recommendation functionalities in the EndoZone platform, a platform dedicated to providing targeted health information on endometriosis.
RESULTS: Application of the proposed methodology in the EndoZone platform led to the creation of a tailored health information recommendation system known as EndoZone Informatics. Feedback from EndoZone stakeholders as well as insights from the implementation process validate the methodology\'s utility in enabling advanced recommendation features in health information applications. Preliminary assessments indicate that the system successfully delivers personalized content, adeptly incorporates user feedback, and exhibits considerable flexibility in adjusting its recommendation logic. While certain project-specific design flaws were not caught in the initial stages, these issues were subsequently identified and rectified in the review and optimization stages.
CONCLUSIONS: We propose a generic methodology to guide the design and implementation of health information recommendation functionality within web-based health information applications. By harnessing user characteristics and feedback for content ranking, this methodology enables the creation of personalized recommendations that align with individual user needs within trusted health applications. The successful application of our methodology in the development of EndoZone Informatics marks a significant progress toward personalized health information delivery at scale, tailored to the specific needs of users.