PDF(Pubmed)
Abstract：
Despite its high prevalence and significance, there is still no widely available method to quantify cough. In order to demonstrate agreement with the current gold standard of human annotation, emerging automated techniques require a robust, reproducible approach to annotation. We describe the extent to which a human annotator of cough sounds (a) agrees with herself (intralabeller or intrarater agreement) and (b) agrees with other independent labellers (interlabeller or inter-rater agreement); we go on to describe significant sex differences in cough sound length and epochs size.
24 participants wore an audiorecording smartwatch to capture 6-24 hours of continuous audio. A randomly selected sample of the whole audio was labelled twice by an expert annotator and a third time by six trained annotators. We collected 400 hours of audio and analysed 40 hours. The cough counts as well as cough seconds (any 1 s of time containing at least one cough) from different annotators were compared and summary statistics from linear and Bland-Altman analyses were used to quantify intraobserver and interobserver agreement.
There was excellent intralabeller (less than two disagreements per hour monitored, Pearson\'s correlation 0.98) and interlabeller agreement (Pearson\'s correlation 0.96), using cough seconds as the unit of analysis decreased annotator discrepancies by 50% in comparison to coughs. Within this data set, it was observed that the length of cough sounds and epoch size (number of coughs per bout or attach) differed between women and men.
Given the decreased interobserver variability in annotation when using cough seconds (vs just coughs) we propose their use for manually annotating cough when assessing of the performance of automatic cough monitoring systems. The differences in cough sound length and epochs size may have important implications for equality in the development of cough monitoring tools.
NCT05042063.
24 participants wore an audiorecording smartwatch to capture 6-24 hours of continuous audio. A randomly selected sample of the whole audio was labelled twice by an expert annotator and a third time by six trained annotators. We collected 400 hours of audio and analysed 40 hours. The cough counts as well as cough seconds (any 1 s of time containing at least one cough) from different annotators were compared and summary statistics from linear and Bland-Altman analyses were used to quantify intraobserver and interobserver agreement.
There was excellent intralabeller (less than two disagreements per hour monitored, Pearson\'s correlation 0.98) and interlabeller agreement (Pearson\'s correlation 0.96), using cough seconds as the unit of analysis decreased annotator discrepancies by 50% in comparison to coughs. Within this data set, it was observed that the length of cough sounds and epoch size (number of coughs per bout or attach) differed between women and men.
Given the decreased interobserver variability in annotation when using cough seconds (vs just coughs) we propose their use for manually annotating cough when assessing of the performance of automatic cough monitoring systems. The differences in cough sound length and epochs size may have important implications for equality in the development of cough monitoring tools.
NCT05042063.
摘要：
背景：尽管它的患病率和重要性很高，仍然没有广泛可用的方法来量化咳嗽。为了证明与当前人类注释的黄金标准一致，新兴的自动化技术需要强大的，可重复的注释方法。我们描述了咳嗽声音的人类注释者（a）与自己（内部标记者或内部标记者同意）和（b）与其他独立标记者（标记者或评估者之间同意）的程度；我们继续描述咳嗽声音长度和时期大小的显着性别差异。
方法：24名参与者佩戴听音智能手表来捕捉6-24小时的连续音频。整个音频的随机选择的样本由专家注释器标记两次，由六个经过训练的注释器标记第三次。我们收集了400小时的音频并分析了40小时。比较了来自不同注释者的咳嗽计数以及咳嗽秒（包含至少一次咳嗽的任何1秒时间），并使用线性和Bland-Altman分析的汇总统计数据来量化观察者内部和观察者之间的一致性。
结果：有出色的内部调整者（每小时监测不到两次分歧，皮尔逊相关性0.98)和标签间协议(皮尔逊相关性0.96)，使用咳嗽秒作为分析单位，与咳嗽相比，注释者的差异减少了50％。在这个数据集中，据观察，咳嗽声音的长度和时期大小（每回合或依恋咳嗽的次数）在女性和男性之间有所不同。
结论：鉴于使用咳嗽秒数（与仅咳嗽相比）时观察者间注释的变异性降低，我们建议在评估自动咳嗽监测系统的性能时将其用于手动注释咳嗽。咳嗽声音长度和时期大小的差异可能对咳嗽监测工具的开发具有重要意义。
背景：NCT05042063。
方法：24名参与者佩戴听音智能手表来捕捉6-24小时的连续音频。整个音频的随机选择的样本由专家注释器标记两次，由六个经过训练的注释器标记第三次。我们收集了400小时的音频并分析了40小时。比较了来自不同注释者的咳嗽计数以及咳嗽秒（包含至少一次咳嗽的任何1秒时间），并使用线性和Bland-Altman分析的汇总统计数据来量化观察者内部和观察者之间的一致性。
结果：有出色的内部调整者（每小时监测不到两次分歧，皮尔逊相关性0.98)和标签间协议(皮尔逊相关性0.96)，使用咳嗽秒作为分析单位，与咳嗽相比，注释者的差异减少了50％。在这个数据集中，据观察，咳嗽声音的长度和时期大小（每回合或依恋咳嗽的次数）在女性和男性之间有所不同。
结论：鉴于使用咳嗽秒数（与仅咳嗽相比）时观察者间注释的变异性降低，我们建议在评估自动咳嗽监测系统的性能时将其用于手动注释咳嗽。咳嗽声音长度和时期大小的差异可能对咳嗽监测工具的开发具有重要意义。
背景：NCT05042063。
