24 participants wore an audiorecording smartwatch to capture 6-24 hours of continuous audio. A randomly selected sample of the whole audio was labelled twice by an expert annotator and a third time by six trained annotators. We collected 400 hours of audio and analysed 40 hours. The cough counts as well as cough seconds (any 1 s of time containing at least one cough) from different annotators were compared and summary statistics from linear and Bland-Altman analyses were used to quantify intraobserver and interobserver agreement.
There was excellent intralabeller (less than two disagreements per hour monitored, Pearson\'s correlation 0.98) and interlabeller agreement (Pearson\'s correlation 0.96), using cough seconds as the unit of analysis decreased annotator discrepancies by 50% in comparison to coughs. Within this data set, it was observed that the length of cough sounds and epoch size (number of coughs per bout or attach) differed between women and men.
Given the decreased interobserver variability in annotation when using cough seconds (vs just coughs) we propose their use for manually annotating cough when assessing of the performance of automatic cough monitoring systems. The differences in cough sound length and epochs size may have important implications for equality in the development of cough monitoring tools.
NCT05042063.
方法:24名参与者佩戴听音智能手表来捕捉6-24小时的连续音频。整个音频的随机选择的样本由专家注释器标记两次,由六个经过训练的注释器标记第三次。我们收集了400小时的音频并分析了40小时。比较了来自不同注释者的咳嗽计数以及咳嗽秒(包含至少一次咳嗽的任何1秒时间),并使用线性和Bland-Altman分析的汇总统计数据来量化观察者内部和观察者之间的一致性。
结果:有出色的内部调整者(每小时监测不到两次分歧,皮尔逊相关性0.98)和标签间协议(皮尔逊相关性0.96),使用咳嗽秒作为分析单位,与咳嗽相比,注释者的差异减少了50%。在这个数据集中,据观察,咳嗽声音的长度和时期大小(每回合或依恋咳嗽的次数)在女性和男性之间有所不同。
结论:鉴于使用咳嗽秒数(与仅咳嗽相比)时观察者间注释的变异性降低,我们建议在评估自动咳嗽监测系统的性能时将其用于手动注释咳嗽。咳嗽声音长度和时期大小的差异可能对咳嗽监测工具的开发具有重要意义。
背景:NCT05042063。