PDF(Pubmed)
Abstract：
BACKGROUND: There is a need for valid and reliable measures of determinants of sustainability of public health interventions in early childhood education and care (ECEC) settings. This study aimed to develop and evaluate the psychometric and pragmatic properties of such a measure - the Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C).
METHODS: We undertook a two-phase process guided by the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN) and Psychometric and Pragmatic Evidence Rating Scale (PAPERS). Phase 1 involved measure development; i.e., determining items and scales through an iterative process and assessment of face and content validity. Phase 2 involved the evaluation of psychometric and pragmatic properties. The 29-item measure completed by service executives (directors and nominated supervisors) was embedded in a larger survey from a national sample of Australian ECEC services assessing their implementation of nutrition and physical activity programs. Structural validity, concurrent validity, known groups validity, internal consistency, floor and ceiling effects, norms, and pragmatic qualities of the measure were assessed according to the PAPERS criteria.
RESULTS: The final measure contained 26 items, with respondents reporting how strongly they agreed or disagreed on a five-point Likert scale. Phase 1 assessments confirmed the relevance, and face and content validity of the scale. In Phase 2, we obtained 482 completed surveys, of which 84% (n = 405) completed the entire measure across 405 ECEC settings (one executive per service). Three of the four fit indices for the confirmatory factor analysis met the pre-specified criteria (SRMR = 0.056, CFI = 0.993, RMSEA = 0.067) indicating \'good\' structural validity. The IMPRESS-C illustrated: \'good\' internal consistency, with Cronbach\'s alpha values from 0.53 to 0.92; \'emerging\' concurrent validity; \'poor\' known groups validity; \'good\' norms; and \'good\' overall pragmatic qualities (cost, readability, length, and assessor burden).
CONCLUSIONS: The IMPRESS-C possesses strong psychometric and pragmatic qualities for assessing service executive-level perceptions of determinants influencing sustainment of public health interventions within ECEC settings. To achieve a full range of perspectives in this setting, future work should be directed to also develop and test measures of sustainability determinants at the implementer level (e.g., among individual educators and staff).
METHODS: We undertook a two-phase process guided by the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN) and Psychometric and Pragmatic Evidence Rating Scale (PAPERS). Phase 1 involved measure development; i.e., determining items and scales through an iterative process and assessment of face and content validity. Phase 2 involved the evaluation of psychometric and pragmatic properties. The 29-item measure completed by service executives (directors and nominated supervisors) was embedded in a larger survey from a national sample of Australian ECEC services assessing their implementation of nutrition and physical activity programs. Structural validity, concurrent validity, known groups validity, internal consistency, floor and ceiling effects, norms, and pragmatic qualities of the measure were assessed according to the PAPERS criteria.
RESULTS: The final measure contained 26 items, with respondents reporting how strongly they agreed or disagreed on a five-point Likert scale. Phase 1 assessments confirmed the relevance, and face and content validity of the scale. In Phase 2, we obtained 482 completed surveys, of which 84% (n = 405) completed the entire measure across 405 ECEC settings (one executive per service). Three of the four fit indices for the confirmatory factor analysis met the pre-specified criteria (SRMR = 0.056, CFI = 0.993, RMSEA = 0.067) indicating \'good\' structural validity. The IMPRESS-C illustrated: \'good\' internal consistency, with Cronbach\'s alpha values from 0.53 to 0.92; \'emerging\' concurrent validity; \'poor\' known groups validity; \'good\' norms; and \'good\' overall pragmatic qualities (cost, readability, length, and assessor burden).
CONCLUSIONS: The IMPRESS-C possesses strong psychometric and pragmatic qualities for assessing service executive-level perceptions of determinants influencing sustainment of public health interventions within ECEC settings. To achieve a full range of perspectives in this setting, future work should be directed to also develop and test measures of sustainability determinants at the implementer level (e.g., among individual educators and staff).
摘要：
背景：在幼儿教育和护理（ECEC）环境中，需要有效和可靠地衡量公共卫生干预措施可持续性的决定因素。这项研究旨在开发和评估这种措施的心理测量和语用特性-儿童保育环境中PRogram元素可持续能力的综合措施（IMPRESS-C）。
方法：我们进行了一个两阶段的过程，该过程以基于认知的健康状态测量指标清单（COSMIN）和心理测量和语用证据评定量表（PAPERS）的选择标准为指导。第一阶段涉及测量开发；即，通过迭代过程确定项目和量表，并评估面部和内容的有效性。第二阶段涉及心理测量和语用属性的评估。由服务主管（董事和提名的主管）完成的29项措施包含在一项更大的调查中，该调查来自澳大利亚ECEC服务的国家样本，评估其营养和体育活动计划的执行情况。结构有效性，并发有效性，已知群体有效性，内部一致性，地板和天花板效果，规范,根据PAPERS标准评估该措施的语用质量。
结果：最终措施包含26个项目，受访者报告他们对五点李克特量表的同意或不同意程度。第一阶段评估确认了相关性，以及量表的面形和内容效度。在第二阶段，我们完成了482项调查，其中84%(n=405)在405个ECEC设置(每个服务一名高管)中完成了整个测量。验证性因子分析的四个拟合指数中的三个符合预先指定的标准（SRMR=0.056，CFI=0.993，RMSEA=0.067），表明结构有效性良好。IMPRESS-C说明：\'好\'内部一致性，Cronbach的alpha值从0.53到0.92；“新兴”并发有效性；“差”已知群体有效性；“好”规范；和“好”整体语用质量(成本，可读性,长度,和评估员负担)。
结论：IMPRESS-C具有很强的心理测量和语用素质，可用于评估服务执行人员对影响ECEC环境中公共卫生干预措施维持的决定因素的看法。要在此设置中实现全方位的视角，未来的工作应针对在实施者一级制定和测试可持续性决定因素的措施(例如，在个别教育工作者和工作人员中)。
方法：我们进行了一个两阶段的过程，该过程以基于认知的健康状态测量指标清单（COSMIN）和心理测量和语用证据评定量表（PAPERS）的选择标准为指导。第一阶段涉及测量开发；即，通过迭代过程确定项目和量表，并评估面部和内容的有效性。第二阶段涉及心理测量和语用属性的评估。由服务主管（董事和提名的主管）完成的29项措施包含在一项更大的调查中，该调查来自澳大利亚ECEC服务的国家样本，评估其营养和体育活动计划的执行情况。结构有效性，并发有效性，已知群体有效性，内部一致性，地板和天花板效果，规范,根据PAPERS标准评估该措施的语用质量。
结果：最终措施包含26个项目，受访者报告他们对五点李克特量表的同意或不同意程度。第一阶段评估确认了相关性，以及量表的面形和内容效度。在第二阶段，我们完成了482项调查，其中84%(n=405)在405个ECEC设置(每个服务一名高管)中完成了整个测量。验证性因子分析的四个拟合指数中的三个符合预先指定的标准（SRMR=0.056，CFI=0.993，RMSEA=0.067），表明结构有效性良好。IMPRESS-C说明：\'好\'内部一致性，Cronbach的alpha值从0.53到0.92；“新兴”并发有效性；“差”已知群体有效性；“好”规范；和“好”整体语用质量(成本，可读性,长度,和评估员负担)。
结论：IMPRESS-C具有很强的心理测量和语用素质，可用于评估服务执行人员对影响ECEC环境中公共卫生干预措施维持的决定因素的看法。要在此设置中实现全方位的视角，未来的工作应针对在实施者一级制定和测试可持续性决定因素的措施(例如，在个别教育工作者和工作人员中)。
