PDF(Pubmed)
Abstract：
Following a flurry of policies for Open Science (OS), there is now a wave of initiatives to monitor its adoption. However, the great diversity of understandings and activities related to Open Science makes monitoring very challenging. There is a danger that by focusing on what can be readily observed (e.g. publications) many other OS activities are overlooked (e.g. participation), with a potential narrowing of OS scope, streetlight effects, and deviation from the values of OS. Since Open Science can be understood as a systemic transformation of the research system, we have borrowed concepts from Transformative Innovation Policies frameworks which aim at evaluating socio-technical transitions. In accordance with this view of OS as a systemic transformation, we propose that the new monitoring efforts should shift towards: (i) systemic perspectives which considers the various actions related to OS, including policies and outputs (e.g. datasets) but also processes (e.g. participatory events), outcomes (e.g. citizen interest in science) and expected impacts (e.g. better scientific contributions to addressing societal problems); (ii) implementation of monitoring as reflexive learning (rather than accountability or benchmarking); (iii) mapping the directionality of the activities and the values associated with the choices in directions. In summary, a monitoring framework for OS requires a profound change in conventional monitoring practices. The scope should broaden from current focus on outputs (such as publications) towards the processes of connection that make science \'open\' (usage, co-creation and dialogue), as well as towards outcomes (changes in practices) and the longer-term impacts that reflect the values and normative commitments of OS.
摘要：
在一系列开放科学(OS)政策之后，现在有一波举措来监测其采用情况。然而,与开放科学相关的理解和活动的多样性使得监测非常具有挑战性。有一个危险，通过专注于可以容易观察到的内容（例如出版物），许多其他操作系统活动被忽略（例如参与），随着操作系统范围的潜在缩小，路灯效果，以及与OS值的偏差。由于开放科学可以理解为研究体系的系统性转变，我们借鉴了旨在评估社会技术转型的转型创新政策框架中的概念。根据操作系统作为系统转换的观点，我们建议新的监测工作应转向:(i)考虑与操作系统有关的各种行动的系统观点，包括策略和输出（例如数据集），但也包括过程（例如参与式事件），结果（例如公民对科学的兴趣）和预期的影响（例如对解决社会问题的更好的科学贡献）；（ii）将监测作为反身学习（而不是问责制或基准）实施；（iii）绘制活动的方向性以及与方向选择相关的价值观。总之,操作系统的监控框架需要对传统的监控实践进行深刻的改变。范围应从当前对输出（例如出版物）的关注扩展到使科学“开放”的连接过程（用法，共同创造和对话)，以及对结果（实践的变化）和反映OS的价值观和规范承诺的长期影响。
