Abstract:
Human moral reactions to artificial intelligence (AI) agents\' behavior constitute an important aspect of modern-day human-AI relationships. Although previous studies have mainly focused on autonomy ethics, this study investigates how individuals judge AI agents\' violations of community ethics (including betrayals and subversions) compared with human violations. Participants\' behavioral responses, event-related potentials (ERPs), and individual differences were assessed. Behavioral findings reveal that participants rated AI agents\' community-violating actions less morally negative than human transgressions, possibly because AI agents are commonly perceived as having less agency than human adults. The ERP N1 component showed the same pattern with moral rating scores, indicating the modulation effect of human-AI differences on initial moral intuitions. Moreover, the level of social withdrawal correlated with a smaller N1 in the human condition but not in the AI condition. The N2 and P2 components were sensitive to the difference between the loyalty/betrayal and authority/subversion domains but not human/AI differences. Individual levels of moral sense and autistic traits also influenced behavioral data, especially on the loyalty/betrayal domain. In our opinion, these findings offer insights for predicting moral responses to AI agents and guiding ethical AI development aligned with human moral values.
摘要:
人类对人工智能(AI)代理人行为的道德反应构成了现代人类与AI关系的重要方面。尽管以前的研究主要集中在自治伦理上,这项研究调查了个人如何判断AI代理人违反社区道德(包括背叛和颠覆)与违反人类的行为相比。参与者的行为反应,事件相关电位(ERP),并评估了个体差异。行为研究结果表明,参与者对人工智能代理人的社区侵犯行为的道德负面评价低于人类的侵犯行为,可能是因为人工智能代理人通常被认为比成年人具有更少的代理人。ERPN1组件在道德评分方面表现出相同的模式,表明人类-人工智能差异对初始道德直觉的调节作用。此外,在人类状况下,社会退缩的水平与较小的N1相关,而在AI状况下则不相关。N2和P2组件对忠诚/背叛和权威/颠覆域之间的差异敏感,但对人类/AI差异不敏感。个人的道德感和自闭症特征水平也影响了行为数据,特别是在忠诚/背叛领域。在我们看来,这些发现为预测对AI代理人的道德反应和指导符合人类道德价值观的道德AI发展提供了见解。