近年来,人工智能军事化进程正随着复杂多变的国际局势高速发展。从人工智能的概念及其伦理风险出发,列举了国内外军用人工智能发展中具有代表性的伦理问题,包括身份识别技术与道德判断、责任归属、由人工智能失控引发的灾难问题等。分析了人工智能军事化伦理风险产生的根本原因,提出了以确保避免军用人工智能造成人类重大灾难为底线、持续改善军用人工智能存在的问责差距与技术漏洞、努力推进国际之间军用人工智能话题的积极讨论等3方面建议。
In recent years, the militarization process of artificial intelligence is developing rapidly with the complex and changeable international situation. Starting from the concept of artificial intelligence and its ethical risks, this paper lists the representative ethical issues in the development of military artificial intelligence both in domestic and abroad, including identification technology and moral judgment, responsibility attribution, and disaster caused by the artificial intelligence out of control. This paper analyzes the primary causes of the ethical risks arising from the militarization of artificial intelligence, and puts forward suggestions from three aspects: ensuring the bottom line of avoiding major human disasters caused by military artificial intelligence, continuously improving the accountability gap and technical vulnerability existing in military artificial intelligence, and striving to promote the active discussion of military artificial intelligence topics in the international community,so as to provide ethical review and reference for the application of artificial intelligence to the military.
[1] McCarthy J, Minsky M, Rochester N, et al. A proposal for the Dartmouth summer research project on artificial intelligence[J]. AI Magazine, 1955, 27(4):12.
[2] 马克思,恩格斯.马克思恩格斯选集(第3卷)[M].北京:人民出版社, 1972:211.
[3] 马建光.叙利亚战争启示录[M].武汉:长江文艺出版社,2021:43.
[4] Hambling D. Autonomous military drone may have attacked humans[J]. New Scientist, 2021, 250(3337):16.
[5] Dave P, Dastin J, Exclusive-Ukraine has started using Clearview AI's facial recognition during war[EB/OL].(2022-03-13)[2023-11-22]. https://www.marketscreener.com/news/latest/Exclusive-Ukraine-has-started-using-Clearview-AI-s-facial-recognition-during-war-39750732/.
[6] Staff A. Tay, the neo-Nazi millennial chat bot, gets autopsied[EB/OL].(2016-03-26)[2023-11-22]. https://arstechnica.com/information-technology/2016/03/tay-the-neo-nazi-millennial-chatbot-gets-autopsied.
[7] 黄志澄.如何看待霍金对人工智能的警告[EB/OL].(2017-06-05)[2023-11-22]. http://opinion.people.com.cn/n1/2017/0605/c1003-29316746.html.
[8] Umbrello S, Torres P, Bellis D. The future of war:Could lethal autonomous weapons make conflict more ethical[J].AI&Society, 2020, 35:273-282.
[9] Arkin R. Governing lethal behavior:Embedding ethics in a hybrid deliberative/reactive robot architecture part I:Motivation and philosophy[C]//3rd ACM/IEEE International Conference on Human-Robot Interaction(HRI). Amsterdam, Netherlands:IEEE, 2008:121-128.
[10] Lin P, Abney K, Bekey G. Robot ethics:The ethical and social implications of robotics[M]. Cambridge:MIT Press, 2012:129-144.
[11] Garfinkel L, Juels A, Pappu R. RFID privacy:An overview of problems and proposed solutions[J]. IEEE Security and Privacy Magazine, 2005, 3(3):34-43.
[12] Office of the Surgeon Multinational Force-Iraq, Office of the Surgeon General(Army). Mental health advisory team(MHAT)IV operation Iraqi freedom 05-07. final report[R]. Washington DC:Army, 2006.
[13] Malle F. Integrating robot ethics and machine morality:The study and design of moral competence in robots[J].Ethics and Information Technology, 2015, 18(4):243-256.
[14] Christen M, Burri T, Chapa J, et al. An evaluation schema for the ethical use of autonomous robotic systems in security applications[R/OL].(2017-10-12)[2023-11-22]. https://www.researchgate.net/publication/321091297_An_Evaluation_Schema_for_the_Ethical_Use_of_Autonomous_Robotic_Systems_in_Security_Applications.
[15] Skerker M, Purves D, Jenkins R. Autonomous weapons systems and the moral equality of combatants[J]. Ethics and Information Technology, 2020, 22(3):197-209.
[16] Bellaby R. Can AI weapons make ethical decisions?[J].Criminal Justice Ethics, 2021, 40(2):86-107.
[17] 封帅.人工智能时代的国际关系:走向变革且不平等的世界[J].外交评论(外交学院学报), 2018, 35(1):128-156.
[18] 张煌,杜雁芸.人工智能军事化发展态势及其安全影响[J].外交评论(外交学院学报), 2022, 39(3):99-130.
[19] Harwell D. Google to drop Pentagon AI contract after employee objections to the'usiness of war'[EB/OL].(2018-06-02)[2023-11-22]. https://www.ndtv.com/world-news/google-to-drop-pentagon-ai-contract-afteremployees-called-it-the-business-of-war-1861298.
[20] Carbone C. Microsoft employees slam $480M HoloLens military contract, refuse to create tech for "warfare and oppression"[EB/OL].(2019-02-24)[2023-11-22]. https://www.foxnews.com/tech/microsoft-employees-slam-480m-hololens-military-contract-demand-its-cancellation.
[21] Wallach W, Allen C. Framing robot arms control[J]. Ethics and Information Technology, 2013, 15(2):125-135.
[22] Roff H. Killing in war:Responsibility, liability, and lethal autonomous robots[M]//Roff H. Routledge Handbook of Ethics and War. London:Routledge and CRC Press,2013:13.
[23] Whetham D. Morality and war:Can war be just in the twenty-first century?[J]. Scientia Militaria South African Journal of Military Studies, 2012, 40(1):881-883.
[24] Sparrow R. Killer robots[J]. Journal of Applied Philosophy, 2007, 24(1):62-77.
[25] Chmielewski P. Ethical autonomous weapons? Practical,required functions[J]. IEEE Technology and Society Magazine, 2018, 37(3):48-55.
[26] Scharre C, Horowitz P. Artificial intelligence:What every policymaker needs to know[EB/OL].(2018-06-01)[2023-11-22]. https://www.jstor.org/stable/resrep20447.1.
[27] Pfaff C A. The ethics of acquiring disruptive technologies:Artificial intelligence, autonomous weapons, and decision support systems[EB/OL].(2020-01-10)[2023-11-22]. https://ndupress.ndu.edu/Media/News/News-Article-View/Article/2054156/the-ethics-of-acquiring-disruptive-technologies-artificial-intelligence-autonom/.
[28] Article 36. Killer Robots:UK government policy on fully autonomous weapons[EB/OL].(2013-04-21)[2023-11-22]. https://article36.org/wp-content/uploads/2013/04/Policy_Paper1.pdf1.
[29] Examination of various dimensions of emerging technologies in the area of lethal autonomous weapons systems,in the context of the objectives and purposes of the Convention[EB/OL].(2021-01-09)[2023-11-22]. https://docs-library.unoda.org/Convention_on_Certain_Conventional_Weapons_-_Group_of_Governmental_Experts_(2017)/2017_GGEonLAWS_WP6_USA.pdf.
[30] International Committee of the Red Cross. Views of the International Committee of the Red Cross on autonomous weapon system[C]//CCW Meetings of Experts on LAWS. Geneva:Group of Governmental Experts on Lethal Autonomous Weapons Systems, 2016:3-4.
[31] Sharkey N. Guidelines for the human control of weapon systems[R]. Sheffield UK:International Committee for Robot Arms Control, 2018.
[32] Caton J L. Autonomous weapon systems:A brief survey of developmental, operational, legal, and ethical issues[R]. Carlisle USA:Strategic Studies Institute, US Army War College, 2015.
[33] Chatterjee P. American drone operators are quitting in record numbers[EB/OL].(2015-03-15)[2023-11-22].https://www.thenation.com/article/archive/american-drone-operators-are-quitting-record-numbers/.
[34] 王燕玲,李瑞华.人工智能时代恐怖主义犯罪行为的刑法规制[J].刑法论丛, 2020, 64(4):134-160.
[35] Haner J, Garcia D, Held D, et al. The artificial intelligence arms race:Trends and world leaders in autonomous weapons development[J]. Global Policy, 2019, 10(3):331-337.
[36] Brown-Gaston R D, Arora A S. War and peace:Ethical challenges and risks in military robotics[J]. International Journal of Intelligent Information Technologies, 2021, 17(3):12.
[37] 王玫黎,杜陈洁.美国参与自主性武器国际军控的战略关切及角色定位[J].国际观察, 2021(2):127-156.
[38] 龙坤,徐能武.对美军推出人工智能伦理准则的剖析[J].情报杂志, 2022, 41(3):1-8.
[39] 李琼琼,李振.智能时代"人机关系"辩证——马克思"人与机器"思想的当代回响[J].毛泽东邓小平理论研究, 2021(1):71-79, 108.
