{"id":8717,"date":"2021-10-01T09:31:30","date_gmt":"2021-10-01T12:31:30","guid":{"rendered":"https:\/\/www.fie.undef.edu.ar\/ceptm\/?p=8717"},"modified":"2021-10-01T09:31:30","modified_gmt":"2021-10-01T12:31:30","slug":"el-dilema-moral-de-las-armas-autonomas","status":"publish","type":"post","link":"https:\/\/www.fie.undef.edu.ar\/ceptm\/?p=8717","title":{"rendered":"El dilema moral de las armas aut\u00f3nomas"},"content":{"rendered":"<p>Los sistemas de armas aut\u00f3nomos, com\u00fanmente conocidos como &#8220;robots asesinos&#8221;, pueden haber ejecutado acciones letales, sin supervisi\u00f3n de un operador humano,\u00a0seg\u00fan un informe reciente del Consejo de Seguridad de las Naciones Unidas, sobre la Guerra Civil en Libia.\u00a0La historia bien podr\u00eda identificar esto como el punto de partida de la pr\u00f3xima gran carrera armamentista, con el potencial de convertirse en algo incontrolable\u00a0para la humanidad.\u00a0No solo por las armas aut\u00f3nomas sofisticadas producidas por potencias tecnol\u00f3gicas, sino tambi\u00e9n por el riesgo de proliferaci\u00f3n de otras, muy baratas y accesibles, que sueles ser ya denominadas como los \u201cKalasnikov\u201d aut\u00f3nomos.<\/p>\n<hr \/>\n<p>Autonomous weapon systems \u2013 commonly known as killer robots \u2013 may have\u00a0<a href=\"https:\/\/www.npr.org\/2021\/06\/01\/1002196245\/a-u-n-report-suggests-libya-saw-the-first-battlefield-killing-by-an-autonomous-d\" target=\"_blank\" rel=\"noopener\">killed human beings for the first time ever<\/a>\u00a0last year, according to a recent United Nations Security Council\u00a0<a href=\"https:\/\/undocs.org\/S\/2021\/229\" target=\"_blank\" rel=\"noopener\">report on the Libyan civil war<\/a>. History could well identify this as the starting point of the next major arms race, one that has the potential to be humanity\u2019s final one.<\/p>\n<p>Autonomous weapon systems are robots with lethal weapons that can operate independently, selecting and attacking targets without a human weighing in on those decisions. Militaries around the world are\u00a0<a href=\"https:\/\/www.newsweek.com\/2021\/09\/24\/us-only-nation-ethical-standards-ai-weapons-should-we-afraid-1628986.html\" target=\"_blank\" rel=\"noopener\">investing heavily<\/a>\u00a0in autonomous weapons research and development. The U.S. alone\u00a0<a href=\"https:\/\/www.scientificamerican.com\/article\/dont-let-robots-pull-the-trigger\/\" target=\"_blank\" rel=\"noopener\">budgeted US$18 billion<\/a>\u00a0for autonomous weapons between 2016 and 2020.<\/p>\n<p>Meanwhile, human rights and\u00a0<a href=\"https:\/\/www.stopkillerrobots.org\/\" target=\"_blank\" rel=\"noopener\">humanitarian organizations<\/a>\u00a0are racing to establish regulations and prohibitions on such weapons development. Without such checks, foreign policy experts warn that disruptive autonomous weapons technologies will dangerously destabilize current nuclear strategies, both because they could radically change perceptions of strategic dominance,\u00a0<a href=\"https:\/\/www.rand.org\/blog\/2020\/06\/the-risks-of-autonomous-weapons-systems-for-crisis.html\" target=\"_blank\" rel=\"noopener\">increasing the risk of preemptive attacks<\/a>, and because they could become\u00a0<a href=\"https:\/\/foreignpolicy.com\/2020\/10\/14\/ai-drones-swarms-killer-robots-partial-ban-on-autonomous-weapons-would-make-everyone-safer\/\" target=\"_blank\" rel=\"noopener\">combined with chemical, biological, radiological and nuclear weapons<\/a>\u00a0themselves.<\/p>\n<p>As a\u00a0<a href=\"https:\/\/muse.jhu.edu\/search?action=search&amp;query=author:James%20Dawes:and&amp;limit=subscription:n&amp;min=1&amp;max=20\" target=\"_blank\" rel=\"noopener\">specialist in human rights<\/a>\u00a0with a focus on the\u00a0<a href=\"https:\/\/muse.jhu.edu\/article\/761349#bio_wrap\" target=\"_blank\" rel=\"noopener\">weaponization of artificial intelligence<\/a>, I find that autonomous weapons make the unsteady balances and fragmented safeguards of the nuclear world \u2013 for example, the U.S. president\u2019s minimally constrained\u00a0<a href=\"https:\/\/wwnorton.com\/books\/thermonuclear-monarchy\/\" target=\"_blank\" rel=\"noopener\">authority to launch a strike<\/a>\u00a0\u2013 more unsteady and more fragmented.<\/p>\n<p><strong>Lethal errors and black boxes<\/strong><\/p>\n<p>I see four primary dangers with autonomous weapons. The first is the problem of misidentification. When selecting a target, will autonomous weapons be able to distinguish between hostile soldiers and 12-year-olds playing with toy guns? Between civilians fleeing a conflict site and insurgents making a tactical retreat?<\/p>\n<p><iframe loading=\"lazy\" title=\"YouTube video player\" src=\"https:\/\/www.youtube.com\/embed\/fPqmC16ewYg\" width=\"754\" height=\"424\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>The problem here is not that machines will make such errors and humans won\u2019t. It\u2019s that the difference between human error and algorithmic error is like the difference between mailing a letter and tweeting. The scale, scope and speed of killer robot systems \u2013 ruled by one targeting algorithm, deployed across an entire continent \u2013 could make misidentifications by individual humans like a recent\u00a0<a href=\"https:\/\/www.reuters.com\/world\/asia-pacific\/us-military-says-10-civilians-killed-kabul-drone-strike-last-month-2021-09-17\/\" target=\"_blank\" rel=\"noopener\">U.S. drone strike in Afghanistan<\/a>\u00a0seem like mere rounding errors by comparison.<\/p>\n<p>Autonomous weapons expert Paul Scharre uses the metaphor of\u00a0<a href=\"https:\/\/wwnorton.com\/books\/Army-of-None\/\" target=\"_blank\" rel=\"noopener\">the runaway gun<\/a>\u00a0to explain the difference. A runaway gun is a defective machine gun that continues to fire after a trigger is released. The gun continues to fire until ammunition is depleted because, so to speak, the gun does not know it is making an error. Runaway guns are extremely dangerous, but fortunately they have human operators who can break the ammunition link or try to point the weapon in a safe direction. Autonomous weapons, by definition, have no such safeguard.<\/p>\n<p>Importantly, weaponized AI need not even be defective to produce the runaway gun effect. As multiple studies on algorithmic errors across industries have shown, the very best algorithms \u2013 operating as designed \u2013 can\u00a0<a href=\"https:\/\/brianchristian.org\/the-alignment-problem\/\" target=\"_blank\" rel=\"noopener\">generate internally correct outcomes that nonetheless spread terrible errors<\/a>\u00a0rapidly across populations.<\/p>\n<p>For example, a neural net designed for use in Pittsburgh hospitals identified\u00a0<a href=\"https:\/\/www.pulmonologyadvisor.com\/home\/topics\/practice-management\/the-potential-pitfalls-of-machine-learning-algorithms-in-medicine\/\" target=\"_blank\" rel=\"noopener\">asthma as a risk-reducer<\/a>\u00a0in pneumonia cases; image recognition software used by Google\u00a0<a href=\"https:\/\/www.usatoday.com\/story\/tech\/2015\/07\/01\/google-apologizes-after-photos-identify-black-people-as-gorillas\/29567465\/\" target=\"_blank\" rel=\"noopener\">identified African Americans as gorillas<\/a>; and a machine-learning tool used by Amazon to rank job candidates\u00a0<a href=\"https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight\/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G\" target=\"_blank\" rel=\"noopener\">systematically assigned negative scores to women<\/a>.<\/p>\n<p>The problem is not just that when AI systems err, they err in bulk. It is that when they err, their makers often don\u2019t know why they did and, therefore, how to correct them. The\u00a0<a href=\"https:\/\/jolt.law.harvard.edu\/assets\/articlePDFs\/v31\/The-Artificial-Intelligence-Black-Box-and-the-Failure-of-Intent-and-Causation-Yavar-Bathaee.pdf\" target=\"_blank\" rel=\"noopener\">black box problem<\/a>\u00a0of AI makes it almost impossible to imagine morally responsible development of autonomous weapons systems.<\/p>\n<p><strong>The proliferation problems<\/strong><\/p>\n<p>The next two dangers are the problems of low-end and high-end proliferation. Let\u2019s start with the low end. The militaries developing autonomous weapons now are proceeding on the assumption that they will be able to\u00a0<a href=\"https:\/\/www.popularmechanics.com\/military\/research\/a23133118\/us-ai-robots-warfare\/\" target=\"_blank\" rel=\"noopener\">contain and control the use of autonomous weapons<\/a>. But if the history of weapons technology has taught the world anything, it\u2019s this: Weapons spread.<\/p>\n<p>Market pressures could result in the creation and widespread sale of what can be thought of as the autonomous weapon equivalent of the\u00a0<a href=\"https:\/\/www.npr.org\/templates\/story\/story.php?storyId=6539945\" target=\"_blank\" rel=\"noopener\">Kalashnikov assault rifle<\/a>: killer robots that are cheap, effective and almost impossible to contain as they circulate around the globe. \u201cKalashnikov\u201d autonomous weapons could get into the hands of people outside of government control, including international and domestic terrorists.<\/p>\n<p>High-end proliferation is just as bad, however. Nations could compete to develop increasingly devastating versions of autonomous weapons, including ones capable of\u00a0<a href=\"https:\/\/cpr.unu.edu\/publications\/articles\/ai-global-governance-ai-and-nuclear-weapons-promise-and-perils-of-ai-for-nuclear-stability.html\" target=\"_blank\" rel=\"noopener\">mounting chemical, biological, radiological and nuclear arms<\/a>. The moral dangers of escalating weapon lethality would be amplified by escalating weapon use.<\/p>\n<p>High-end autonomous weapons are likely to lead to more frequent wars because they will decrease two of the primary forces that have historically prevented and shortened wars: concern for civilians abroad and concern for one\u2019s own soldiers. The weapons are likely to be equipped with expensive\u00a0<a href=\"https:\/\/smartech.gatech.edu\/bitstream\/handle\/1853\/31465\/09-02.pdf\" target=\"_blank\" rel=\"noopener\">ethical governors<\/a>\u00a0designed to minimize collateral damage, using what U.N. Special Rapporteur Agnes Callamard has called the\u00a0<a href=\"https:\/\/news.un.org\/en\/story\/2020\/07\/1068041\" target=\"_blank\" rel=\"noopener\">\u201cmyth of a surgical strike\u201d<\/a>\u00a0to quell moral protests. Autonomous weapons will also reduce both the need for and risk to one\u2019s own soldiers, dramatically altering the\u00a0<a href=\"https:\/\/www.jstor.org\/stable\/3312365?seq=1#metadata_info_tab_contents\" target=\"_blank\" rel=\"noopener\">cost-benefit analysis<\/a>\u00a0that nations undergo while launching and maintaining wars.<\/p>\n<p>Asymmetric wars \u2013 that is, wars waged on the soil of nations that lack competing technology \u2013 are likely to become more common. Think about the global instability caused by Soviet and U.S. military interventions during the Cold War, from the first proxy war to the\u00a0<a href=\"https:\/\/dx.doi.org\/10.2139\/ssrn.3804885\" target=\"_blank\" rel=\"noopener\">blowback<\/a>\u00a0experienced around the world today. Multiply that by every country currently aiming for high-end autonomous weapons.<\/p>\n<p><strong>Undermining the laws of war<\/strong><\/p>\n<p>Finally, autonomous weapons will undermine humanity\u2019s final stopgap against war crimes and atrocities: the international laws of war. These laws, codified in treaties reaching as far back as the 1864\u00a0<a href=\"https:\/\/www.law.cornell.edu\/wex\/geneva_conventions_and_their_additional_protocols\" target=\"_blank\" rel=\"noopener\">Geneva Convention<\/a>, are the international thin blue line separating war with honor from massacre. They are premised on the idea that people can be held accountable for their actions even during wartime, that the right to kill other soldiers during combat does not give the right to murder civilians. A prominent example of someone held to account is\u00a0<a href=\"https:\/\/www.britannica.com\/biography\/Slobodan-Milosevic\" target=\"_blank\" rel=\"noopener\">Slobodan Milosevic<\/a>, former president of the Federal Republic of Yugoslavia, who was indicted on charges against humanity and war crimes by the U.N.\u2019s International Criminal Tribunal for the Former Yugoslavia.<\/p>\n<p>But how can autonomous weapons be held accountable? Who is to blame for a robot that commits war crimes? Who would be put on trial? The weapon? The soldier? The soldier\u2019s commanders? The corporation that made the weapon? Nongovernmental organizations and experts in international law worry that autonomous weapons will lead to a serious\u00a0<a href=\"https:\/\/www.hrw.org\/news\/2020\/06\/01\/need-and-elements-new-treaty-fully-autonomous-weapons#\" target=\"_blank\" rel=\"noopener\">accountability gap.<\/a><\/p>\n<p>To hold a soldier\u00a0<a href=\"https:\/\/digitalcommons.du.edu\/cgi\/viewcontent.cgi?article=1011&amp;context=djilp\" target=\"_blank\" rel=\"noopener\">criminally responsible<\/a>\u00a0for deploying an autonomous weapon that commits war crimes, prosecutors would need to prove both actus reus and mens rea, Latin terms describing a guilty act and a guilty mind. This would be difficult as a matter of law, and possibly unjust as a matter of morality, given that autonomous weapons are inherently unpredictable. I believe the distance separating the soldier from the independent decisions made by autonomous weapons in rapidly evolving environments is simply too great.<\/p>\n<p>The legal and moral challenge is not made easier by shifting the blame up the chain of command or back to the site of production. In a world without regulations that mandate\u00a0<a href=\"https:\/\/blogs.icrc.org\/law-and-policy\/2018\/08\/29\/im-possibility-meaningful-human-control-lethal-autonomous-weapon-systems\/\" target=\"_blank\" rel=\"noopener\">meaningful human control<\/a>\u00a0of autonomous weapons, there will be war crimes with no war criminals to hold accountable. The structure of the laws of war, along with their deterrent value, will be significantly weakened.<\/p>\n<p><strong>A new global arms race<\/strong><\/p>\n<p>Imagine a world in which militaries, insurgent groups and international and domestic terrorists can deploy theoretically unlimited lethal force at theoretically zero risk at times and places of their choosing, with no resulting legal accountability. It is a world where the sort of unavoidable\u00a0<a href=\"https:\/\/www.amazon.com\/Weapons-Math-Destruction-Increases-Inequality\/dp\/0553418815\" target=\"_blank\" rel=\"noopener\">algorithmic errors<\/a>\u00a0that plague even tech giants like Amazon and Google can now lead to the elimination of whole cities.<\/p>\n<p>In my view, the world should not repeat the catastrophic mistakes of the nuclear arms race. It should not sleepwalk into dystopia.<\/p>\n<p><strong>Fuente:<\/strong> <a href=\"https:\/\/theconversation.com\/an-autonomous-robot-may-have-already-killed-people-heres-how-the-weapons-could-be-more-destabilizing-than-nukes-168049\" target=\"_blank\" rel=\"noopener\"><em>https:\/\/theconversation.com<\/em><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Los sistemas de armas aut\u00f3nomos, com\u00fanmente conocidos como &#8220;robots asesinos&#8221;, pueden haber ejecutado acciones letales, sin supervisi\u00f3n de un operador humano,\u00a0seg\u00fan un informe reciente del&hellip; <\/p>\n","protected":false},"author":1,"featured_media":8718,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[18,2,23],"tags":[],"_links":{"self":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/8717"}],"collection":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8717"}],"version-history":[{"count":1,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/8717\/revisions"}],"predecessor-version":[{"id":8719,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/8717\/revisions\/8719"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/media\/8718"}],"wp:attachment":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8717"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8717"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8717"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}