{"id":15750,"date":"2024-10-22T14:46:24","date_gmt":"2024-10-22T17:46:24","guid":{"rendered":"https:\/\/www.fie.undef.edu.ar\/ceptm\/?p=15750"},"modified":"2024-10-22T14:46:24","modified_gmt":"2024-10-22T17:46:24","slug":"programa-safron-modelos-fundacionales-inteligencia-artificial-y-machine-learning-para-disponer-de-robots-confiables-en-los-sistemas-de-defensa","status":"publish","type":"post","link":"https:\/\/www.fie.undef.edu.ar\/ceptm\/?p=15750","title":{"rendered":"Programa SAFRON, modelos fundacionales, inteligencia artificial y machine learning para disponer de robots confiables en los sistemas de defensa"},"content":{"rendered":"<p>El programa SAFRON (Safe and Assured Foundations Robots for Open Environment) que lleva adelante DARPA, la Agencia de Proyectos Avanzados de\u00a0Defensa\u00a0de EEUU,\u00a0convoca a la industria a presentar propuestas, sobre distintas posibilidades de incorporaci\u00f3n segura de Inteligencia Artificial (AI) y Machine Learning (ML) en sistemas de uso militar. SAFRON tiene por objetivo buscar alternativas que maximicen la confiabilidad de la IA \/ ML aplicada a los robots militares. Las propuestas deber\u00edan permitir a los expertos, desarrollar programas que incorporen IA y ML de la manera m\u00e1s r\u00e1pida, flexible, al menor costo y que fundamentalmente, otorguen la mayor seguridad en el accionar de los sistemas aut\u00f3nomos de todo tipo.<\/p>\n<hr \/>\n<p><strong>ARLINGTON, Va. \u2013<\/strong>\u00a0U.S. military researchers are asking industry for ways of assuring trust in complex\u00a0<a href=\"https:\/\/www.militaryaerospace.com\/computers\/article\/55126930\/artificial-intelligence-ai-machine-learning-military-operations\" target=\"_blank\" rel=\"noopener\" data-feathr-click-track=\"true\" data-feathr-link-aids=\"5d3f06f2c0645c763104b681\">military artificial intelligence (AI)<\/a>\u00a0programming, so that military leaders could use sophisticated robotics for crucial jobs without concern for erroneous and dangerous results.<\/p>\n<p>Officials of the U.S. Defense Advanced Research Projects Agency (DARPA) in Arlington, Va., issued a advanced research concepts opportunity (DARPA-EA-24-01-0) last week for the Safe and Assured Foundation Robots for Open Environments (SAFRON) project.<\/p>\n<p>SAFRON seeks to enhance trust in AI-based robots that use sophisticated foundation models, which can help computer experts develop AI and\u00a0<a href=\"https:\/\/www.militaryaerospace.com\/computers\/article\/14302038\/artificial-intelligence-ai-machine-learning-unmanned\" target=\"_blank\" rel=\"noopener\" data-feathr-click-track=\"true\" data-feathr-link-aids=\"5d3f06f2c0645c763104b681\">machine learning<\/a>\u00a0for military applications quickly and cost-effectively.<\/p>\n<p>Foundation models are trained on extremely large datasets, and are large deep-learning neural networks that can form the foundation of new AI applications that do not require scientists to develop AI programs from scratch.<\/p>\n<p>Foundation models describe machine learning that is trained on a broad spectrum of generalized and unlabeled data that is capable of performing a wide variety of general tasks such as understanding language, generating text and images, and conversing in natural language.<\/p>\n<p>Foundation models, for example, can enable robots to parse natural-language directions for complex tasks and then execute those tasks in real-world conditions. Although this represents a dramatic break from existing autonomous systems, natural-language direction for open-world autonomy presents a safety and assurance challenge.<\/p>\n<p>Current methods to assure learning-enabled systems are inadequate to address\u00a0<a href=\"https:\/\/www.militaryaerospace.com\/home\/article\/55187980\/nasa-and-ibm-rolls-out-open-source-ai-model-for-weather-and-climate-applications\" target=\"_blank\" rel=\"noopener\" data-feathr-click-track=\"true\" data-feathr-link-aids=\"5d3f06f2c0645c763104b681\">AI foundation models<\/a>, DARPA researchers say. Formal neural network verifiers to date have been effective only in limited narrow scenarios, but do not scale to large foundation models.<\/p>\n<p>In addition existing training and alignment methodologies are not very robust, and do not consider complex behaviors that AI-enabled robots may be expected to encounter in an unconstrained open-world environment. Even worse, foundation models are known to exhibit errant behavior such as hallucination, and false confidence in reasoning.<\/p>\n<p>Assurances are crucial to deploy foundation models-enabled robots; a robot controlled by a hallucinating foundation models could fail to execute a critical task, researchers point out.<\/p>\n<p>Instead, the SAFRON project seeks to answer the core question: how, and to what extent, can we assure that foundation model-enabled robots will behave only as directed and intended?<\/p>\n<p>SAFRON seeks to explore approaches that will lead to assurances about the behavior of robots that use foundation models, with particular emphasis on robots that receive commands in natural language; operate in unstructured open-world environments; and incorporate the foundation models in closed-loop decision making. Approaches that provide assurances subject to minimal additional supervision from a human operator in real time also are of interest.<\/p>\n<p><strong>Fuente:<\/strong> <a href=\"https:\/\/www.militaryaerospace.com\/computers\/article\/55234074\/military-artificial-intelligence-ai-machine-learning-ai-foundation-models?o_eid=0763J9111945F9E&amp;oly_enc_id=0763J9111945F9E&amp;rdx.ident[pull]=omeda|0763J9111945F9E&amp;utm_campaign=CPS241009008&amp;utm_medium=email&amp;utm_source=MAE+Technology+Close-up\" target=\"_blank\" rel=\"noopener\"><em>https:\/\/www.militaryaerospace.com<\/em><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>El programa SAFRON (Safe and Assured Foundations Robots for Open Environment) que lleva adelante DARPA, la Agencia de Proyectos Avanzados de\u00a0Defensa\u00a0de EEUU,\u00a0convoca a la industria&hellip; <\/p>\n","protected":false},"author":1,"featured_media":15751,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[2,37,23],"tags":[],"_links":{"self":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/15750"}],"collection":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=15750"}],"version-history":[{"count":1,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/15750\/revisions"}],"predecessor-version":[{"id":15752,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/posts\/15750\/revisions\/15752"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=\/wp\/v2\/media\/15751"}],"wp:attachment":[{"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=15750"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=15750"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fie.undef.edu.ar\/ceptm\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=15750"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}