Los modelos de lenguaje grande pueden ayudar a generar tramas de historias creativas, dise\u00f1ar campa\u00f1as de marketing e incluso crear recomendaciones personalizadas de restaurantes. El contenido generado por IA puede exhibir un fen\u00f3meno conocido como ” veracidad “, una frase acu\u00f1ada por el presentador de televisi\u00f3n Stephen Colbert a principios de la d\u00e9cada de 2000 para describir c\u00f3mo la informaci\u00f3n puede parecer correcta. Este concepto enfatiza que, a pesar de carecer de precisi\u00f3n f\u00e1ctica, el contenido con una estructura l\u00f3gica altamente coherente puede influir en c\u00f3mo las personas inteligentes y sofisticadas deciden si algo es cierto o no.<\/p>\n
Large language models like\u00a0ChatGPT<\/a>\u00a0and Claude offer a wide range of beneficial\u00a0applications<\/a>. However, there are significant risks associated with their use that demand a coordinated effort among partner nations to forge a solid, integrated defense against the threat of malign information operations.<\/p>\n Large language models can assist in generating creative story plots, crafting marketing campaigns and even creating personalized restaurant recommendations. However, they often produce text that is confidently wrong. This design has profound implications, not only for routine use of artificial intelligence, but also for U.S. national security.<\/p>\n AI-generated content can exhibit a phenomenon known as \u201ctruthiness<\/a>\u201d \u2014 a phrase coined by television host Stephen Colbert in the early 2000s to describe how information can feel right. This concept emphasizes that, despite lacking factual accuracy, content with a highly coherent logical structure can influence how smart, sophisticated people decide whether something is true or not.<\/p>\n Our cognitive biases mean well-written content or compelling visuals have the power to make claims seem more true than they are. As one scholar who has studied \u201ctruthiness\u201d\u00a0describes it<\/a>: \u201cWhen things feel easy to process, they feel trustworthy.\u201d<\/p>\n Adversaries of the U.S. can manipulate the potential for AI models to sound \u201ctruthy\u201d \u2014 crafting coherent, well-structured and persuasive sentences, which can mimic human writing \u2014 to gain an advantage. The internet, with its global reach, has created a potent medium for foreign interference through subversive incursions of truthiness.<\/p>\n State actors are leveraging digital technologies to execute hostile information campaigns, using online tools and information operations to promote their interests. State actors can manipulate cognitive fluency bias and truthiness to shape the sociopolitical arena, expanding the potential misuse of AI-driven language models for malign information operations, large-scale spear phishing campaigns and increasingly believable deepfake media.<\/p>\n The exploitation of cognitive fluency bias in information operations can give misinformation a deceptive veneer of credibility, contributing to the destabilization of political systems and of societal coherence.<\/p>\n Brad Smith, the president of Microsoft,\u00a0said during a May 25 speech<\/a>\u00a0the U.S. will \u201chave to address in particular what we worry about most [from] foreign cyber influence operations, the kinds of activities that are already taking place by the Russian government, the Chinese, the Iranians.\u201d<\/p>\n Russian hackers\u2019\u00a0crude deepfake attempt<\/a>\u00a0<\/b>to depict Ukrainian President Volodymyr Zelenskyy calling for Ukrainians to lay down their arms was easily identifiable. But it\u2019s now evident the issue is no longer academic. The reality looms that malign videos, forged documents and counterfeit social media accounts could transition from being seen as crude to conveying a deceptive semblance of authenticity.<\/p>\n A surge in subversion campaigns dependent on disinformation and the heightened efforts by malign actors underscore the necessity for a strategic response from the U.S. and its allies. To combat these trends, U.S. policymakers need a comprehensive strategy, built upon vigilant monitoring, proactive warnings and international collaboration.<\/p>\n The cornerstone of this strategy should be the vigilant monitoring of the information environment. Strengthened by advancements in AI and machine learning, continuous monitoring is vital for the early detection and neutralization of disinformation campaigns.<\/p>\n This stance echoes the U.S. Defense Department\u2019s call for an improved capability to \u201cmonitor, analyze, characterize, assess, forecast, and visualize\u201d the information environment, as\u00a0detailed<\/a>\u00a0in its 2016 \u201cStrategy for Operations in the Information Environment.\u201d To implement this, military and intelligence agencies will need specialized units dedicated to\u00a0information warfare<\/a>, which can provide the crucial expertise needed to interpret and act on the collected data.<\/p>\n The U.S. government also needs a robust warning system that simultaneously promotes truth and exposes disinformation. Timely and effective warnings can help protect the public from false narratives, significantly curtailing the impact of disinformation campaigns. The power of truth is a formidable tool in this context; it serves as an effective countermeasure against the corrosive effects of falsehoods.<\/p>\n Lastly, there is a need to reinforce strategic partnerships with international allies. The global nature of malign disinformation campaigns mandates that counter-efforts be equally far-reaching. These partnerships provide invaluable local knowledge and foster trust, both of which can greatly enhance the credibility of warnings and bolster societal resilience against disinformation.<\/p>\n