人工智能与AI诈骗

Require that developers of the most powerful AI systems share their safety test results and other critical information with the U.S.government.In accordance with the Defense Production Act,the Order will require that companies developing any foundation model that poses a serious risk to national security,national economic security,or national public health and safety must notify the federal government when training the model,and must share the results of all red-team safety tests.These measures will ensure AI systems are safe,secure,and trustworthy before companies make them public.Develop standards,tools,and tests to help ensure that AI systems are safe,secure,and trustworthy.The National Institute of Standards and Technology will set the rigorous standards for extensive red-team testing to ensure safety before public release.The Department of Homeland Security will apply those standards to critical infrastructure sectors and establish the AI Safety and Security Board.The Departments of Energy and Homeland Security will also address AI systems’ threats to critical infrastructure,as well as chemical,biological,radiological,nuclear,and cybersecurity risks.Together,these are the most significant actions ever taken by any government to advance the field of AI safety.Protect against the risks of using AI to engineer dangerous biological materials by developing strong new standards for biological synthesis screening.Agencies that fund life-science projects will establish these standards as a condition of federal funding,creating powerful incentives to ensure appropriate screening and manage risks potentially made worse by AI.Protect Americans from AI-enabled fraud and deception by establishing standards and best practices for detecting AI-generated content and authenticating official content.The Department of Commerce will develop guidance for content authentication and watermarking to clearly label AI-generated content.Federal agencies will use these tools to make it easy for Americans to know that the communications they receive from their government are authentic—and set an example for the private sector and governments around the world.

Risks to societal wellbeingDisinformation generated and propagated by AI could undermine access to reliableinformation and trust in democratic institutions and processes.The Malicious Use of Artificial Intelligence,Malicious AI Report,2018.Constitutional Challenges in the Algorithmic Society,Micklitz et al.,2022.Smart Speakers and Voice Assistants,CDEI,2019; Deepfakes and Audiovisual disinformation,CDEI,2019.Artificial Intelligence,Human Rights,Democracy and the Rule of Law,Leslie et al.,2021.Government has already committed to addressing some of these issues more broadly.See,for example,the InclusiveBritain report,Race Disparity Unit,2022.A pro-innovation approach to AI regulationRisks to securityAI tools can be used to automate,accelerate and magnify the impact of highlytargeted cyber attacks,increasing the severity of the threat from malicious actors.The emergence of LLMs enableshackers48with little technical knowledge or skill togenerate phishing campaigns with malware delivery

我们已经了解了人类如何巧妙应对认知偏差，那么对于AI系统，是否也存在类似的“认知陷阱”？答案是肯定的，这就是“AI幻觉”。[heading2]AI幻觉：真实与想象的“迷宫”[content]简单来说，AI幻觉是指AI系统生成的信息与事实不符，或者与预期不符，就像人工智能在“一本正经地胡说八道”。这些“胡说八道”不是AI故意的，而是技术局限性造成的错误。AI幻觉的定义可以概括为：AI系统生成的输出内容看似合理流畅，但实际上与输入信息、上下文环境或客观事实相矛盾，缺乏逻辑或经验支撑。[heading2]AI幻觉：“多重面孔”[content]AI幻觉的表现形式多种多样，如下图所示：[heading2]AI幻觉：潜藏的风险[content]AI幻觉看似“小错误”，但在实际应用中可能带来巨大风险。误导用户:AI幻觉会导致用户获取错误信息，从而做出错误判断。例如，医疗AI助手给出错误诊断建议，可能延误患者治疗。传播虚假信息:AI幻觉可能被用于制造和传播虚假信息，误导公众，影响社会稳定。例如，AI可以生成虚假新闻报道或社交媒体帖子，用于政治宣传或商业炒作。损害AI系统的可信度:AI幻觉会降低用户对AI系统的信任度，阻碍AI技术推广和应用。例如，如果用户发现AI经常“胡说八道”，他们可能不再信任AI的判断，甚至拒绝使用AI产品。