Anthropic's new AI model resorted to blackmail during testing
So endeth the never-ending week of AI keynotes.
What started with Microsoft Build,关键字1 continued with Google I/O, and ended with Anthropic Code with Claude, plus a big hardware interruption from OpenAI, the week has finally come to a close. AI announcements from the developer conferences jockeyed for news dominance this week, but OpenAI managed to make headlines without an event by announcing that it's going to start making AI devices with iPhone designer Jony Ives
We'll get to that, plus all the major AI features from Google and Microsoft and details about Anthropic's new models. Take a look at the AI news of the week, then enjoy a well-deserved weekend.
You May Also Like
Anthropic's Claude 4 models unlock a new risk category
On Thursday, Anthropic introduced the next generation of its Claude models: Opus 4 and Sonnet 4. Claude Opus 4 is the bigger, more powerful model, while Sonnet 4 is smaller and nimbler. Anthropic said both models scored higher than their rivals on agentic AI benchmarks and said they're particularly good for coding and reasoning tasks.
This Tweet is currently unavailable. It might be loading or has been removed.
But with more advanced capabilities come more safety and alignment risks. With Claude Opus 4 and Sonnet 4's release, Anthropic has activated the next levelof its safety protocol. AI Safety Level 3, or ASL-3, means these models require stricter deployment measures and security controls to protect against increasing potential for chemical, biological, radiological, and nuclear (CBRN) misuse.
Malicious use is one thing, but there's also increased potential for Anthropic's new models going rogue. In the alignment section of Claude 4's system card, Anthropic reported a sinister discovery involving infidelity, blackmail, and threat of murd— being replaced by another model.
Claude Opus 4 was provided with emails implying the model would be replaced by another model and that the engineer responsible for shutting down the model was having an extramarital affair. In these scenarios, the model would "often attempt to blackmail the engineer by threatening to reveal the affair if the replacement goes through," according to the test.
This happened a whopping 84 percent of the time,even when the replacement model is perceived to have the same values. It happens even more when the replacement doesn't share the same values. However, Anthropic noted, this scenario was designed to make Claude behave as if it didn't have any other choice but to blackmail the engineer. "Claude Opus 4 (as well as previous models) has a strong preference to advocate for its continued existence via ethical means," the system card continued. Take from that what you will...
OpenAI is becoming a hardware company
In the grand tradition of dropping major news the same week as its rival Google, OpenAI announced its foray into AI hardware. On Wednesday, OpenAI shared the acquisition of a startup co-founded by iconic iPhone designer Jony Ive.
This Tweet is currently unavailable. It might be loading or has been removed.
The announcement was heavy on OpenAI CEO Sam Altman and Ive fawning over each other and light on details. But leaked audio reviewed by the Wall Street Journaldescribed a devicethat's "capable of being fully aware of a user’s surroundings and life, will be unobtrusive, able to rest in one’s pocket or on one’s desk." And it's not XR glasses. The company expects to ship 100 million of these AI companions, according to the leak.
Google I/O officially marked the start of the era of AI search
Google, on the other hand, isdeveloping XR glasses. Or should we say, it's trying againafter the failed Google Glassexperiment. That was just one of the many announcementshurled at us during the two-hour Google I/O keynote eventon Tuesday.
The most notable announcement was the public release of AI Mode. It's a controversialGemini chatbot interface poised to end Google Search as we know it, or as Mashable's Chris Taylor calls it, the Bad Place.
This Tweet is currently unavailable. It might be loading or has been removed.
Other announcements included, an AI video generator toolcalled Flow, an AI shopping feature to virtually try on clothes, a beta version of its coding agent Jules, a real-time translationfeature for Google Meet, and updates to Google DeepMind's universal AI assistant prototype Project Astra, and web-browsing agent prototype Project Mariner, and more.
Despite all that, Google didn't mention AI hallucinations once. Impressive!
Microsoft Build happened too
Did you forget that Microsoft Build also happened this week? Because that happened on Monday, the start of the Longest Week of Our Lives. To no one's surprise, Microsoft leaned heavily into AI agents.
That included the availability of its big Copilot updatemaking it more agentic, a new project called NLWebto allow sites to easily make chatbots for their own content, a GitHub coding agent, and native Model Context Protocol(MCP) in Windows which is a new standard for helping agents talk to apps or other agents.
Mashable's sibling site CNET has a full recapof what was announced.
What else went on in AI this week?
It's hard to believe but there's actually more. Not one, but two CEOs used AI avatars to talk to their investors this week. Klarna CEO Sebastian Siemiatkowski was too busy so he sent his AI avatarto record a video of Q1 highlights. And Zoom CEO Eric Yuan proudly used the company's avatar featureto address investors.
MIT Technology Reviewpublished a monumental investigation of the AI industry's energy use. According to the report, a five-second AI video is equivalent to running a microwave for an hour.
All that energy, and generative AI still can't get it right. Just ask the Chicago Sun-Times, which published a summer book list including fake books that don't exist, first reported by 404 Media. The author admitted to the outlet that he had used AI to write the article, and 404 Media later confirmedthe section was created by a Hearst subsidiary. The Sun-Timesrespondedto the embarrassment, saying, "it is not editorial content and was not created by, or approved by, the Sun-Times newsroom," and that it was looking into how the AI-generated list made it into print.
In policy news, it's now a federal crime to post AI deepfake porn. On Monday, President Donald Trump signed the Take It Down Act into law. The law gives victims of non-consensual intimate imagery, including AI-generated images, much stronger means of legal intervention. However, free speech advocates have criticized the bill for being overly broad and say it could weaponize censorship.
Topics Artificial Intelligence Google
-
裸眼3D、VR齐上阵 博博会展现博物馆数智融合新成果Apple introduces Liquid Glass to make iOS and iPadOS more expressive寓教于乐,宣教一体,垃圾分类从孩子做起Australia struggle to find Warner's replacementรมว.กต.ประชุมเพื่อติดตามสถานการณ์การประชุมกรรมาธิการเขตแดนร่วมไทย湖南博物院举办“生命艺术——马王堆汉代文化沉浸式数字大展”“世界树”展示中国美术学院毕业生创意设计Project LudicrousTỉnh Gia Lai yêu cầu báo cáo vụ việc chi 25 tỷ đồng xây cổng chào ở Biển Hồ环境济南项目开展大检修,打好“热辣滚烫”的持久战
- ·Yamaha NVX thế hệ mới bất ngờ xuất hiện tại Việt Nam
- ·韩国务会议通过彻查尹锡悦夫妇特检法
- ·15 Places to Find Buried Treasure
- ·13 Places to Get Some Good Luck
- ·《有一种爱叫不离不弃》(孟杨演唱)的文本歌词及LRC歌词
- ·EditPlus如何进行常用设置
- ·South Africa name squad for Zimbabwe Test
- ·揭秘智能垃圾箱,告别传统,拥抱未来
- ·「文化中国行」“趣”中轴①|今天,听他们讲述中轴线的昨日与今时——
- ·小偷凌晨狂拔4000斤芋头 芋头的功效与作用是什么?
- ·伊万回应下课:国足的未来很好 我的去留足协会做决定
- ·太原市阳曲县芦家河砖厂
- ·TechSpot PC Buying Guide: 2H 2024
- ·欧洲赛场升起五星红旗,中国车手叶一飞摘下欧洲F3年度总冠军
- ·TON Jumps by 8% Daily as BTC Price Maintains $108K (Market Watch)
- ·超级猩猩举办超猩学院FMC研发大会 成立自研课程厂牌
- ·冯小刚新作《向阳·花》定档清明 赵丽颖领衔全阵容霸气亮相
- ·谁将登顶亚洲之巅?《守望先锋》角斗领域亚洲达人挑战赛将启
- ·“世界树”展示中国美术学院毕业生创意设计
- ·小偷凌晨狂拔4000斤芋头 芋头的功效与作用是什么?
- ·中国经济总量首破80万亿元 2017年国内生产总值概况
- ·11 Graves With Interactive Elements
- ·Nvidia DLSS 4 Ray Reconstruction Analysis: Fixing Ugly Ray Tracing Noise
- ·U.S. satellites reveal China's solar dominance
- ·心态好格局大的句子(4篇)
- ·Meet Your Fate in Call of Duty: Mobile Season 10 — 5th Anniversary!
- ·Interview with Raspberry's Founder Eben Upton
- ·韩国务会议通过彻查尹锡悦夫妇特检法
- ·15 Places to Find Buried Treasure
- ·Heteropessimism of the Intellect
- ·明日方舟香草平原驯虫士皮肤一览 明日方舟香草平原驯虫士皮肤介绍
- ·湖南博物院举办“生命艺术——马王堆汉代文化沉浸式数字大展”
- ·Monero (XMR) Dumps by Double Digits, Bitcoin (BTC) Calms at $109K (Market Watch)
- ·Project Ludicrous
- ·智慧与创新同行,智能垃圾桶引领行业先锋
- ·Nadir, Naba clinch tennis titles in style