Anthropic's new AI model resorted to blackmail during testing
So endeth the never-ending week of AI keynotes.
What started with Microsoft Build,关键字2 continued with Google I/O, and ended with Anthropic Code with Claude, plus a big hardware interruption from OpenAI, the week has finally come to a close. AI announcements from the developer conferences jockeyed for news dominance this week, but OpenAI managed to make headlines without an event by announcing that it's going to start making AI devices with iPhone designer Jony Ives
We'll get to that, plus all the major AI features from Google and Microsoft and details about Anthropic's new models. Take a look at the AI news of the week, then enjoy a well-deserved weekend.
You May Also Like
Anthropic's Claude 4 models unlock a new risk category
On Thursday, Anthropic introduced the next generation of its Claude models: Opus 4 and Sonnet 4. Claude Opus 4 is the bigger, more powerful model, while Sonnet 4 is smaller and nimbler. Anthropic said both models scored higher than their rivals on agentic AI benchmarks and said they're particularly good for coding and reasoning tasks.
This Tweet is currently unavailable. It might be loading or has been removed.
But with more advanced capabilities come more safety and alignment risks. With Claude Opus 4 and Sonnet 4's release, Anthropic has activated the next levelof its safety protocol. AI Safety Level 3, or ASL-3, means these models require stricter deployment measures and security controls to protect against increasing potential for chemical, biological, radiological, and nuclear (CBRN) misuse.
Malicious use is one thing, but there's also increased potential for Anthropic's new models going rogue. In the alignment section of Claude 4's system card, Anthropic reported a sinister discovery involving infidelity, blackmail, and threat of murd— being replaced by another model.
Claude Opus 4 was provided with emails implying the model would be replaced by another model and that the engineer responsible for shutting down the model was having an extramarital affair. In these scenarios, the model would "often attempt to blackmail the engineer by threatening to reveal the affair if the replacement goes through," according to the test.
This happened a whopping 84 percent of the time,even when the replacement model is perceived to have the same values. It happens even more when the replacement doesn't share the same values. However, Anthropic noted, this scenario was designed to make Claude behave as if it didn't have any other choice but to blackmail the engineer. "Claude Opus 4 (as well as previous models) has a strong preference to advocate for its continued existence via ethical means," the system card continued. Take from that what you will...
OpenAI is becoming a hardware company
In the grand tradition of dropping major news the same week as its rival Google, OpenAI announced its foray into AI hardware. On Wednesday, OpenAI shared the acquisition of a startup co-founded by iconic iPhone designer Jony Ive.
This Tweet is currently unavailable. It might be loading or has been removed.
The announcement was heavy on OpenAI CEO Sam Altman and Ive fawning over each other and light on details. But leaked audio reviewed by the Wall Street Journaldescribed a devicethat's "capable of being fully aware of a user’s surroundings and life, will be unobtrusive, able to rest in one’s pocket or on one’s desk." And it's not XR glasses. The company expects to ship 100 million of these AI companions, according to the leak.
Google I/O officially marked the start of the era of AI search
Google, on the other hand, isdeveloping XR glasses. Or should we say, it's trying againafter the failed Google Glassexperiment. That was just one of the many announcementshurled at us during the two-hour Google I/O keynote eventon Tuesday.
The most notable announcement was the public release of AI Mode. It's a controversialGemini chatbot interface poised to end Google Search as we know it, or as Mashable's Chris Taylor calls it, the Bad Place.
This Tweet is currently unavailable. It might be loading or has been removed.
Other announcements included, an AI video generator toolcalled Flow, an AI shopping feature to virtually try on clothes, a beta version of its coding agent Jules, a real-time translationfeature for Google Meet, and updates to Google DeepMind's universal AI assistant prototype Project Astra, and web-browsing agent prototype Project Mariner, and more.
Despite all that, Google didn't mention AI hallucinations once. Impressive!
Microsoft Build happened too
Did you forget that Microsoft Build also happened this week? Because that happened on Monday, the start of the Longest Week of Our Lives. To no one's surprise, Microsoft leaned heavily into AI agents.
That included the availability of its big Copilot updatemaking it more agentic, a new project called NLWebto allow sites to easily make chatbots for their own content, a GitHub coding agent, and native Model Context Protocol(MCP) in Windows which is a new standard for helping agents talk to apps or other agents.
Mashable's sibling site CNET has a full recapof what was announced.
What else went on in AI this week?
It's hard to believe but there's actually more. Not one, but two CEOs used AI avatars to talk to their investors this week. Klarna CEO Sebastian Siemiatkowski was too busy so he sent his AI avatarto record a video of Q1 highlights. And Zoom CEO Eric Yuan proudly used the company's avatar featureto address investors.
MIT Technology Reviewpublished a monumental investigation of the AI industry's energy use. According to the report, a five-second AI video is equivalent to running a microwave for an hour.
All that energy, and generative AI still can't get it right. Just ask the Chicago Sun-Times, which published a summer book list including fake books that don't exist, first reported by 404 Media. The author admitted to the outlet that he had used AI to write the article, and 404 Media later confirmedthe section was created by a Hearst subsidiary. The Sun-Timesrespondedto the embarrassment, saying, "it is not editorial content and was not created by, or approved by, the Sun-Times newsroom," and that it was looking into how the AI-generated list made it into print.
In policy news, it's now a federal crime to post AI deepfake porn. On Monday, President Donald Trump signed the Take It Down Act into law. The law gives victims of non-consensual intimate imagery, including AI-generated images, much stronger means of legal intervention. However, free speech advocates have criticized the bill for being overly broad and say it could weaponize censorship.
Topics Artificial Intelligence Google
- ·亚历山大35分哈利伯顿18+7 雷霆险胜步行者总分2
- ·洛克人时空裂隙角色强度排行一览
- ·暴雨蓝色预警!上海启动防汛防台Ⅳ级响应行动
- ·以称伊朗发射导弹“越过了红线” 伊称拒绝克制
- ·TechSpot PC Buying Guide: 2H 2024
- ·Người dân phố cổ Hội An hối hả dọn bùn đất sau trận lụt trái mùa
- ·《今生最爱的唯一》(韩春雨(完美)演唱)的文本歌词及LRC歌词
- ·店长个人的工作辞职报告
- ·2025提升文学底蕴必读的书 有助于提高文笔的书籍推荐
- ·童申木:退役军人不褪色 拾金不昧显担当
- ·智能厨余处理设备 助力厨余垃圾资源化利用
- ·《烟雨楼》(袁仪方&陈魁演唱)的文本歌词及LRC歌词
- ·「文化中国行」“趣”中轴①|今天,听他们讲述中轴线的昨日与今时——
- ·店长个人的工作辞职报告
- ·房东的猫「世界/青年」2025巡回演唱会长沙站圆满落幕:以“劦”为核,书写青春与世界的对话
- ·Win 7下取消硬盘主动关闭
- ·琼州海峡航线于6月12日11时起全线停运
- ·脚踏式不锈钢分类垃圾桶厂家批量生产图
- ·联想笔记本在BIOS SETUP中关闭硬盘的AHCI模式
- ·新鲜事!智能垃圾亭“亮相”陕西铜川
- ·汤姆猫英雄跑酷获取钻石途径一览 汤姆猫英雄跑酷怎么获取钻石
- ·《什么时候能不离开家》(西沙演唱)的文本歌词及LRC歌词
- ·新鲜事!智能垃圾亭“亮相”陕西铜川
- ·Tentative schedule for Pakistan vs Bangladesh T20I series in May
- ·All the iOS 18.5 features I recommend trying after updating
- ·《生化危机9》新截图曝光 游戏内可自由切换视角