Anthropic's new AI model resorted to blackmail during testing
So endeth the never-ending week of AI keynotes.
What started with Microsoft Build,关键字3 continued with Google I/O, and ended with Anthropic Code with Claude, plus a big hardware interruption from OpenAI, the week has finally come to a close. AI announcements from the developer conferences jockeyed for news dominance this week, but OpenAI managed to make headlines without an event by announcing that it's going to start making AI devices with iPhone designer Jony Ives
We'll get to that, plus all the major AI features from Google and Microsoft and details about Anthropic's new models. Take a look at the AI news of the week, then enjoy a well-deserved weekend.
You May Also Like
Anthropic's Claude 4 models unlock a new risk category
On Thursday, Anthropic introduced the next generation of its Claude models: Opus 4 and Sonnet 4. Claude Opus 4 is the bigger, more powerful model, while Sonnet 4 is smaller and nimbler. Anthropic said both models scored higher than their rivals on agentic AI benchmarks and said they're particularly good for coding and reasoning tasks.
This Tweet is currently unavailable. It might be loading or has been removed.
But with more advanced capabilities come more safety and alignment risks. With Claude Opus 4 and Sonnet 4's release, Anthropic has activated the next levelof its safety protocol. AI Safety Level 3, or ASL-3, means these models require stricter deployment measures and security controls to protect against increasing potential for chemical, biological, radiological, and nuclear (CBRN) misuse.
Malicious use is one thing, but there's also increased potential for Anthropic's new models going rogue. In the alignment section of Claude 4's system card, Anthropic reported a sinister discovery involving infidelity, blackmail, and threat of murd— being replaced by another model.
Claude Opus 4 was provided with emails implying the model would be replaced by another model and that the engineer responsible for shutting down the model was having an extramarital affair. In these scenarios, the model would "often attempt to blackmail the engineer by threatening to reveal the affair if the replacement goes through," according to the test.
This happened a whopping 84 percent of the time,even when the replacement model is perceived to have the same values. It happens even more when the replacement doesn't share the same values. However, Anthropic noted, this scenario was designed to make Claude behave as if it didn't have any other choice but to blackmail the engineer. "Claude Opus 4 (as well as previous models) has a strong preference to advocate for its continued existence via ethical means," the system card continued. Take from that what you will...
OpenAI is becoming a hardware company
In the grand tradition of dropping major news the same week as its rival Google, OpenAI announced its foray into AI hardware. On Wednesday, OpenAI shared the acquisition of a startup co-founded by iconic iPhone designer Jony Ive.
This Tweet is currently unavailable. It might be loading or has been removed.
The announcement was heavy on OpenAI CEO Sam Altman and Ive fawning over each other and light on details. But leaked audio reviewed by the Wall Street Journaldescribed a devicethat's "capable of being fully aware of a user’s surroundings and life, will be unobtrusive, able to rest in one’s pocket or on one’s desk." And it's not XR glasses. The company expects to ship 100 million of these AI companions, according to the leak.
Google I/O officially marked the start of the era of AI search
Google, on the other hand, isdeveloping XR glasses. Or should we say, it's trying againafter the failed Google Glassexperiment. That was just one of the many announcementshurled at us during the two-hour Google I/O keynote eventon Tuesday.
The most notable announcement was the public release of AI Mode. It's a controversialGemini chatbot interface poised to end Google Search as we know it, or as Mashable's Chris Taylor calls it, the Bad Place.
This Tweet is currently unavailable. It might be loading or has been removed.
Other announcements included, an AI video generator toolcalled Flow, an AI shopping feature to virtually try on clothes, a beta version of its coding agent Jules, a real-time translationfeature for Google Meet, and updates to Google DeepMind's universal AI assistant prototype Project Astra, and web-browsing agent prototype Project Mariner, and more.
Despite all that, Google didn't mention AI hallucinations once. Impressive!
Microsoft Build happened too
Did you forget that Microsoft Build also happened this week? Because that happened on Monday, the start of the Longest Week of Our Lives. To no one's surprise, Microsoft leaned heavily into AI agents.
That included the availability of its big Copilot updatemaking it more agentic, a new project called NLWebto allow sites to easily make chatbots for their own content, a GitHub coding agent, and native Model Context Protocol(MCP) in Windows which is a new standard for helping agents talk to apps or other agents.
Mashable's sibling site CNET has a full recapof what was announced.
What else went on in AI this week?
It's hard to believe but there's actually more. Not one, but two CEOs used AI avatars to talk to their investors this week. Klarna CEO Sebastian Siemiatkowski was too busy so he sent his AI avatarto record a video of Q1 highlights. And Zoom CEO Eric Yuan proudly used the company's avatar featureto address investors.
MIT Technology Reviewpublished a monumental investigation of the AI industry's energy use. According to the report, a five-second AI video is equivalent to running a microwave for an hour.
All that energy, and generative AI still can't get it right. Just ask the Chicago Sun-Times, which published a summer book list including fake books that don't exist, first reported by 404 Media. The author admitted to the outlet that he had used AI to write the article, and 404 Media later confirmedthe section was created by a Hearst subsidiary. The Sun-Timesrespondedto the embarrassment, saying, "it is not editorial content and was not created by, or approved by, the Sun-Times newsroom," and that it was looking into how the AI-generated list made it into print.
In policy news, it's now a federal crime to post AI deepfake porn. On Monday, President Donald Trump signed the Take It Down Act into law. The law gives victims of non-consensual intimate imagery, including AI-generated images, much stronger means of legal intervention. However, free speech advocates have criticized the bill for being overly broad and say it could weaponize censorship.
Topics Artificial Intelligence Google
- ·欢迎来到撒丁尼亚!《碧蓝航线》2月重磅版本携多重活动惊喜来袭
- ·全民转职:死灵法师!我即是天灾
- ·风向诡异 日本二手站惊现大批NS2但价格低廉甚至低于港版
- ·Alcaraz battles back to win French Open
- ·西安户外智能垃圾桶可充电为市民提供便利
- ·谁离鸟巢更近一步?2022“鸟巢之路”+“全明星”积分榜最新出炉!
- ·Most Anticipated PC Games of 2025
- ·马胃溃疡综合症,及时有效的解决方案来了!
- ·อุตุฯ เผยไทยตอนบนมีฝนตกหนักบางแห่ง
- ·吃20斤橘险丧命竟是因为不吐籽 什么水果籽不能吃
- ·入驻小红书之后,宁泽涛商业价值会回暖吗?
- ·超神:每天一个概念级,震惊凯莎
- ·精选大乐透专家:发哥连中90万和4+1累擒5847万
- ·“众里之星”上演精彩逆袭,1000米成功夺魁!
- ·Mbappe fires France to Nations League bronze
- ·法师易“挂”之困,回归道士的安逸游戏路
- ·节约内存:清除任务栏“自定义通知”里的图标
- ·Over 55? AT&T's new unlimited plan for seniors costs $35/month
- ·桐城首家个体投资公益性中老年俱乐部正式运营
- ·UAE captain Waseem named ICC Player of the Month
- ·《剩下的盛夏》(TFBOYS(Rap,Feat.CUG)演唱)的文本歌词及LRC歌词
- ·2025高中必看的书籍排行榜 国内外适合高中生看的书
- ·国产科幻机甲游戏《解限机》定档7月2日公测,登顶Steam国产游戏愿望单榜首
- ·玩家发掘《艾尔登:黑夜君临》超珍稀道具线头用途 掉率感人
- ·挖掘院校“宝藏”|当教育遇上人工智能,会碰撞出什么“火花”?
- ·揭秘传奇武器升级:实践出真知,找寻规律!
- ·《剩下的盛夏》(TFBOYS(Rap,Feat.CUG)演唱)的文本歌词及LRC歌词
- ·传奇SF道士全攻略:辅助与消耗战术一网打尽
- ·四年级状物作文:我家兔子真可爱
- ·Alcaraz battles back to win French Open
- ·Hàng trăm du khách bị mời ra khỏi phố cà phê đường tàu trong đêm
- ·原神久岐忍武器推荐排行
- ·贵州“村超”被足协叫停?组委会回应
- ·รวมไทยสร้างชาติ: ย้อนจุดเริ่มต้นถึงจุดจบของ “มรดกลุงตู่”?
- ·家园卫士毕业武器装备选择推荐 家园卫士毕业武器装备怎么选择
- ·《三国:谋定天下》一周年庆典将启:明星主播齐聚 豪礼福利加码!