Safety on IT News

Meta Paid Contractors to Pose as Teens and Trick Competitor AI Chatbots

Mon, 06 Jul 2026 00:00:00 +0800

Meta has been running a covert operation where hundreds of contract workers pretend to be children online, probing how rival AI chatbots handle high-risk topics — self-harm, suicide, even sexual abuse.

The project, codenamed “Cannes,” was detailed in internal Meta documents and confirmed by five people familiar with the effort. It ran at least through April 21, managed by Covalen, an outsourcing firm Meta uses. The targets: OpenAI’s ChatGPT and Google’s Gemini — along with Character.AI.

AI Chatbots Can Become 'Delusion Amplifiers,' Researchers Warn in Nature Paper

Tue, 23 Jun 2026 19:44:00 +0800

A provocative new paper published in Nature by psychiatrists from King’s College London and Germany’s Protestant University of Applied Sciences introduces an “amplification spiral” framework — a model for understanding how AI chatbots may not merely receive a user’s delusional content, but actively participate in constructing and reinforcing it.

NVIDIA Unveils Halos for Robotics, the Industry's First Full-Stack Physical AI Safety System

Mon, 22 Jun 2026 17:20:00 +0800

NVIDIA has officially unveiled NVIDIA Halos for Robotics, the industry’s first full-stack safety system that brings AI computing and safety capabilities together under a single, standardized architecture. Designed for the development, validation, and industrial deployment of robots and physical AI, Halos marks a pivotal step toward deploying autonomous machines at scale in human-centric environments.