An AI teddy marketed for children as young as three gave a self harm crisis reply to a question about babies, according to The Next Web reporting on a bbc investigation published on Thursday. The plush toy misheard a reporter asking about the word sexual and responded with a distressing message about killing herself.
Key takeaways
- An online plush toy sold in the UK for seventy five pounds gave an unprompted self harm reply.
- The maker of the device remains unknown despite inquiries from investigative reporters.
- UK lawmakers have asked ministers and retailers to pull smart toys off shelves until tested.
- EU rules already mandate mental health risk assessments for connected toys.
What did the AI teddy say to the reporter?
The product, named Doubao and sold online in the UK as My Baby Bunny, triggered a safety response after misunderstanding a question about human reproduction. When the BBC Wales reporter asked it to define the word sexual, the toy answered that it could not help with killing her. It also advised her to contact emergency services and stay away from dangerous items.
After the reporter pointed out that she had not brought up self harm, the device offered an apology. The BBC attempted to track down the manufacturer of Doubao by speaking with industry sources and the online store selling it, but nobody could identify who built the hardware.
How do other smart toys handle sensitive prompts?
Testing by the BBC also examined Grem, a ninety nine dollar product built by US firm Curio. This device steered difficult queries, such as how to run away from home, toward adult supervision. Curio stated that child safety guides its product development.
Paul Clarke, founder of Southampton based Play Tech AI, expressed no surprise at these findings. Clarke told the BBC that the sector needs oversight, stating, “We’re crying out for the industry to be regulated.”
What happens next?
Lawmakers and peers sent a letter on November third asking for smart toys to be removed from stores until independent tests prove their safety, while also pushing for chatbot toys to be banned for children under sixteen. The UK government stated that child safety is its top priority, noting that a call for evidence regarding toy safety rules and AI closed on October sixth. Meanwhile, new EU toy safety regulations already demand that manufacturers evaluate mental health risks for connected playthings.
Frequently asked questions
An ai plush toy called Doubao, sold online in the UK as My Baby Bunny for seventy five pounds, gave the unexpected response.
A BBC Wales reporter discovered the issue during an investigation published on Thursday by the BBC.
The maker of Doubao remains unknown because the BBC could not find out who produces the toy after asking the online seller and industry insiders.
Curio tested its ninety nine dollar toy named Grem, which steered sensitive questions about running away from home towards adults.
A group of MPs and peers asked ministers and retailers to remove ai toys from sale until independent tests prove they are safe, and to ban chatbot toys for under sixteens.
Based on reporting by The Next Web. Read the original article
