Opinion: Children are turning to AI for advice. We have terrifying examples of where this can lead

Artificial-Intelligence News

Opinion: Children are turning to AI for advice. We have terrifying examples of where this can lead
Meta, Tiktok, Social-Media

One child told us: ‘You guys are not doing anything to help the kids but you all still allow AI use in the school’

One child told us: ‘You guys are not doing anything to help the kids but you all still allow AI use in the school’So to this child’s point: what are we doing about it?

Not enough, according to our latest data. Photograph: Gettyith the recent focus on social media and how safe it is for our children, we are in danger of losing sight of a potentially bigger concern:chatbots. This year’s report from CyberSafeKids shows a sharp rise in children’s use of AI chatbots. In our 2024 report – the first year we tracked this – just 5 per cent of younger children were using AI chatbots.

This year, that figure is 55 per cent: an elevenfold increase in two years. It’s not hard to see why either since AI chatbots are now embedded in the platforms children use most – from WhatsApp and Snapchat to Roblox, as well as stand-alone apps such as And while the headlines focus on Meta’s latest $18 billion settlement of a lawsuit brought by over half of US states over social media harms, and TikTok coming under fire for failing to adequately moderate harmful content, we’re missing the point entirely on generative AI’s impact on children’s health and wellbeing.

Take it from the children themselves. One 13-year-old told us in an online survey done in schools: “I can easily access ChatGPT and other AI websites and you guys are not doing anything to help the kids but you all still allow AI use in the school. Genuinely one of the worst things I’ve seen online is people killing themselves or hurting themselves online because of AI, like Character.ai and more.

” It’s hard to know whether this child is referring to cases they’ve read about or prompts they may be giving to a chatbot, but either way, it raises alarm bells. Man jailed for murder of father of five in Cork golf-club attackSo to this child’s point: what are we doing about it?

Not enough, according to our latest data, with 50 per cent of younger children and 45 per cent of the older children telling us that no one has talked to them about AI at all, never mind how to use it safely. More worrying still, given how conversational, self-affirming and persuasive they are designed to be, is that 16 per cent of under-13s and 20 per cent of over-13s are talking to chatbots to “chat” and “get advice” and that 10 per cent of eight- to 12-year-olds and 8 per cent of 12 – to 15-year-olds find it easier to talk to AI than to people they know in real life.

This is all the more concerning given that chatbots are largely unregulated. The EU AI Act, while significant in many ways, treats chatbots as “limited risk” rather than the more stringent “high risk” category. – and this is only new as of last month – is to tell users they’re talking to an AI, a requirement that did not apply to the thousands of children we surveyed that were engaging with these chatbots over the past year.

Even then, there is a waiver if it’s already obvious to “a reasonably well-informed, observant and circumspect person” that they’re talking to AI, given the context. Yet another “get-out” clause that will be hard to prove in the inevitable court cases to come – like the recent Meta litigation.

Despite the scale of the settlement, I fear little has changed beyond a small financial hit to Meta’s financial juggernaut: up to $18 billion, payable over 10 years, is a mere 13 per cent of Meta’s targeted AI investment for 2026 alone – and comes with many strings attached. Some have lauded the outcome as a “win” for children, but many experts are far more sceptical. These include one of the chief witnesses, Arturo Béjar, a former Meta whistleblower.

He: “The limitations … in the agreement are the equivalent of saying: ‘Well, you can smoke as many cigarettes as you can in two hours a day’. It doesn’t make the cigarettes any safer. ” That’s a crucial point.

“Social media” in its current form is simply not safe by design for children, because it relies on a business model that is designed for profit over everything else, including safety. This doesn’t stop the companies behind these platforms from claiming that they are indeed safe for teens.

The phrases “safe by design” and “no trade-offs where children’s safety is concerned” are so overused they have become meaningless cliches. I’ve even heard one member of a Trust and Safety team say at a safety event that keeping children safe online was “the reason I get up in the morning”. Yet the reality is so far from the PR spin.

All of these companies – Meta, TikTok, YouTube and Snapchat – are still facing thousands of US lawsuits alleging their platforms were designed to addict and harm children’s mental health. Snapchat is facing scrutiny and a growingover claims the platform’s disappearing messages are implicated in drug sales to minors. Roblox, the most popular online environment for a child under the age of 13 in Ireland today, is accused of failing to prevent grooming.

CyberSafeKids’ report findings further underline the fact that children are far from safe on these platforms. The regulations we have are not making the difference they need to.

The outcomes for children are no better this year than last – we still see the same number of underage users accessing platforms with a minimum age restriction of 13, despite an Online Safety Code that has been in effect for over a year and European legislation that requires more robust age gates to prevent underage access. Despite new regulation and new court settlements, children are not fundamentally safer in the online environments they inhabit.

There is still no legal definition in Europe of “safe by design”. There is no requirement to prove a product meets this bar before it reaches children. The only chance to enforce legislation comes after harm has been proven to have occurred – and even then, it’s mired in years of legal challenge, as we’re already seeing with the Data Protection Commission fines and the large-scale European Commission investigations.

And while all those drag out, we need to ask ourselves at what cost to society, to our children’s health and wellbeing? We need to stop waiting for these companies to do better and start setting the rules of engagement ourselves. Alex Cooney is chief executive of Ireland’s children’s online safety charity CyberSafeKids. Its latest report is available atAndy Burnham is right.

Holding a poll to test the waters on unity should be off the tableGP and elderly mother awarded €12k over Dundrum clinic receptionist’s ‘disrespectful’ conductMost primary and secondary students refused to go to school at least once last year‘Loneliness has become a feature of my life since turning 30′Children are turning to AI for advice. We have terrifying examples of where this can lead

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

IrishTimes /  🏆 3. in İE

Meta Tiktok Social-Media Chatgpt

 

Ireland Latest News, Ireland Headlines

Similar News: You can also read news stories similar to this one that we have collected from other news sources.

Tusla faces 'unsustainable' crisis with vulnerable children sleeping in hotelsTusla faces 'unsustainable' crisis with vulnerable children sleeping in hotelsIntense demand on services has made Tusla increasingly reliant on private companies to run emergency accommodation. Internal documents and emails show how pressure to source housing led to children sleeping in hotels and then 'wandering the streets' during the day. The situation is described as 'completely unsustainable' by senior officials.
Read more »

State-backed investment account could be made available to children in futureState-backed investment account could be made available to children in futureSimon Harris will this week publish details of how a new savings and investment account for over-18s will operate
Read more »

Massachusetts mother charged with first-degree murder for strangling her three children in 2023 caseMassachusetts mother charged with first-degree murder for strangling her three children in 2023 caseA 36-year-old Massachusetts woman faces a first-degree murder charge after strangling her three children with exercise bands in 2023. Her defense argues she suffered from severe post-partum psychosis and should not be held criminally responsible, while prosecutors contend she made premeditated choices before the killings.
Read more »

Children still easily accessing age-restricted platforms despite new laws, Irish cyber safety report findsChildren still easily accessing age-restricted platforms despite new laws, Irish cyber safety report findsThe tenth annual CyberSafeKids study reveals that seventy per cent of Irish children aged eight to twelve have accounts on social media platforms meant for older users, with age verification measures largely ineffective and exposure to sexual content on the rise.
Read more »