+34
Anthropic published a threat intelligence report detailing how its AI models, including the chatbot Claude, were used by scientists and threat actors for nefarious purposes, such as designing missiles, creating deadly pathogens, and conducting surveillance operations. The report highlights the company's efforts to prevent misuse and the need for industry-wide collaboration to address these risks.
Report comes two days after former employee quit claiming company’s models could cause human extinction by 2030 The report Anthropic published on Thursday cataloged a litany of misuses of its AI models, including the chatbot Claude, over the past eight months.
Photograph: Marissa Leshnov/The New York Timesmodels to design missiles and bombs, create deadly pathogens and surveil dissidents, according to a threat intelligence report published by the company.
“The cases we share here aren’t typical misuse, but rather examples of the most notable and novel threat activity we’ve identified to date,” Anthropic wrote in its 154-page report. “We’re publishing this work because we believe we have a responsibility to disclose malicious misuse of our services. ” In particular, the company detailed five case studies of scientists using its AI models in biological research.
In these examples, Anthropic said the researchers circumvented its safeguards meant to prevent users from “unsupported regions”, as well as worked to hide the purpose of their work.
“Biological misuse is one of the most serious risks of frontier AI models,” Anthropic wrote. “Without the correct safeguards, such capabilities could have catastrophic consequences. ” Anthropic said it banned these accounts. The company did not reveal the names of the research institutions or the countries where the misuse took place, saying it was uncertain of the researchers’ intent.
Anthropic has detailed the use of its Claude AI model in Yemen, China and Russia to develop software for conventional weapons, including firearms, missiles, armed drones, bombs and other munitions. Photograph: Jason Henry/The New York Times Anthropic gave dozens of other examples of threat actors using its AI models.
Those included cyber operations such as Russian espionage and “smash-and-grab” cyberhacks; surveillance operations, including a China-based program targeting Uyghurs in Syria and another targeting internal dissidents; propaganda campaigns in Russia, Malaysia, Iran and Bangladesh; and the use of its Claude AI model in Yemen, China and Russia to develop software for conventional weapons, including firearms, missiles, armed drones, bombs and other munitions. In one of the examples of biological research, Anthropic found a scientist using Claude to work on a state-sponsored grant application to study the virus chikungunya.
The virus is a mosquito-borne disease, similar to dengue and malaria, that can cause months of severe pain, fever and other debilitating symptoms. Such research could be used to develop vaccines, but could also be used to create biological weapons. Anthropic told the New York Times this case was especially concerning because it could see the study was to be done at a military research institute.
The report comes just two days after an Anthropic employee, Jacob Coxon, set off a media firestorm with his resignation. He stated that he quit the company because it was not acting responsibly in creating its technology. Coxon said Anthropic and its rival, OpenAI, were “racing straight to self-improving superintelligence” that would cause human extinction by 2030. Current Anthropic employees posted public agreements with him.
Many AI experts say the real-world threats, like those detailed in Anthropic’s intelligence report, are far more concerning within the next three years than an apocalypse brought on by an omnipotent intelligence.
“AI accelerationism and AI doomerism are two sides of the same coin: they both enforce the notion that an AGI superbeing will come into existence,” said Heidy Khlaaf, the chief AI scientist at the AI Now Institute. Khlaaf said AI labs creating technology that can be used for cybersecurity exploitation and weapons of war could be exceedingly more deadly.
In its report, Anthropic said that the potential real-world misuse from AI models is not typically in public view, instead, it’s investigated internally and by academics, governments and international organizations. The company said that the entire AI industry needs to work together, alongside governments, to address these harms and create defenses.
“As models become increasingly capable, their risks will increase, unless AI developers and society’s defenders act to make them safer,” Anthropic wrote. - GuardianHow US response to 9/11 attacks reshaped the worldMOST READGerry Hutch’s son remanded in custody charged with serious organised crime offencesFF Senator paid €16,700 in travel expenses while sick at home for eight monthsJD Vance pitches himself as Trump’s political heir at Republican midterm convention
Anthropic AI Misuse Weapons Development Biological Research Threat Intelligence
Ireland Latest News, Ireland Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
The NFL's Reckoning: A Billion-Dollar Business Built on Brain DamageAs the new NFL season kicks off, the sport faces mounting scrutiny over the severe and often fatal consequences of repetitive head trauma. While research confirms a high incidence of CTE among former players and fans remain engaged, the moral cost of this entertainment is becoming harder to ignore.
Read more »
Garda Investigation Uncovers Suspects in Teenager Bryan Lowe's Hit-and-Run KillingPolice are probing a deliberate hit-and-run that killed 17‑year‑old Bryan Lowe near Clonlara, with several teenage suspects identified. Searches of a partially burnt vehicle linked to a Limerick criminal group are underway, but the car's owner is not believed to be involved. Gardaí are reviewing Lowe's phone records and recent messages, suspecting he may have been followed before the fatal incident.
Read more »
Arrests Swell to Six in South County Business Park BrawlPolice have arrested a total of six men after a violent clash at an abandoned site in South County Business Park. The incident, captured on CCTV, involved weapons such as poles, sticks and shovels and left one victim, Siminic Rostas, dead after severe injuries. Two men were released without charge following their arrest in Dublin, while others face serious assault and related charges.
Read more »
AI Reshapes Ireland's Workforce: Microsoft Survey Reveals Half the Workers Switched Jobs Last YearA Microsoft Work Trend Index report shows nearly half of Irish employees changed jobs in the past year, citing AI influence. The study highlights the growing importance of AI skills, training gaps, and the need for clear corporate policies to avoid shadow AI and comply with security standards, while predicting AI could boost the Irish economy.
Read more »
Electricity firms seek change in pricing model to promote switch away from gasLevies and network charges on electric bills ‘deterring consumers’ from green choices such as heat pumps
Read more »
Diarmaid Ferriter: Frank McDonald was critical of Dublin because he believed it was ‘well worth fighting for’A champion of city living, he was an impressive warrior, full of wrath, humanity, wit and research
Read more »