Former Anthropic researcher: AI employees are "genuinely afraid" for humanity's future

 

 People working on the technology were "genuinely frightened" by how quickly it was developing and what it would imply for humanity, according to an artificial intelligence researcher who left Anthropic.

 

"I believe that if we don't slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," he said.

 

In light of mounting safety worries about the sector, Jacob Coxon was speaking to the BBC after his resignation article on the risks of AI went viral.
Dario Amodei, the head of Anthropic, the 27-year-old's previous employer, recently urged AI development to slow down, however others have questioned the reasons for this.

 

Elon Musk of xAI and Sam Altman of OpenAI, the leaders of two competing AI companies, have both stated that they support Amodei's proposal for independent oversight of AI model development as well as industry-wide slowing and regulation.

 

In an essay published on Saturday, Amodei stated that while the technology's development was unquestionable, the hazards involved were "serious" and that businesses and governments needed time to handle them.

 

The idea of a delay was supported by Coxon, who was employed at OpenAI before joining Anthropic, but he stated that it would need to be coordinated with China in order to prevent "a race at an international scale".

 

"Because they are caught in a race, the employees of these corporations take their requests for regulation very seriously. He said on Sunday with Laura Kuenssberg, "And they're afraid of the results of that race."

 

Anthropic's CEO, Dario Amodei, calls for a slowdown in AI research. 

 

According to Coxon, the most difficult thing to answer was what an AI apocalypse might look like.

One of the dangers mentioned in Amodei's remarks was that the internet might be taken over by a swarm of bots operating like a supercomputer.

 

This scenario might be feasible in six months to a year, according to Coxon.

 

In response to Coxon's departure, an Anthropic spokesperson told BBC News: "We have "We have always been transparent that AI will bring both enormous benefits and unprecedented risks," an Anthropic representative told BBC News in response to Coxon's exit.

 

"To address these risks, we continue to build models with some of the strongest safeguards in the industry."

The representative continued, "The company has been a pioneer in studying how AI models work." In addition to "aggressively" testing its models and disseminating the results to support scrutiny and stop instances of "AI misalignment," it was the first to offer a strategy for reducing the risks associated with their creation.

 

"This work is also why we believe the world would benefit from the industry adopting a "This work is also why we believe the world would benefit from the industry adopting a lawful, verifiable way to work together to pace how we release powerful models," they stated.

According to Coxon, his colleagues were concerned that the threat might materialize within the next two years.

He added people at AI firms were "planning what to do with their lives and thinking about the impacts of their work", while some were "considering buying land somewhere because they're so scared of the instability as a result of rapid AI progress".

 

 

"They all keep this in their head on a daily basis while working on the technology."

 

 

However, Coxon expressed some hope for AI's future to the BBC, stating that researchers "genuinely want to see the upside" of "solving diseases and improving everyone's lives."

 

Over 10% of anthropologists believe AI "could kill all humans." 

 

Since Coxon's social media post, numerous other members of the industry, like anthropic scientist Evan Hubinger, have also expressed their worries.

"We sincerely think AI has the potential to wipe out humanity! In my opinion, it will be more than 10% over the next ten years," Hubinger stated.

The CEO of AI safety company Faculty, Marc Warner, told the BBC that it was "extremely hard to place a probability" that AI will kill all people.

 

"But it's important to recognize that these people are very sincere in what they're saying," he continued, pointing out that the leaders of various AI companies have long voiced concerns about the hazards associated with AI.

 

Despite being generally upbeat, former prime minister Rishi Sunak, a paid advisor to Anthropic, expressed concern in the Sunday Times about the threat AI poses to humans.

 

 

Dramatic insider warnings concerning AI are rejected by some in Silicon Valley.

 

Nonetheless, some business leaders have hinted that remarks regarding the dangers and potential of AI might be intended to create excitement.

 

 "Sorry, but asking Jacob [Coxon] about AI extinction risk is like asking your AC guy about climate change," Clement Delangue, chief executive of the AI platform Hugging Face, wrote on social media. I'm not suggesting it's inherently boring or incorrect, but let's keep things in perspective."

 

However, Delangue offered to contribute to the possible answers the Anthropic boss suggested once Amodei's piece was published.

 

Several participants in the group informed the BBC that Nvidia CEO Jensen Huang also talked about Coxon's remarks at a conference held last week by the investment firm Goldman Sachs. They said he disregarded them as false.

 

The idea that AI was "going to be the end of humanity" was deemed "complete nonsense" by Huang in the past.

 

Even though Nvidia produces the processors needed to power AI systems, so he might have a commercial stake in an AI boom, his remarks reveal a growing resistance in Silicon Valley against the existential concerns from both current and past employees.

Anthropic and OpenAI are in a duopoly, according to some critics, because Anthropic has been attempting to start a regulatory drive to stifle competition.

According to reports, Anthropic is getting ready for a possible record-breaking initial public offering (IPO) on the stock market, where investors will be able to purchase company shares.

It was anticipated that OpenAI, which was most recently valued at $852 billion (£630 billion), would follow suit. However, Altman of OpenAI stated on Friday that this will not occur this year due to safety concerns.

WHY THERE ARE CONCERNS ABOUT THE US ECONOMY

Given the football World Cup, Taylor Swift's wedding, and a 250th birthday, Americans would be excused for losing focus this summer.
However, there have been increasing indications of economic difficulties. They made headlines this week when the US national debt surpassed $40 trillion (£29.4 trillion), sparking worries both domestically and internationally.

HOW DID WE ARRIVE HERE?

According to Maya MacGuineas, president of the Committee for a Responsible Federal Budget, it took nearly 200 years for the US national debt to reach $1 trillion for the first time.
That 1981 milestone was seen as a warning. "At that time, President [Ronald] Reagan told the nation in a televised address, 'If we as a nation needed a warning, let that be it'," she stated.As we approach America's 250th year, we are spending more on debt interest alone."

Reaching the $40 trillion milestone was anticipated due to increases in public spending throughout the administrations of Joe Biden and Donald Trump, but it also represents a turning point.
Increased expenses for social programs and other expenditures have surpassed income, which has been compromised by tax cuts. Borrowing has escalated in response to disasters like the Covid epidemic and the 2008 financial crisis.

HOW AWFUL IS IT?

The US national debt was slightly less than $20 trillion at the start of Trump's first term as president in 2016. In the ten years following then, it has doubled.
The Congress Joint Economic Committee estimates that the amount is increasing by around $90,000 every second, or $7.8 billion every day.The level of interest rates has changed significantly during the past ten years, according to Eric Swanson, a professor of economics at the University of California and a former senior economist at the Federal Reserve.

"Long-term interest rates in the US are at multi-decade highs - part of that is concerns about inflation, but part of that is concerns about the extreme levels of US government borrowing."
In addition to investors' concerns about the size of the US debt, the bond market is demanding bigger returns since tech companies are vying with the government for investors' money by borrowing staggering amounts to spend on artificial intelligence.The funding of the deficit becomes more costly when interest rates rise, according to economist Mohamed A. El-Erian, a professor at the Wharton School.

According to El-Erian, interest payments on public debt have increased by 15% from the same time last year. They account for about 20% of tax income, which is "larger than defense," he continues.

DO I NEED TO WORRY?

According to the Congressional Budget Office, the US is very close to its $41.1 trillion debt maximum and is expected to reach over $64 trillion by 2036.
However, economists claim that the situation is not yet dire. According to El-Erian, the US has a "much longer runway to fiscally misbehave" than other nations since it has the largest economy in the world and the dollar serves as the global reserve currency.It's about to turn into a yellow light that flashes. "It's not a red light that flashes," he claims.

Other nations have had comparable or greater debt levels, according to Swanson.
Even though the US national debt is 126% of its GDP, it is less than that of other G7 countries like Italy and Japan.
However, Swanson cautions that investor interest in lending money to the US government through bond purchases is "diminishing," producing a "vicious" cycle that necessitates the government providing ever-higher yields to keep investors buying its debt.
Additionally, increased borrowing costs in the US invariably translate into higher borrowing costs in other nations. "What happens in the US never stays in the US," El-Erian asserts. EL-Erian address to BBC News 

According to Charlie Bean, an emeritus professor of economics at the London School of Economics, financial market upheaval could result from a fire sale of US bonds if the US debt to economy ratio reaches a specific threshold.He states, "There's probably a point, but we don't know where it is."It's not like there's a certain amount that we can say, "We're fine if we stay at 145 percent, but disaster will happen if it gets to 150 percent."

FOR AMERICANS, WHAT DOES THAT MEAN?

According to El-Erian, households will probably pay more for credit cards, auto loans, and mortgages as a result of the current circumstances, with those with lower incomes being most severely impacted.
Because greater borrowing costs for businesses are frequently transferred to consumers through higher prices, there is also a secondary impact on consumers.
Accordingly, the debt "finds its way to the pocketbooks of people one way or another," according to MacGuineas.

WHAT COMES NEXT?

According to the most recent data, the US economy has slowed recently, although it is still expanding very quickly.
This is significant because economic expansion results in increased tax revenue, which may be used to fund government initiatives or interest payments. El-Erian notes that the debt issue is alleviated with sufficient growth.
However, the US may need to consider other choices if growth is insufficient. These can involve austerity or changes to the tax and public expenditure systems. Restructuring debt is an additional choice.

The Treasury department intervened on Wednesday to buy back government debt, increasing demand for bonds and cutting borrowing rates. Thus far, the approach has been akin to financial engineering.
However, the effect was fleeting, as long-term borrowing costs increased again the next day.

The White House will want to appear to be making progress on the economy as the midterm elections draw near. Voters' #1 issue is affordability. However, El-Erian is skeptical that the administration is prepared to consider alternative choices because they are no longer attractive.Over the next two to three years, I don't see anything that will drastically reduce the deficit. Tax cuts are the main topic of discussion in politics.

How crypto currency thieves stole $700 million from victims, frequently employing tried-and-true methods

"Having your crypto currency stolen is particularly painful. Even if someone takes your money and puts it in their own crypto currency wallet, it is still viewable online since every transaction is documented on a digital ledger called a block chain”

 " Helen, who lost almost $315,000 (£250,000) to burglars, adds, "You can see your money there on the public block chain, but there's nothing you can do to get it back."

She compares it to witnessing a robber stack your valuables on the other side of an impassable abyss.
Helen and her husband Richard (not his real name), who live in the UK, have been purchasing and hoarding Cardano crypto currency for seven years.

Unlike money saved in more traditional methods, they were drawn to the prospect of investing in a digital asset with the potential for significant value growth. They took precautions to protect their digital keys even though they knew it was dangerous.
However, hackers managed to gain access to their cloud storage account, which contained details on their crypto currency wallets and how to access them.

Following a brief test transfer in February 2024, the thieves quickly and covertly transferred all of the couple's coins to their own digital wallets.
Then, with no way to stop it, the couple watched for months as their money was transferred between wallets. (The fundamental paradox of crypto currency is that, although users can opt to be publicly untraceable, all transactions are publicly trackable.)
Richard and Helen don't have much money. He is a composer, she works as a personal assistant, and they had great expectations for their Cardano investments.

"We'd been buying these coins for so long... We used every scrap of money we could find to buy more," Richard adds. "Aside from my parents' deaths, this theft is the worst thing to happen to me."
Helen has been determined to get their money back ever since. She acquired comprehensive reports from the Cardano developers and other law enforcement agencies. Now, no one can uncover the offenders, despite the fact that she has their wallet address.
They intend to accumulate sufficient funds to hire private detectives in an effort to track down the hackers. It makes you feel powerless, but I'm going to keep trying," she says.

An increase in cybercrime

According to a study conducted in August 2024 for the Financial Conduct Authority (FCA), over 12% of British adults—almost seven million people—owned crypto currency.
560 million people are thought to be crypto currency owners worldwide. However, stealing increased along with ownership. The pandemic caused the value of crypto currency to soar, which in turn led to an explosion in attacks on the sector.

According to investigators at block-chain analysis company Chainalysis, thefts totaled over $3.4 billion (£2.5 billion) in 2025, making it yet another successful year for crypto currency thieves. Since 2020, the annual figure has stayed almost the same.

Massive cyberattacks on cryptocurrency companies are stealing the majority of the money. For instance, in February 2025, hackers from North Korea stole $1.5 billion (£1.1 billion) from the crypto currency exchange Bybit.
The wealthy crypto currency companies compensate the losses in this instance as well as the great majority of others, with no effect on individuals. However, attacks on individual crypto currency investors also increased in 2025.

These individual attacks increased from 40,000 in 2022 to 80,000 last year, according to Chainalysis analysis.
An estimated 20% of all crypto currency value taken, or $713 million (£532 million), came from hacking, scams, or coercion of individuals.
However, the business notes that not all victims may opt to report thefts publicly, so the figure might be far higher. You might be left on your own when this occurs.

Banks and credit card firms cover a lot of thefts and frauds in traditional banking. In the UK, you may file a complaint with the Financial Ombudsman Service and receive compensation through the Financial Services Compensation Scheme. According to the FCA, crypto currency is still very risky and mostly uncontrolled in the UK. "If something goes wrong, it is unlikely you will be protected so you should be prepared to lose all your money."
Searching for "Binance account hacked" online serves as a sobering reminder of this. Although Binance is the biggest crypto currency exchange in the world, with an estimated 1.4 million members in the UK, the page on its website that provides guidance to victims of theft is prohibited in the UK.

Since 2023, the company has not been taking on new UK clients because the FCA has not granted it operating authorization. However, criminals don't give a damn about the location of their victims, and they target people without distinction wherever in the world.
The "under-documented frontier for crypto crime" is how Chainalysis has characterized these attacks on individuals.

They contend that enhanced security procedures at big services may have driven "attackers toward individuals perceived as easier targets" and attribute the volume of crimes to the number of people entering the crypto currency space as investors as coin values have increased.
Additionally, the likelihood of being targeted increases with the amount of crypto currency you own and your level of publicity about it; small-time holders, or "hodlers," as the community refers to them, are much less likely to be impacted.

Muggings, burglaries, and "wrench attacks"

As for the thieves, they could be anywhere.

Block-chain experts from the crypto currency analysis firm Elliptic issued a warning in October that North Korean state-sponsored hackers are increasingly focusing on affluent crypto currency owners. Young con artists and hackers from foreign nations are also prevalent.
Evan Tangeman, 22, entered a guilty plea in December in the United States to being a member of the Social Engineering Enterprise, a group of crypto-currency criminals accused of stealing over $260 million (£194 million) between October 2023 and May 2025.

According to the prosecution, they used compromised databases to target wealthy crypto-currency owners, deceiving them into believing they were crypto-currency exchanges and convincing them to send money.
The gang's members, who were primarily young men from the United States, are alleged to have used the pilfered money to purchase designer handbags, costly vehicles, and private jets to give away at nightclubs.

Prosecutors claim that in several instances, the gang planned home invasions to seize electronics that held the keys to crypto-currency stashes

“In the crypto-currency ecosystem, burglaries and muggings have become so frequent that they are sometimes referred to as "wrench attacks" since perpetrators have been known to threaten victims with spanners.
Spanish crypto-currency thieves attempted to coerce a man and woman into giving up their crypto-currency in April of last year.
The victim and his partner were detained for several hours while the thieves attempted to access their crypto-currency wallets after the man was shot in the leg, according to Spanish police. The woman was eventually freed, but her partner was still unaccounted for; his body was later discovered in a forest.”

In relation to the case, four individuals in Denmark were accused, and five more were detained in Spain.
Similar incidents have occurred in France on multiple occasions, including one in which a kidnapping attempt was caught on camera.

Early in 2025, David Balland, a co-founder of Ledger, a crypto-currency security firm, and his spouse were kidnapped from their central French house.
Police saved them a few days later, but during the extortion attempt, Balland's finger was severed.
Then, last month, masked men stopped a car traveling between Oxford and London and made one of the occupants transfer £1.5 million worth of bit-coin, leading UK police to detain six people.

According to Phil Ariss, director of UK Public Sector Relations at block-chain intelligence company TRM Labs, criminal organizations who are already at ease using violence to further their objectives are likely to switch to crypto-currency.

"As long as there's a viable route to launder or liquidate stolen assets, it makes little difference to the offender whether the target is a high-value watch or a crypto wallet. “Since crypto-currencies are now widely accepted, our conventional perceptions of physical danger and robbery must change.


Since few "wrench attacks" are reported to the public, it is challenging to pinpoint their actual frequency. However, it seems that these kinds of thefts represent a tiny portion of the expanding problem of personal crypto currency thefts.

Additionally, a lot of thieves rely on tried-and-true hacking or fraud techniques, which are getting easier because so much data is being stolen in large-scale cyber-attacks on businesses.

"The number of Bit-coin millionaires is increasing."

"Data is a common problem as Bit-coin millionaires are becoming so frequent, and there are stolen databases that are enriching the target list all the time," explains Matthew Jones, the founder of the crypto-currency security company Haven.
One hacker contacted by the BBC cited a data breach at Kering, the parent firm of premium goods like Gucci and Balenciaga, as an example.
The databases display the amount of money consumers have spent at the stores, along with millions of customer names and contact information.

According to the hacker the BBC spoke with, he paid $300,000 (£224,000) for the spreadsheets so he could target the largest spenders.
He says he conned several Coin base users out of at least $1.5 million (£1.1 million) in crypto-currency using the information and details from another stolen database.

The culprit proved to the BBC that he had $700,000 (£522,000) in Bit-coin, which he claims originated from a single victim, and that he was in possession of the stolen data. I purchase hacked databases and compare them with others to look for wealthy individuals as well as current phone numbers and email addresses. He asserted, "I'm still moving down the list and quickly tripled my money."
Other than the fact that he attends a US institution, the hacker would not provide any personal information.

He responded, "Neither, I am only interested in making money," when asked if he thought of himself as a hacker or a con artist.
Kering previously assured the BBC that its IT systems had been protected following the data breach and emphasized that no bank account details, credit card information, or government-issued identification numbers had been stolen in the attack. Kering did not reply to a request for comment regarding this.

According to Matthew Jones from Haven, he had his own crypto-currency stolen, which led him to create a wallet with additional security features.
He claims that features like geo-fencing to prevent transactions outside of a person's home or place of employment and ongoing biometric verification to ensure that only the owner can transmit coins are now necessary. Additionally, he is incorporating a panic button inside the digital wallet.

"People are walking around with millions of dollars in crypto these days and wallets have no ceiling on how much can be held - or how much can be stolen in one go," he states.

Being 'your own bank'

What the market promotes as "self-custody" is the main focus of Matthew Jones's crypto-currency wallet.
Haven's app is comparable to Trust wallet and Metamask. Although tangible products like USB memory sticks are offered by other firms like Trezor and Ledger, the concept remains the same: you can operate your own bank.
However, as you have no safeguards at all, this increased freedom also comes with more risk.

You cannot even file a complaint with a crypto-currency exchange if your coins are taken from your own self-custody wallet.

When asked if the independence of "being your own bank" outweighs the growing hazards, Jones maintains that it does. He contends that banks have the authority to suspend or terminate your account for general, frequently ambiguous reasons and that they are not really liable to their clients.
Additionally, he claims that he objected to being questioned by conventional financial institutions about topics like why he was taking money out of an account.

After deciding to run their own bank, Helen and Richard lost all of their money. The fact that a large portion of the funds came from the selling of Richard's mother's home following her passing was what made it very heartbreaking.

"My mother's money has gone," Richard claims. "She stole all the grafting she had done for my future. We were briefly homeless after having to sell our automobile and musical instruments."
However, they are not completely abandoning cryptocurrencies. They intend to immediately return to cryptocurrency investing once they receive their money back or save enough.