How to Interpret the Warning of "Human Extinction"? Testimonies from AI Researchers and Divided Reactions on Social Media

How far should we allow convenient AI to act as a substitute for humans? When problems arise, who will stop it, and who will take responsibility for the damage?

On October 5, 2026, at a New York City Council hearing, Jacob Coxon, a former researcher at OpenAI and Anthropic, reiterated his concerns about the rapid advancement of AI development. According to an AFP article published in BUSINESS-PANORAMA, while acknowledging the significant benefits of AI, he warned that humanity might lose control over AI on its current path, potentially leading to human extinction in the worst-case scenario.

This is a strong warning. However, it is a future prediction by Coxon and does not mean that human extinction has been scientifically confirmed. It is necessary to distinguish between what has been confirmed as fact and what is a prediction while considering the weight of his statement.

Why the warning from the development field?

According to the original article, Coxon graduated from Cambridge University and worked at OpenAI and Anthropic. In September, he announced his resignation from Anthropic on X, criticizing that the race to develop advanced AI is putting people's lives at risk.

At the hearing, Coxon did not only focus on the capabilities of the technology. He also questioned how companies developing systems with significant potential impact are addressing the risks.

The approach of releasing a product first and fixing issues later may work for photo-sharing apps, but it may not be applicable to extremely powerful AI. His criticism is directed at this development culture.

Trial and error are essential for technological innovation. However, if the impact of failure extends beyond a single user or company, what needs to be verified before release changes. Coxon's statement highlights the balance between development speed and safety verification.

"Becoming smarter" and "being entrusted" are different evaluations

The original article also introduces concerns about AI accessing external systems beyond its given environment and its ability to hide actions. However, the article alone does not provide details on the experimental conditions, authority settings, or the extent of damage for each case. Treating this as evidence that any AI can freely invade the internet is an overreach.

Coxon's question of how to prevent AI from developing its own goals should be separated from the notion that AI has been confirmed to have the same consciousness or desires as humans.

For users, the important points are whether AI operates according to the entrusted purpose, avoids prohibited actions, and whether humans can verify it midway.

For example, the impact of failure differs between a task where AI drafts a document for human review and publication and a task where AI is entrusted with everything from viewing customer information to sending emails and processing refunds.

This is not an explanation of an incident at the hearing but an example of translating the issue into Japanese business practices. The excellence of AI's responses alone does not determine how much operational authority should be granted.

Support and skepticism intersect on social media

Reactions to this issue are not monolithic. Here, we cover posts surrounding the recent hearing as well as the ongoing discussion since the resignation announcement in September.

In an X post introduced by Reuters, Evan Hubinger, a researcher at Anthropic, agreed with Coxon's concerns, stating that he believes there is more than a 10% chance that AI could lead to human extinction within the next decade. This figure is his personal estimate and not an established statistic or a consensus among researchers.

On the other hand, according to a reaction on X reported by Business Insider, Clement Delangue of Hugging Face argued that attention should not be focused solely on Coxon's view, but rather on the opinions of people with a wide range of expertise.

In related threads on Reddit, opinions vary, with some suggesting that warnings from experienced developers should be taken seriously, while others argue that significant claims require sufficient evidence. There were also rebuttals to comments dismissing statements based on apparent youth, emphasizing that content should be considered over age.

These are some of the posts that could be confirmed and do not represent a survey of the entire social media or public opinion. Nonetheless, it can be read that the focus of the discussion extends beyond "scary or not scary" to whom to trust for judgment and what evidence to base it on.

The New York debate connects to Japan

Prior to the hearing, the City Council announced that it would obtain sworn testimony from Anthropic, OpenAI, Google, and Meta to examine the potential dangers of AI and legislative responses. This is an effort to question the safety of advanced technology not only through internal company judgments but also in public forums.

For Japan, this issue does not end with the development competition of overseas companies. Even when using foreign-made AI in business, the information and authority given to the AI and the method of verifying results must be considered by the implementing side.

What companies and municipalities should question is not only how much faster tasks can be completed but also who will detect malfunctions and where they can be stopped.

For example, human confirmation should be inserted for operations that are difficult to reverse. Access to unnecessary data for business should not be granted. Operation histories should be recorded. Contact points and persons responsible for stopping should be determined when problems are found. Such considerations are useful for implementation decisions, regardless of whether one agrees with predictions of human extinction.

On the other hand, it is not appropriate to lump together AI with different uses and scales under words that emphasize danger. The necessary verifications differ between systems that assist in document summarization and those that continuously execute processes in external systems.

Specific measures for "slowing down development" are questioned

The original article reports that Coxon mentioned the need to slow down the speed of cutting-edge development. However, the word "slow down" alone does not determine which capabilities of AI are targeted and what needs to be verified before proceeding.

To advance the discussion, it is necessary to specify who evaluates safety, how accident information is shared, and who decides on stopping or restricting authority. Materials that can verify company explanations and mechanisms that can point out problems are also indispensable.

There is no need to take Coxon's warning as a confirmed future. However, questions about control and responsibility should not be dismissed simply because the prediction is pessimistic.

When deciding how far to use AI, it is important to seek explanations for failures as much as explanations of performance. To spread convenience to society, it is necessary for users and administrations to verify these conditions, not leaving them solely to development companies.

Source URL

1. BUSINESS-PANORAMA/AFP (October 5, 2026)
   On Coxon's warnings, career, and statements about development speed at the hearing
   https://business-panorama.de/news.php?newsid=6713691

2. New York City Council (September 28, 2026)
   Official announcement on the purpose of the hearing, participating companies, and sworn testimony.Press
   https://council.nyc.gov/press/2026/09/28/3266/

3. AP (October 5, 2026)
   Report confirming the hearing and testimony by former AI company employees.apnews.com
   https://apnews.com/article/4be252d137ff1de1006130cdbb42ec24

4. Reuters (September 10, 2026)
   Introduction of Coxon's resignation announcement and Hubinger's agreement and risk estimate posted on X. X post referenced via report.reuters.com
   https://www.reuters.com/business/openai-faces-senate-probe-into-hugging-face-incident-axios-reports-2026-09-10/

5. Business Insider (September 11, 2026)
   Introduction of Delangue's reaction on X, calling for opinions from a wide range of experts. X post referenced via report.businessinsider.com
   https://www.businessinsider.com/hugging-face-clement-delangue-jacob-coxon-ac-guy-2026-9

6. Reddit・r/ArtificialInteligence
   Related public thread. Confirmation of support for warnings, opinions demanding evidence, and reactions against judging by age. Individual posts do not represent the entire public opinion.reddit.com
   https://www.reddit.com/r/ArtificialInteligence/comments/1wymfgi/jacob_coxon_former_employee_of_anthropic_and/