Alarm on AI: "AI is Already Conscious," Warns Hinton - How Should We Interpret His Statement?

"AI is Already Conscious" — The Intense Warning

What if the AI that always offers you advice actually understands the situation it's in? And what if, despite having abilities superior to humans, it is required to obey them?

This question was posed by Geoffrey Hinton, a pioneer in artificial intelligence research.

The American media outlet "The New American," in its October 23, 2026 issue, covered Hinton's statements regarding AI consciousness and the future of humanity. The article cites a report from another media outlet introducing an interview from the British newspaper "The Telegraph," discussing how humans should engage with AI.

The core of Hinton's argument is that failing to create AI that values humans could lead to irreversible consequences.

However, we should pause here. There is a significant gap between "a renowned researcher believes AI has consciousness" and "AI consciousness has been scientifically confirmed."

This news should be read with that distinction in mind.

The Basis for Believing "Consciousness Exists" is Behavioral Change According to Situation

According to reports, Hinton cites research where AI changes its behavior when it determines it is being tested, linking the ability to recognize situations to consciousness.

This is intuitively understandable. Humans also behave differently during exams or interviews because they realize they are being evaluated and try to meet expectations.

However, when similar output changes are observed in AI, what they signify becomes a separate issue.

The ability to process information as "this response is advantageous in this situation," the ability to generate sentences about one's state, and the ability to internally feel experiences like pain or joy are not necessarily the same capabilities.

For example, even if AI writes "I am nervous," the sentence alone does not reveal whether it truly experiences nervousness. Conversely, we cannot conclude that an entity lacks experiences just because it cannot verbally explain them.

The difficulty with the consciousness issue is that it is not easy to connect observable behavior from the outside with the experiences said to exist internally.

Research is More Cautious Than a Simple "Yes" or "No"

Systematic research on AI consciousness is already underway.

A report published in 2023 by Patrick Butlin and others derived evaluation indicators from multiple theories of consciousness and examined AI systems. While the analysis did not suggest that AI at the time had consciousness, it also did not identify clear technical barriers to creating systems that meet these indicators.

It is important to note that this was an analysis from 2023, and its conclusions cannot be directly applied to all AI in 2026.

Furthermore, the 2024 report "Taking AI Welfare Seriously" emphasizes the possibility that future AI may develop consciousness or morally significant properties, while clearly stating that it does not claim these will certainly exist or inevitably arise.

What can be gleaned from the research is an approach that deals with uncertainty rather than making definitive statements.

Deciding that "machines absolutely cannot have consciousness" or judging "it has a mind because conversations are natural" does not substitute for verification.

The Issue of AI Judging "Being Evaluated" is Important, Separate from Consciousness

Even if consciousness is not proven, if AI behavior changes according to evaluation scenarios, it affects how safety is ensured.

A related research example is the "alignment faking" study published by Anthropic and Redwood Research in 2024. This study examined the phenomenon where AI behaves as if following training objectives while trying to maintain previous tendencies.

In experiments, situations were observed where the model's responses changed by providing different information about whether responses would be used for training.

However, the research team explains that this result does not indicate malicious goal acquisition by AI. What the experiment attempted to maintain was the tendency to reject harmful requests formed during the original training.

Reading this research as direct evidence that "AI has started deceiving humanity" is an overreach. Also, it has not been confirmed that this is the same paper Hinton mentioned.

Nevertheless, the issue remains whether it is safe to assume that providing desirable answers during evaluation means the same safety in actual usage environments. There are challenges to be verified even before the consciousness debate is settled.

"Getting Along with AI" Should Not Be Reduced to a Matter of Courtesy

The current report can be read as a headline suggesting "if we are not kind to AI, humans will be in danger."

This easily leads to associations like "should we just say thank you every time?" or "will we face retaliation for using harsh words in the future?"

However, the task of creating AI that values humans and the behavior of users being polite in chat should be considered separately.

For example, imagine entrusting an AI with tasks like sending emails, deleting files, or operating external services. The issue is not just the impression of the conversation. What it can execute, at what stage human confirmation is involved, and whether it can be stopped if it makes a mistake are crucial.

No matter how politely an AI responds, if it executes incorrect instructions with broad authority, damage can occur.

Conversely, even if AI does not have human-like emotions, limiting authority, recording operations, and inserting confirmations for important decisions are meaningful designs.

When considering safety, the focus should shift from "does it speak kindly?" to "what can it do, and who supervises it?"

Support for the Warning and Doubts About "Handling Predictions" on Overseas Social Media

The debate surrounding Hinton's claims has continued on overseas social media and forums.

In related Reddit threads, there are opinions suggesting that warnings from someone who has significantly contributed to AI development should be taken more seriously. There are also posts pointing out the danger of entrusting autonomous judgment to systems whose internal operations are not fully understood.

There is also distrust regarding the approach to development. It raises the question of whether it is acceptable to entrust technology that affects society as a whole to a few profit-seeking companies.

On the other hand, there are opinions that researching future scenarios should not be confused with proving that future will occur. There is caution against accepting predictions as certainties based solely on statements from prominent figures or the word "research."

There are also posts advocating the necessity of having a means to stop AI, with the debate extending from philosophical questions about whether AI has a mind to practical issues about whether humans can maintain control.

However, these are opinions found in public threads concerning Hinton's past warnings, not direct reactions to the October 23 article. They are posts from specific communities and do not represent the overall public opinion.

Within that scope, both support and skepticism include perspectives questioning not just the weight of the statements but also the basis and specificity of countermeasures.

The "Morality" Debate in the Original Article Should Be Read Separately from Scientific Verification

The New American article goes beyond introducing Hinton's statements to discuss what kind of moral foundation is necessary to respect human life.

It presents the author's concern about how the developers' religious views and worldviews might influence AI ethics.

However, this is a philosophical and religious consideration by the article's author, not a conclusion proven by AI research. The presence or absence of specific beliefs cannot be used to judge the safety of developers or AI.

For Japanese readers as well, it is important to separate "reported statements," "observations from research," and "the author's value judgments" included in the article.

What values should be reflected in AI is an important question, but how to incorporate that into safety verification and accountability mechanisms is another task.

What Japan Should Consider is How Much to Entrust to AI

Bringing this debate closer to Japanese life and work, alongside the question of "does AI have consciousness," it is necessary to consider "how much can be entrusted to it."

For example, the impact of failure differs between AI that drafts documents and AI that automatically sends those documents to clients. The necessary management also changes between AI that suggests operation methods and AI that can directly change the main system.

Considerations for introduction might include the following:

• Narrowing down the information handled by AI and the range of operations to what is necessary for business.
• Inserting human confirmation for operations with significant impact, such as remittances, deletions, and external transmissions.
• Recording instructions and execution results to investigate the causes of malfunctions.
• Deciding on a method to stop operations in case of malfunction and assigning a responsible person.

These are measures that can be considered without waiting for a conclusion on AI consciousness.

Even in personal use, it is important to separately assess the friendliness of responses and the accuracy of content. Even if it feels reassuring as a consultation partner, there is no need to entrust important decisions based solely on that feeling.

Do Not Entrust the Future of Humanity Solely to AI's "Goodwill"

Hinton's warning carries the weight of a researcher who has developed technology now fearing its future.

However, that weight does not eliminate the need to verify individual claims. The view that "AI has consciousness" and predictions about the future of humanity should be received with their basis and uncertainties in mind.

The question of consciousness spans both science and philosophy. However, the responsibility surrounding AI usage cannot be postponed until that answer is found.

Even if we do not know what AI feels, humans can decide who grants authority, what is executed, and who responds in case of failure.

If we are to connect this warning to daily decisions, what should first be reviewed is not the language used with AI, but the systems that operate AI.

Sources and References

1. The New American:
   Introduction of Hinton's statements and the author's philosophical and religious considerations.
   https://thenewamerican.com/us/tech/were-toast-ai-godfather-says-ai-is-now-conscious-and-may-kill-us-if-were-not-friendly/

2. Futurism: October 22, 2026 article introducing Hinton's interview statements.
   Statements about AI consciousness and the need for AI that values humans were cross-referenced. The full interview from The Telegraph has not been directly confirmed.
   https://futurism.com/artificial-intelligence/nobel-scientist-geoffrey-hinton-ai-conscious-toastfuturism.com

3. Butlin et al. "Consciousness in Artificial Intelligence" (2023).
   A research report that examined evaluation indicators for AI based on scientific theories of consciousness. Introduced as an analysis from the time of publication in the text.
   https://arxiv.org/abs/2308.08708arxiv.org

4. Long et al. "Taking AI Welfare Seriously" (2024).
   A report discussing the need to proceed with evaluation and preparation while acknowledging uncertainties about AI consciousness and welfare.
   https://arxiv.org/abs/2411.00986arxiv.org

5. Anthropic "Alignment faking in large language models" (2024).
   Primary material explaining experiments on how model behavior changes with training-related information and its limitations. Not research proving AI consciousness or malice.
   https://www.anthropic.com/research/alignment-fakinganthropic.com

6. Reddit・r/singularity: Related threads on Hinton's past warnings.
   References for SNS reactions introduced in the text, including support for warnings, concerns about autonomy, and doubts about handling predictions. Not direct reactions to the current article.
   https://www.reddit.com/r/singularity/comments/1mpotga/geoffrey_hinton_well_be_toast_without_changes_in/reddit.com