[United States] Court Halted Due to "Nonexistent Case Law" Written by AI, Four Lawyers Sanctioned - "Proxy War Between ChatGPTs" Unfolds in Court

[United States] Court Halted Due to "Nonexistent Case Law" Written by AI, Four Lawyers Sanctioned - "Proxy War Between ChatGPTs" Unfolds in Court

https://www.reuters.com/legal/litigation/judge-rules-both-sides-lawsuit-misused-ai-disqualifies-lawyers-2026-06-09/Court Halts Trial Due to "Non-Existent Precedents" Written by AI—The Cost of Lawyers Not Reading Their Filings

An unusual incident emblematic of the generative AI era occurred in a U.S. courtroom. The issue wasn't the use of AI itself. The problem was that the content output by AI was submitted to the court without verification by human experts.

The case handled by the U.S. District Court for the Northern District of Mississippi was a contract dispute between attorney Tom Withers and the city of Aberdeen, Mississippi. Withers claimed there were unpaid legal fees owed by the city. Typically, briefs would be exchanged during the lawsuit, organizing factual and legal arguments before proceeding to trial. However, in this case, the court noticed a significant anomaly before reaching that stage.

The submitted documents contained case precedents that the court could not locate.

At first, it seemed like a simple citation error or inconsistency. However, the problematic citations were not isolated. Both the defendant's and plaintiff's documents contained unverified precedents. Upon investigation, the court found these were "hallucinated" citations—non-existent or unverifiable in the form submitted.

Hallucination refers to the phenomenon where generative AI produces plausible text or information that is not based on facts. This is particularly dangerous in the legal field because citations of precedents and statutes are not mere embellishments but the very foundation of arguments. Citing non-existent precedents is not like writing a recipe with imaginary ingredients. It wastes the time and trust of judges, opposing parties, clients, and the entire judicial system.

What was even more unusual about this case was that the AI-related problems were not limited to one side. Both the plaintiff and defendant had issues with AI-generated documents. It was as if arguments created by AI were being countered by other AI-generated arguments. This oddity led to sarcastic remarks on social media that clients were paying high legal fees to essentially witness an AI argument.

According to the sanctions order, the plaintiff's attorney, Kathleen Wilson, used generative AI to draft documents without verifying the legal basis included. The defendant's attorney, Kathryn Williams, used an AI legal research tool and incorporated its output into documents without independent verification. Furthermore, local attorneys on both sides signed the documents but failed to adequately review their content.

The court did not entirely dismiss the use of AI. Rather, it acknowledged that AI can be a useful tool when used appropriately. However, the court drew a clear line: the responsibility of the attorney signing the document cannot be transferred to AI, co-counsel, or software companies. While AI can generate text, it is the attorney who must ensure its truthfulness and take responsibility for it.

This decision carries a significant message common to professionals in the generative AI era. AI can serve as a convenient drafting assistant. It can be used for search entry points, issue organization, and draft creation. However, at the stage of final submission, presentation, billing, diagnosis, or judgment, human verification is indispensable. Especially in fields like law, where every word is directly linked to rights, obligations, money, and freedom, "because AI said so" is not a valid reason.

Judge Sharion Aycock canceled the scheduled trial and halted the legal proceedings. Additionally, she removed all four attorneys involved in the case. For the two attorneys directly involved in creating the problematic documents and legal research using AI, she banned them from appearing in the U.S. District Court for the Northern District of Mississippi for two years. Fines were also imposed: $2,500 for Wilson, $3,500 for Williams, and $1,000 each for the two local attorneys. Wilson was also ordered to take continuing legal education on AI use and ethics.

This sanction is not just about fines. The court also plans to send orders to the relevant bar associations. This means the issue could be treated as a matter of professional ethics, not just a failure within a single lawsuit.

Reactions on social media were a mix of anger, exasperation, and practical discussion.

In the legal community, there were notable reactions about "wasting the time and money of an already overloaded judicial system." Courts handle many cases, and when lawyers submit AI-generated documents without verification, judges are burdened with unnecessary verification work. This is not just about the lawyers themselves being embarrassed; it depletes judicial resources and delays other parties' trials.

There was also much sympathy for the clients' position. People hire lawyers because they lack legal expertise and rely on professionals. However, when those professionals submit AI outputs without reading them, resulting in halted trials and the need to change representatives, clients end up bearing the risk of "lack of professional oversight." Social media saw posts expressing sentiments like "I'd be furious if I paid legal fees for this."

On the other hand, some pointed out that interpreting this as "being punished for using AI" is a misunderstanding. In the tech community, headlines might suggest that AI usage itself was the issue, but the core problem was "citing non-existent precedents without verification." In fact, AI tools and search assistance tools for legal purposes exist, and when combined with proper verification, they can aid in improving work efficiency. The issue was not the use of tools, but the delegation of work to them.

This point is crucial. Simplifying the issue to "do not use AI" misses the essence of the problem. In the past, legal offices have introduced precedent databases, document templates, contract drafting software, and electronic filing systems. Many routine documents have long been created using some combination of software and templates. AI can be used as an extension of these tools. However, the difference between traditional tools and generative AI is its ability to create plausible lies in natural language.

 

There were questions on social media like "Can't we automatically check if the cited precedents actually exist?" Technically, certain automatic checks such as cross-referencing with precedent databases, verifying citation formats, and checking URLs or document IDs are possible. In fact, some researchers tracking AI hallucination precedents are developing reference check tools. However, the ultimate responsibility still lies with the submitter. Check tools are not foolproof and only serve to assist in the verification process.

There is another critical point in this case: AI errors are not just a "beginner's issue." Shortly after the advent of generative AI, mistakes by general users filing lawsuits on their own or inexperienced users were often highlighted. However, in this case, formally appearing attorneys were involved. And not just one side, but both. Even experts can fall into the same trap if busyness, complacency, overconfidence, and excessive expectations of tools converge.

AI hallucinations becoming an issue in courtrooms are no longer rare exceptions. Databases tracking AI-generated fictitious precedents and misquotations have recorded numerous related cases confirmed in courts worldwide. In the U.S. alone, many cases have accumulated, and the patience of the courts is clearly wearing thin.

In recent years, court responses have become stricter. What might have previously been resolved with fines or warnings now often involves more impactful sanctions such as bans on appearances, removal from cases, reporting to bar associations, and orders for educational courses. This is because there is a growing view that small fines alone do not serve as a deterrent. Social media also saw harsh opinions like "fines alone are not painful for those with financial resources" and "a deterrent example is needed."

However, there is room for debate about the severity of the sanctions. The attorneys in this case apologized to the court, and at least some acknowledged the cause of the errors. The two local attorneys did not directly use AI, but the issue was their failure to verify the documents of co-counsel. Nevertheless, the court determined that they were responsible since they signed the documents. This decision will likely affect future co-representation and the role of local counsel. "Just lending a name" or "not being the main responsible party" will be less acceptable in court.

The biggest question this case raises is what the "value of experts" is in the AI era.

If AI can write documents, what do lawyers do? If AI can find something resembling precedents, are human legal professionals unnecessary? This case suggests the opposite answer. The more plausible the information AI provides, the more advanced verification skills and a sense of responsibility are required of human experts. Because AI can draft, experts must discern, trim, cross-check, and discard it if necessary.

This is not limited to the legal industry. The same issue arises in any field where AI is integrated into operations, such as healthcare, finance, education, journalism, administration, advertising, and software development. Who verified what AI created? What sources were cross-referenced? Who takes responsibility if errors occur? Rushing AI implementation without this basic framework risks not efficiency but the collapse of trust.

If used incorrectly, generative AI becomes a "tool for mass-producing mistakes quickly" rather than a "time-saving tool." Moreover, because these mistakes are wrapped in natural language, they appear respectable on the surface. The attorneys in this case probably did not create fictitious precedents with malicious intent from scratch. However, the absence of malice is not an excuse. Documents submitted to the court come with a minimum responsibility for verification.

The trend of AI entering the courtroom will likely continue. AI can certainly be useful in legal research, document drafting, evidence organization, and contract review. However, the more AI is introduced, the more stringent professional ethics and verification procedures must be. What tools were used? Who verified the output? Do the cited sources exist? Does the precedent truly support the argument? Such mundane verification will become the core task of professionals in the AI era.

The court's decision in this case was not a rejection of AI but a clarification of responsibility in the AI era. Generative AI can create words. However, it cannot create responsibility. The responsibility lies with the human who ultimately chooses, signs, and submits those words.



Source URL

Gizmodo: Reports on the case overview, the point that both sides' attorneys did not verify AI-generated documents, and the judge's response.
https://gizmodo.com/judge-cancels-whole-case-after-lawyers-admit-they-didnt-read-ai-generated-filings-2000769668

404 Media: An early detailed report on the case. Confirms the court's sanctions order, Rob Freund's remarks on social media, and the context of the case being seen as an "AI argument" on social media.
https://www.404media.co/judge-learns-lawyers-on-both-sides-of-case-used-ai-cancels-trial-kicks-everyone-off-the-case/

U.S. District Court for the Northern District of Mississippi Sanctions Order PDF: Primary source detailing case number, parties involved, AI-related fictitious/unverifiable precedent citations, sanctions against four attorneys, fine amounts, and two-year appearance bans.
https://storage.courtlistener.com/recap/gov.uscourts.msnd.50181/gov.uscourts.msnd.50181.123.0.pdf

Reuters: Confirms case overview, names of sanctioned attorneys, fine amounts, two-year appearance bans, and notifications to bar associations.
https://www.reuters.com/legal/litigation/judge-rules-both-sides-lawsuit-misused-ai-disqualifies-lawyers-2026-06-09/

Reddit r/law: Confirms reactions in the legal community. References to wasted judicial resources, impact on clients, and criticism of lawyers for not verifying AI-generated content.
https://www.reddit.com/r/law/comments/1u16wbc/judge_learns_lawyers_on_both_sides_of_case_used/

Reddit r/technology: Confirms reactions in the tech community. Points out that the issue was not AI usage itself but the unverified citation of non-existent precedents, and discusses AI tools and human verification responsibility.
https://www.reddit.com/r/technology/comments/1u18o6n/judge_learns_lawyers_on_both_sides_of_case_used/

Damien Charlotin “AI Hallucination Cases” database: Used to confirm the spread of AI hallucination cases in court submissions, record numbers in various countries and the U.S., and the background of the AI hallucination precedent issue.
https://www.damiencharlotin.com/hallucinations/