Fifth Circuit: AI Hallucinations Mar Mississippi DEI Law Ruling

• The Fifth Circuit overturned a preliminary injunction against a Mississippi DEI law, citing errors from AI hallucinations in the lower court's rulings.
• US District Judge Henry Wingate's orders contained factual inaccuracies, including non-existent case citations and misidentified parties, which he attributed to a law clerk using AI for drafting.
• The appeals panel criticized Judge Wingate for failing to properly apply the Moody v. NetChoice standard for First Amendment facial challenges.
• The case has been remanded to a different judge due to the lower court's "impoverished legal analysis" and manipulation of legal texts.
• Despite the injunction's reversal, plaintiffs found a partial victory in the Fifth Circuit's clarification that the Mississippi law does not ban classroom discussions on race or sex.

Lawyers and compliance officers must exercise extreme caution when using AI for legal drafting or research, as this case demonstrates the severe risks of 'hallucinations' leading to factual errors and non-existent citations, which can result in overturned rulings and judicial rebuke.

The Fifth Circuit Court of Appeals recently delivered a sharp rebuke to a lower court's handling of a challenge to a Mississippi law prohibiting diversity, equity, and inclusion (DEI) initiatives in public educational institutions. An appeals panel reversed a preliminary injunction that had temporarily blocked the enforcement of this state statute, pointing to significant errors in the district court's rulings. These errors, the panel indicated, appeared to stem from the use of artificial intelligence, leading to what are commonly termed "AI hallucinations" in legal documents.

In a strongly worded opinion, US Circuit Judge Jerry Smith, a Ronald Reagan appointee, criticized US District Judge Henry Wingate, also a Reagan appointee, for his decisions. Judge Wingate had concluded that a coalition of teachers, students, and parents were likely to succeed in their arguments that the Mississippi DEI law violated the First Amendment and was unconstitutionally vague. The appellate panel found Judge Wingate's analysis to be "impoverished," suggesting it barely acknowledged Supreme Court or Fifth Circuit precedents and at times seemed to deliberately misinterpret legal texts. Consequently, the case has been ordered to be reassigned to a different judge upon its return to the district court.

A central point of contention for the Fifth Circuit panel was the presence of numerous factual inaccuracies within the temporary restraining order (TRO) issued by the district court. These included the erroneous identification of plaintiffs and defendants who were not involved in the case, the quotation of terms not found within the actual Mississippi DEI law, and the citation of evidence that was absent from the official record. These specific errors were highlighted as characteristic of "AI hallucinations," where generative AI produces plausible but entirely fabricated information.

When questioned by US Senator Chuck Grassley, Judge Wingate acknowledged that artificial intelligence had been utilized in drafting the TRO. He explained that a law clerk had employed AI to generate a draft, which was then mistakenly docketed. Although Judge Wingate subsequently issued a corrected version of the order, the appellate panel observed that this revised document still contained a reference to a non-existent legal case, indicating another instance of an AI hallucination. The judges further determined that this problematic reliance on AI-generated inaccuracies extended to a later preliminary injunction issued by Judge Wingate, as that injunction explicitly incorporated the discussion and analysis from the flawed TRO.

Beyond the issues of AI-induced errors, the Fifth Circuit also faulted US District Judge Henry Wingate for his improper application of established legal standards concerning First Amendment facial challenges. The panel underscored the precedent set by the US Supreme Court in Moody v. NetChoice, which mandates that a law should only be struck down if its unconstitutional applications demonstrably and significantly outweigh any constitutional ones. This rigorous standard requires a careful balancing act, rather than a broad dismissal based on potential harms.

Instead of adhering to this critical analysis, the appellate panel found that Judge Wingate had stretched the interpretation of the Mississippi DEI law's text and unduly credited the plaintiffs' concerns about hypothetical future applications of the statute. US Circuit Judge Jerry Smith, in his opinion, pointedly remarked that the district court — or perhaps, charitably, its "AI agent" — appeared to have disregarded and manipulated governing law, seemingly to advance a "policy agenda." US Circuit Judge Kurt Engelhardt joined Judge Smith's opinion, while US Circuit Judge Catharina Haynes concurred with the ultimate decision to overturn the injunction but did not endorse the majority of the opinion's reasoning.

This ruling from the Fifth Circuit carries significant implications for the legal community, particularly regarding the increasing integration of artificial intelligence into legal practice. The explicit condemnation of "AI hallucinations" leading to judicial errors serves as a potent reminder of the inherent risks associated with relying on AI for legal drafting or research without stringent human oversight and verification. Lawyers and compliance officers must exercise extreme caution when using AI for legal drafting or research, as this case demonstrates the severe risks of 'hallucinations' leading to factual errors and non-existent citations, which can result in overturned rulings and judicial rebuke.

Despite the reversal of the preliminary injunction, the plaintiffs' representatives, including the Mississippi Center For Justice and the ACLU of Mississippi, characterized the outcome as a partial victory. This perspective stems from the appellate panel's clarification that the Mississippi DEI law does not prohibit classroom discussions on topics such as race or sex. The Mississippi Center For Justice had initially voiced concerns that school districts might interpret the law as restricting these vital classroom conversations. The Fifth Circuit's interpretation directly addresses this major concern, affirming that such important discussions can indeed continue within educational settings, thereby providing a measure of clarity and reassurance to educators and students alike.

Lawyers and compliance officers must exercise extreme caution when using AI for legal drafting or research, as this case demonstrates the severe risks of 'hallucinations' leading to factual errors and non-existent citations, which can result in overturned rulings and judicial rebuke. Additionally, this ruling reinforces the rigorous standard for First Amendment facial challenges as established in Moody v. NetChoice, requiring proof that unconstitutional applications significantly outweigh constitutional ones.

Source: Original reporting via a legal news outlet