GenAI, fake law and fallout—new report reveals surge in legal cases involving generative AI

November 14, 2025

The GIST GenAI, fake law and fallout—new report reveals surge in legal cases involving generative AI

Sadie Harley

scientific editor

Andrew Zinin

lead editor

Editors' notes

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

fact-checked

trusted source

proofread

The Center for the Future of the Legal Profession (CFLP) at UNSW Law & Justice has released a new report on the impacts of generative artificial intelligence (GenAI) in law: "GenAI, Fake Law & Fallout: A review of the misuse of generative artificial intelligence in legal proceedings."

Drawing from a review of legal cases reported between January 2023 and September 2025, the report identifies over 520 cases where GenAI misuse was suspected or confirmed.

From curiosity to concern

What began as a trickle of GenAI cases has become a steady stream, led by cases in U.S. courts, followed by Australia. CFLP's GenAI cases dataset was compiled from official court records and legal databases, spanning ten jurisdictions: Australia, Canada, Hong Kong, India, Ireland, New Zealand, Singapore, South Africa, the UK, and the U.S.

Visualizations in the report highlight key trends, including the predominance of GenAI cases involving self-represented litigants and the clustering of cases in commissions, tribunals, and lower courts, where self-representation is common. Other recurring themes or risk patterns related to GenAI misuse include:

• Fake and incorrect case citations and summaries.
• Flawed legal reasoning.
• Incorrect documentation.
• Prolix documentation and "flooding."

Extracts from recent Australian GenAI cases involving legal professionals and self-represented litigants illustrate what can go wrong when GenAI is misused, a range of court responses, and key takeaways.

Best practice guidance

The report offers practical tips for legal professionals and self-represented litigants seeking to use GenAI responsibly and safely when preparing for court. GenAI can enhance legal services, but realizing this potential depends on understanding its limits and risks, and implementing appropriate safeguards.

Professor Michael Legg, Director of CFLP, said, "GenAI offers real opportunities to improve legal services, but it also introduces risks that courts, lawyers, and policymakers must understand and manage. CFLP's research aims to help the legal profession strike the right balance."

Key data points from CFLP's GenAI cases dataset

• Period of case law review: 1 January 2023 to 30 September 2025.
• Jurisdictions reviewed: 10—Australia, Canada, Hong Kong, India, Ireland, New Zealand, Singapore, South Africa, UK, U.S.
• Total GenAI cases in the dataset: 520.
• Australian GenAI cases in the dataset: 87.
• Australian cases by user type: Legal professionals—10; Self-represented litigants (SRLs)—68; Other—9 (=78% SRLs).
• Australian courts/tribunals/commissions represented: 23.

More information: GenAI, Fake Law & Fallout. d35nv8m6ay1zkp.cloudfront.net/ … 038506&s=2&k=1989774

Provided by University of New South Wales Citation: GenAI, fake law and fallout—new report reveals surge in legal cases involving generative AI (2025, November 14) retrieved 14 November 2025 from https://techxplore.com/news/2025-11-genai-fake-law-fallout-reveals.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Justice at stake as generative AI enters the courtroom