{"id":1082,"date":"2024-05-30T22:46:03","date_gmt":"2024-05-30T22:46:03","guid":{"rendered":"https:\/\/usatrustedlawyers.com\/blog\/circuit-judge-proposes-using-ai-powered-llms-to-interpret-legal-texts-justia-news-may-30-2024\/"},"modified":"2024-06-02T17:21:33","modified_gmt":"2024-06-02T17:21:33","slug":"circuit-judge-proposes-using-ai-powered-llms-to-interpret-legal-texts-justia-news-may-30-2024","status":"publish","type":"post","link":"https:\/\/usatrustedlawyers.com\/blog\/circuit-judge-proposes-using-ai-powered-llms-to-interpret-legal-texts-justia-news-may-30-2024\/","title":{"rendered":"Circuit Judge Proposes Using AI-Powered LLMs to Interpret Legal Texts \u2014 Justia News \u2014 May 30, 2024"},"content":{"rendered":"\n
\n

U.S. Circuit Judge Kevin Newsom issued a concurring opinion on Tuesday with a \u201cmodest proposal\u201d to use AI-powered large language models (LLMs) such as OpenAI\u2019s ChatGPT and Google\u2019s Gemini to help analyze and interpret the ordinary meaning of words and phrases in legal texts.<\/span><\/p>\n

The underlying case involved a dispute between a landscaper and his insurance company over whether his installation of an in-ground trampoline fell under the term \u201clandscaping\u201d in his insurance policy. The district court noted that because the term \u201clandscaping\u201d was not defined in the policy, whether or not the landscaper\u2019s activities were covered by the insurance policy hinged on whether the installation of the trampoline fell within the common, everyday meaning of the word \u201clandscaping.\u201d After a review of assorted dictionary definitions, the court determined that the work was not \u201clandscaping.\u201d However, the parties continued to debate the plain meaning of the word on appeal.<\/span><\/p>\n

Though the appellate court resolved the appeal without determining the ordinary meaning of the term, Judge Newsom took the opportunity to express his thoughts about artificial intelligence\u2019s possible role in future disputes after \u201chours and hours (and hours) laboring over the question [of the ordinary meaning of \u2018landscaping\u2019 in the context].\u201d<\/span><\/p>\n

Judge Newsom recounted that querying ChatGPT about the ordinary meaning of \u201clandscaping\u201d resulted in an explanation that \u201csquared with [his] own impression.\u201d The ChatGPT result defined \u201clandscaping\u201d in part as \u201cthe process of altering the visible features of an area of land, typically a yard, garden or outdoor space, for aesthetic or practical purposes.\u201d ChatGPT\u2019s definition also listed a few activities that could be considered \u201clandscaping,\u201d including planting trees and installing paths and water features. Newsom noted that dictionary definitions of the term took a more varied approach, some only referencing modification of \u201cplant cover,\u201d and some confining the activity to an aesthetic rather than practical pursuit.<\/span><\/p>\n

Judge Newsom and his clerk went on to ask ChatGPT whether installing an in-ground trampoline was \u201clandscaping,\u201d and got an affirmative answer. Google\u2019s Bard (now Gemini) gave a similar result.<\/span><\/p>\n

In evaluating the pros and cons of using LLMs to interpret legal texts, Judge Newsom found one of the strongest pros to be that LLMs are trained on a vast range of ordinary-language data, \u201cfrom Hemmingway [sic] novels and Ph.D. dissertations to gossip rags and comment threads.\u201d However, he noted as one of the cons that LLMs cannot capture \u201cpure offline\u201d usages, meaning usages that do not occur online or are not eventually digitized online.<\/span><\/p>\n

Other pros he listed were that LLMs can understand context, LLMs are accessible, LLM research is relatively transparent, and LLMs have advantages over other empirical interpretive methods, like dictionary research. Other cons listed were that LLMs can \u201challucinate\u201d (meaning they sometimes make things up), that lawyers, judges, and would-be litigants may try and manipulate them, and that \u201creliance on LLMs will lead us into dystopia.\u201d<\/span><\/p>\n

Finally, Judge Newsom offered some suggestions for the use of LLMs when determining ordinary meanings of words and phrases, including an emphasis on more data \u201crepresenting a more representative cross-section of Americans,\u201d determining the proper question, giving thought to and documenting multiple prompts and responses, as well as using different models, specifying the desired output, and taking timeframes of usage into account.<\/span><\/p>\n

Additional Reading<\/b><\/p>\n

US judge makes \u2018unthinkable\u2019 pitch to use AI to interpret legal texts<\/span><\/a>, <\/span>Reuters<\/span><\/i> (May 29, 2024)<\/span><\/p>\n

Snell v. United Specialty Ins. Co. May 28 Opinion, Newsom Concurrence<\/p>\n

Image Credit: <\/b>Tada Images \/ Shutterstock.com<\/span><\/p>\n<\/div>\n