{"id":8696,"date":"2025-11-24T17:21:27","date_gmt":"2025-11-24T17:21:27","guid":{"rendered":"https:\/\/usatrustedlawyers.com\/blog\/how-to-scale-defensible-generative-ai-results-for-document-review-law-com\/"},"modified":"2025-11-24T17:21:27","modified_gmt":"2025-11-24T17:21:27","slug":"how-to-scale-defensible-generative-ai-results-for-document-review-law-com","status":"publish","type":"post","link":"https:\/\/usatrustedlawyers.com\/blog\/how-to-scale-defensible-generative-ai-results-for-document-review-law-com\/","title":{"rendered":"How to Scale Defensible Generative AI Results for Document Review| Law.com"},"content":{"rendered":"\n<div>\n<p>The use of <a href=\"https:\/\/relativity.com\/data-solutions\/air\/?utm_medium=referral&amp;utm_source=alm&amp;utm_campaign=scale-defensible-ai-alm&amp;utm_content=article\" rel=\"nofollow noopener\" target=\"_blank\">generative AI in document review<\/a> provokes two familiar questions, echoing the early debates around technology-assisted review (TAR):<\/p>\n<ol class=\"rte2-style-ol\" id=\"rte-5af803f0-c952-11f0-ae32-f941f5c9108e\" start=\"1\">\n<li>Is it accurate?<\/li>\n<li>Is it defensible?<\/li>\n<\/ol>\n<p>TAR earned its judicial acceptance through transparent validation metrics, and many of those same principles apply to generative AI. Accuracy can be measured using established metrics:<\/p>\n<ul class=\"rte2-style-ul\" id=\"rte-5af803f1-c952-11f0-ae32-f941f5c9108e\">\n<li><b>Recall<\/b>: the percentage of relevant documents correctly identified<\/li>\n<li><b>Precision<\/b>: the percentage of AI-predicted relevant documents that are truly relevant<\/li>\n<li><b>Elusion<\/b>: the percentage of relevant documents incorrectly tagged as irrelevant<\/li>\n<li><b>Richness<\/b>: the share of all documents that are relevant, which influences sample size and margin of error<\/li>\n<\/ul>\n<p>These metrics provide a quantitative foundation for assessing an AI model\u2019s reliability. What\u2019s new with generative AI is <i>when<\/i> validation occurs. Instead of validating after a full review, legal teams can now test and refine prompts on smaller datasets upfront\u2014measuring recall, precision, and elusion before scaling to the full document set.<br \/>By validating early, teams can optimize prompt design, build defensibility into their processes, and set realistic expectations for AI-assisted review. As Ben Sexton, SVP of Innovation &amp; Strategy at JND eDiscovery, explains:<br \/>\u201cBeing able to assess recall and precision before committing to a full review run is a major advantage. If results meet expectations, we can proceed with confidence; if not, we can iterate and re-validate without costly rework.\u201d<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The use of generative AI in document review provokes two familiar questions, echoing the early debates around technology-assisted review (TAR): Is it accurate? Is it defensible? TAR earned [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":8697,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[7063,3464,154,6724,319,2266,3754],"class_list":["post-8696","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lawyers","tag-defensible","tag-document","tag-generative","tag-law-com","tag-results","tag-review","tag-scale"],"_links":{"self":[{"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/posts\/8696","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/comments?post=8696"}],"version-history":[{"count":0,"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/posts\/8696\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/media\/8697"}],"wp:attachment":[{"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/media?parent=8696"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/categories?post=8696"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/usatrustedlawyers.com\/blog\/wp-json\/wp\/v2\/tags?post=8696"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}