The Truth About Hallucinations in Legal Research AI: How to Avoid Them and Trust Your Sources

Hallucinations are outputs from LLMs and generative AI that look coherent but are wrong or absurd. They may come from errors or gaps in the training data “garbage in, garbage out”.

But just as importantly, hallucinations may arise from the nature of the task we are giving to the model. The objective during text generation is to produce human-like, coherent and contextually relevant responses, but the model does not check responses for truth. And simply asking the model if its responses are accurate is not sufficient.

In the coming months, as legal research generative AI products become increasingly available, librarians will need to adapt to develop methods for assessing accuracy. Currently, there appear to be no benchmarks to compare hallucinations across platforms. Knowing librarians, that won’t be the case for long, at least concerning legal research.

Source: AI Law Librarians


Posted

in

,

by

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *
https://largelanguagelaw.com/the-truth-about-hallucinations-in-legal-research-ai-how-to-avoid-them-and-trust-your-sources/
largelanguagelaw.com
CC-MAIN-2024-26
70706
application/http; msgtype=response
sha1:O3ZBSUEIQ4BYQHDFE66ZYVNMNXFHQHEM
<urn:uuid:1b735fb3-a012-49f1-a4a6-d022043e1309>
2024-06-12T17:48:40Z
13.54.88.239
text/html
sha1:7DLPQSHY3MQJBHEQZ74OXYYJZDMY6KHE
<urn:uuid:b2707504-aaef-4534-acda-8a5458e578b8>
https://largelanguagelaw.com/the-truth-about-hallucinations-in-legal-research-ai-how-to-avoid-them-and-trust-your-sources/
response
<urn:uuid:e0237192-4e71-4721-b722-bd6385ff5197>
isPartOf: CC-MAIN-2024-26
publisher: Common Crawl
description: Wide crawl of the web for June 2024
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-181
software: Apache Nutch 1.20 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.5-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/