Meta’s Llama 3.1 can recall 42 percent of the first Harry Potter book

Details

Publish Date:
June 12, 2025
Author(s):
Source:
Understanding AI
Related Person(s):
Related Organization(s):

Summary

The results surprised the study’s authors, including Mark Lemley, a law professor at Stanford.

“We’d expected to see some kind of low level of replicability on the order of one or two percent,” Lemley told me. “The first thing that surprised me is how much variation there is.”

Read More