Meta’s Llama 3.1 can recall 42 percent of the first Harry Potter book
Summary
The results surprised the study’s authors, including Mark Lemley, a law professor at Stanford.
“We’d expected to see some kind of low level of replicability on the order of one or two percent,” Lemley told me. “The first thing that surprised me is how much variation there is.”
Read More