Building GenAI Benchmarks: A Case Study in Legal Applications

Abstract

AI has a long history, but only recently has Generative AI risen to prominence as a form that makes notable progress on some of the long-standing goals of the field. Whereas classic machine learning models typically predict a category label or a number, a Generative AI model may produce an entire text, a photorealistic picture, or other complex outputs. This chapter provides a brief introduction to the techniques that enable this, starting from basic ideas such as learning from training data and building foundation models. The chapter explains how large language models operate internally, introducing the transformer neural network architecture. It also provides a high-level explanation of common generative models for images and further kinds of data. Finally, it concludes with a discussion of agentic AI and possible future developments.

Details

Author(s):
Publish Date:
2025
Publication Title:
Building GenAI Benchmarks: A Case Study in Legal Applications
Editor(s):
  • Philipp Hacker,
  • Sarah Hammer,
  • Andreas Engel
Format:
Book, Section
Citation(s):
  • Neel Guha, Julian Nyarko, Daniel E. Ho & Chris RĂ©, Building GenAI Benchmarks: A Case Study in Legal Applications, in Oxford Handbook of the Foundations and Regulation of Generative AI 117 (Philipp Hacker, Andreas Engel, Sarah Hammer & Brent Mittelstadt eds., 2025), https://doi.org/10.1093/oxfordhb/9780198940272.013.0007.

Related Organization(s):

Other Publications By