Ari HOLTZMAN- 20 novembre 2025 à 10h30 au PK-5115 (201, ave President-Kennedy, 5e étage)
TITRE: Articulating the Ineffable: The Analytic Turn in Generative AI
RÉSUMÉ
Generative AI has taken an analytic turn: we now cultivate models from objectives and data, then try to understand what we’ve grown. Current approaches to studying LLMs—focused on engineering progress or mechanistic explanations at the implementation level-—are insufficient for grasping their emergent behaviors. I will discuss what it means for interpretability approaches to be predictive rather than mechanistic, the changing landscape of machine communication, and efforts to identify fundamental laws that govern LLM behavior. I will argue that developing precise behavioral vocabulary and conceptual frameworks is the only way to turn the ‘fieldwork’ of finding surface regularities in LLMs into a science of LLMs. The guiding questions are basic, empirical, and exploratory: what do models consistently do, what do they reliably miss, and how do they incorporate and store new information? Along the way we’ll discover that AI has been given a new mandate—to articulate the ineffable, by describing aspects of communication and computation that we previously had no words for because they were stuck to deep inside human cognition to be easily referenced.
BIOGRAPHIE
Ari HOLTZMAN is Assistant Professor of Computer Science and Data Science at the University of Chicago, where he directs the Conceptualization Lab. His research is on developing new conceptual frameworks for understanding generative models, treating them as complex systems rather than traditional engineering artifacts. He introduced nucleus sampling, a text generation algorithm used in deployed systems including the OpenAI API.
RÉFÉRENCES
Holtzman, A., et al. (2023). Generative Models as a Complex Systems Science. arXiv:2308.00189.