Project D01

Probing the limits of prompt variability in Large Language Models

PI(s): Prof. Dr. David Schlangen

This project investigates prompt (in)stability in Large Language Models. While this is typically treated as a technical problem, it is treated here as a means for exploring the limits of linguistic variability captured by these systems. By defining a range of controlled prompt manipulations and evaluating the induced functions on standard datasets, the project aims to elucidate the way these models go from analysis and interpretation of prompts to instruction following – and the extent to which it concurs with linguistic predictions.

Members

Talks

Author(s)TitleYearPublished inLinks
Schlangen, D.“Wer spricht da?” Zur Pragmatik von Mensch/Chatbot-Interaktionen.2026Keynote talk at the Jahrestagung Linguistische Pragmatik (ALP): Pragmatik & Künstliche Intelligenz: Pragmatische Kompetenz zwischen Mensch und Maschine, University of Trier, Trier, Germany. 24 February.
Contact
University of Potsdam
Department Linguistics
Prof. Dr. Doreen Georgi
Karl-Liebknecht-Strasse 24-25
House 14, Room 3.33
14476 Potsdam

(+49) 331 977-2968
doreen.georgi@uni-potsdam.de
Directions