Project B03

Modeling the control of eye-movements and sentence processing

PI(s): Prof. Dr. Ralf Engbert, Dr. Maximilian Michael Rabe & Prof. Dr. Shravan Vasishth

Project B03 investigates how syntactic processing and eye movement control in reading are linked. First, using cognitive modeling, our work will be based on a simplified version of the SEAM model (the first-ever computational model of eye-movement control during reading that integrates visual, attentional, lexical, and motor processes with post-lexical language processes via linguistic dependency completion). Second, in eye-tracking experiments, we will test the model against new benchmark data. Our model will incorporate the effects of surprisal as a new component and address individual differences through Bayesian hierarchical inference.

in Phase 2

Modelling the connection between eye-movement control, sentence processing, and brain signals

PI(s): Prof. Dr. Shravan Vasishth & Prof. Dr. Ralf Engbert & Prof. Dr. Milena Rabovsky-Schad

This project extends our previous mathematical modelling of the integration of eye-movement control and syntactic processing to include electrophysiological indicators during reading. We work with a process-oriented model in which prediction of behaviour is implemented at the level of individual subjects. As a long-term goal, we plan to also include neural processes in the model via electrophysiological markers to obtain a well-founded theoretical explanation of the dynamics of natural reading comprehension and its connection with individually variable eye movements and event-related potentials.

in Phase 1

Modelling the interaction between eye-movement control and parsing processes

PI(s): Prof. Dr. Ralf Engbert & Prof. Dr. Shravan Vasishth

This project aims to develop mathematical/computational models to investigate how eye movements and natural language parsing processes influence and interact with each other. Based on novel experimental designs and an integrated modeling approach, we will seek to explain how the dynamical interaction of subprocesses (vision, attention, parsing, sensorimotor control) generates the observed variability in language processing between and within participants under varying task demands.

Members

Papers

Author(s)TitleYearPublished inLinks
Chandra, J., Krügel, A., & Engbert, R.Experimental test of Bayesian saccade targeting under reversed reading direction.2020Attention, Perception, & Psychophysics, 82(3), 1230-1240.
Seelig, S. A., Rabe, M. M., Malem-Shinitski, N., Risse, S., Reich, S., & Engbert, R.Bayesian parameter estimation for the SWIFT model of eye-movement control during reading.2020Journal of Mathematical Psychology, 95, 102313.
Rabe, M. M., Chandra, J., Krügel, A., Seelig, S. A., Vasishth, S., & Engbert, R.A Bayesian Approach to dynamical modeling of eye-movement control in reading normal, mirrored, and scrambled texts.2021Psychological Review, 128(5), 803–823.
Paape, D., Vasishth, S., & Engbert, R.Does Local Coherence Lead to Targeted Regressions and Illusions of Grammaticality?2021Open Mind (2022) 5: 42–58.
Engbert, R., Rabe, M. M., Schwetlick, L., Seelig, S. A., Reich, S., & Vasishth, S.Data assimilation in dynamical cognitive science.2022Trends in Cognitive Sciences, 26(2), 99-102.
Mertzen, D.A cross-linguistic investigation of similarity-based interference in sentence comprehension.2022PhD Thesis. Potsdam: Universitätsverlag Potsdam.
Yadav, H., Smith, G., Reich, S., & Vasishth, S.Number feature distortion modulates cue-based retrieval in reading.2023Journal of Memory and Language, 129, 104400.
Mertzen, D., Paape, D., Dillon, B. W., Engbert, R., & Vasishth, S.Syntactic and semantic interference in sentence comprehension: Support from English and German eye-tracking data.2023Glossa: Psycholinguistics, 2(1), 8, 1-48.
Rabe, M. M., Paape, D., Mertzen, D., Vasishth, S., & Engbert, R. SEAM: An integrated activation-coupled model of sentence processing and eye movements in reading.2024Journal of Memory and Language, 135, 104496
Mertzen, D., Laurinavichyute, A., Dillon, B. W., Engbert, R., & Vasishth, S.Crosslinguistic evidence against interference from extra-sentential distractors2024Journal of Memory and Language, 137, 104514.
Engbert, R., & Rabe, M. M.A tutorial on Bayesian inference for dynamical modeling of eye-movement control during reading.2024Journal of Mathematical Psychology, 119, 102843.
Rabe, M. M.Modeling the interaction of sentence processing and eye-movement control in reading.2024PhD Thesis. Potsdam: Universitätsverlag Potsdam.
Schoknecht, P., Yadav, H., & Vasishth, S.Do syntactic and semantic similarity lead to interference effects? Evidence from self-paced reading and event-related potentials using German.2025Journal of Memory and Language, 141, 104599.
Contier, F., Höger, M., & Rabovsky, M.The P600 during sentence reading predicts behavioraland neural markers of recognition memory2025Journal of Cognitive Neuroscience, 1-20
Hao, H., Fuchs, Z., & Vasishth, S.Similarity-based interference in the processing of classifier-noun dependencies in Mandarin Chinese.2025Journal of Memory and Language, 144, 104669.

Talks

Author(s)TitleYearPublished inLinks
Mertzen, D., Dillon, B. W., Laurinavichyute, A., & Vasishth, S.A cross-linguistic investigation of similarity-based interference and depth of processing in English and German.2019Poster presented at the Architectures and Mechanisms of Language Processing (AMLaP 2019), Moscow, Russia. 06 - 08 September.
Rabe, M. M.Eye-movement control during reading: Bayesian parameter inference of the dynamical SWIFT model.2019Invited talk at the University of Victoria, Victoria, BC, Canada. 01 November.
Rabe, M. M., Chandra, J., Krügel, A., Seelig, S. A., & Engbert, R.Bayesian inference of dynamical cognitive and oculomotor processes in the SWIFT model of reading.2019Poster presented at the 60th Annual Meeting of the Psychonomic Society, Montréal, QC, Canada. 14 - 17 November.
Rabe, M. M., Chandra, J., Krügel, A., Seelig, S. A., & Engbert, R.Bayesian inference of the SWIFT model: Reading mirrored, scrambled, and normal texts.2019Poster presented at the 20th European Conference on Eye Movements (ECEM 20), Alicante, Spain. 18 - 22 August.
Seelig, S. A., Rabe, M. M., Malem-Shinitski, N., Reich, S., & Engbert, R. Bayesian parameter estimation for the SWIFT model of eye-movement control during reading.2019Poster presented at the Conference on Cognitive Computational Neuroscience (CCN) 2019, Technical University of Berlin, Berlin, Germany. 13 - 16 September.
Mertzen, D., Laurinavichyute, A., Dillon, B. W., & Vasishth, S. A pre-registered large-sample investigation of similarity-based interference in English, German and Russian.2020Paper presented at the 33rd Annual CUNY Human Sentence Processing Conference University of Massachusetts, Amherst, MA, USA. 19 - 21 March.
Arkhipova, Y.N400 as an index of semantic feature preactivation.2023Paper presented at the Language And Cognition Group Meeting., University of Leiden. Leiden, The Netherlands. 12 January.
Schoknecht, P., & Vasishth, S.Event-related potentials elicited by similarity-based interference during subject-verb dependency resolution.2023Lightning talk and poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France. 24-26 October.
Schoknecht, P., & Vasishth, S.Event-related potentials elicited by similarity-based interference during subject-verb dependency resolution.2023Poster presented at the 29th Architectures and Mechanisms for Language Processing Conference (AMLaP 2023), San Sebastian, Spain. 31 August-02 September.
Schoknecht, P., & Vasishth, S.The time course of local coherence in German: Evidence from event-related potentials.2024Poster presented at the 30th Architectures and Mechanisms for Language Processing Conference (AMLaP 2024), Edinburgh, UK. 05-07 September.
Schoknecht, P., & Vasishth, S.Do syntactic and semantic similarity lead to interference effects?2024Paper presented at the Linguistic Evidence 2024, University of Potsdam, Potsdam, Germany. 22-23 February.
Contact
University of Potsdam
Department Linguistics
Prof. Dr. Doreen Georgi
Karl-Liebknecht-Strasse 24-25
House 14, Room 3.33
14476 Potsdam

(+49) 331 977-2968
doreen.georgi@uni-potsdam.de
Directions