B03
Modelling the connection between eye-movement control, sentence processing, and brain signals
PI(s): Prof. Dr. Shravan Vasishth & Prof. Dr. Ralf Engbert & Prof. Dr. Milena Rabovsky
This project extends our previous mathematical modelling of the integration of eye-movement control and syntactic processing to include electrophysiological indicators during reading. We work with a process-oriented model in which prediction of behaviour is implemented at the level of individual subjects. As a long-term goal, we plan to also include neural processes in the model via electrophysiological markers to obtain a well-founded theoretical explanation of the dynamics of natural reading comprehension and its connection with individually variable eye movements and event-related potentials.
in phase 1:
Modelling the interaction between eye-movement control and parsing processes
PI(s): Prof. Dr. Ralf Engbert & Prof. Dr. Shravan Vasishth
This project aims to develop mathematical/computational models to investigate how eye movements and natural language parsing processes influence and interact with each other. Based on novel experimental designs and an integrated modeling approach, we will seek to explain how the dynamical interaction of subprocesses (vision, attention, parsing, sensorimotor control) generates the observed variability in language processing between and within participants under varying task demands.
Members
Prof. Dr. Ralf EngbertUniversität PotsdamCampus GolmHaus 14, Raum 4.03
(+49) 331 977-2140 ralf.engbert@uni-potsdam.de
Prof. Dr. Milena Rabovsky-SchadUniversität PotsdamCampus GolmHaus 14, Raum 4.37
(+49) 331 977-2703 milena.rabovsky@uni-potsdam.de
Prof. Dr. Shravan VasishthUniversität PotsdamCampus GolmHaus 14, Raum 2.34
(+49) 331 977-2457 shravan.vasishth@uni-potsdam.de
Publications
Types of Publications
- Peer-Reviewed: Papers, Journals, Books, Articles of the CRC
- Talk or Presentation: Talks, Presentations, Posters of the CRC
- SFB-Related: not produced in connection with the CRC, but are thematically appropriate
- Other: Papers, Journals, Books, Articles of the CRC, but not peer-reviewed
| Author(s) | Title | Year | Published in | Type | Links |
|---|---|---|---|---|---|
| Vasishth, S., Nicenboim, B., Engelmann, F., & Burchert, F. | Computational models of retrieval processes in sentence processing. | 2019 | Trends in Cognitive Sciences, 23(11), 968–982. DOI: 10.1016/j.tics.2019.09.003 | Peer-Reviewed | |
| Chandra, J., Krügel, A., & Engbert, R. | Experimental test of Bayesian saccade targeting under reversed reading direction. | 2019 | Attention, Perception, & Psychophysics, 82, 1230-1240. DOI: 10.3758/s13414-019-01814-4 | Peer-Reviewed | |
| Rabe, M. M., Chandra, J., Krügel, A., Seelig, S. A., Vasishth, S., & Engbert, R. | A Bayesian Approach to dynamical modeling of eye-movement control in reading normal, mirrored, and scrambled texts. | 2021 | Psychological Review, 128(5), 803–823. DOI: 10.1037/rev0000268 | Peer-Reviewed | |
| Seelig, S. A., Rabe, M. M., Malem-Shinitski, N., Risse, S., Reich, S., & Engbert, R. | Bayesian parameter estimation for the SWIFT model of eye-movement control during reading. | 2020 | Journal of Mathematical Psychology, 95, 102313. DOI: 10.1016/j.jmp.2019.102313 | Peer-Reviewed | |
| Rabe, M. M., Vasishth, S., Hohenstein, S., Kliegl, R., & Schad, D. J. | hypr: An R package for hypothesis-driven contrast coding. | 2020 | The Journal of Open Source Software, 5(48), 2134. DOI: 10.21105/joss.02134 | Peer-Reviewed | |
| Engelmann, F., Jäger, L. A., & Vasishth, S. | The effect of prominence and cue association in retrieval processes: A computational account. | 2019 | Cognitive Science, 43, e12800. DOI: 10.1111/cogs.12800 | Peer-Reviewed | |
| Vasishth, S., Mertzen, D., Jäger, L.A., & Gelman, A. | The statistical significance filter leads to overoptimistic expectations of replicability. | 2018 | Journal of Memory and Language, 103, 151-175. DOI: 10.1016/j.jml.2018.07.004 | Peer-Reviewed | |
| Jäger, L. A., Mertzen, D., Van Dyke, J. A., & Vasishth, S. | Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study. | 2020 | Journal of Memory and Language, 111, 104063. DOI: 10.1016/j.jml.2019.104063 | Peer-Reviewed | |
| Vasishth, S. | Using Approximate Bayesian Computation for estimating parameters in the cue-based retrieval model of sentence processing. | 2020 | MethodsX, 7, 100850. DOI: 10.1016/j.mex.2020.100850 | Peer-Reviewed | |
| Mertzen, D., Dillon, B. W., Laurinavichyute, A., & Vasishth, S. | A cross-linguistic investigation of similarity-based interference and depth of processing in English and German. | 2019 | Poster presented at the Architectures and Mechanisms of Language Processing (AMLaP 2019), Moscow, Russia. 06 - 08 September. | Talk or Presentation | |
| Mertzen, D., Laurinavichyute, A., Dillon, B. W., & Vasishth, S. | A pre-registered large-sample investigation of similarity-based interference in English, German and Russian. | 2020 | Paper presented at the 33rd Annual CUNY Human Sentence Processing Conference University of Massachusetts, Amherst, MA, USA. 19 - 21 March. | Talk or Presentation | |
| Rabe, M. M. | Eye-movement control during reading: Bayesian parameter inference of the dynamical SWIFT model. | 2019 | Invited talk at the University of Victoria, Victoria, BC, Canada. 01 November. | Talk or Presentation | |
| Rabe, M. M., Chandra, J., Krügel, A., Seelig, S. A., & Engbert, R. | Bayesian inference of dynamical cognitive and oculomotor processes in the SWIFT model of reading. | 2019 | Poster presented at the 60th Annual Meeting of the Psychonomic Society, Montréal, QC, Canada. 14 - 17 November. | Talk or Presentation | |
| Rabe, M. M., Chandra, J., Krügel, A., Seelig, S. A., & Engbert, R. | Bayesian inference of the SWIFT model: Reading mirrored, scrambled, and normal texts. | 2019 | Poster presented at the 20th European Conference on Eye Movements (ECEM 20), Alicante, Spain. 18 - 22 August. | Talk or Presentation | |
| Seelig, S. A., Rabe, M. M., Malem-Shinitski, N., Reich, S., & Engbert, R. | Bayesian parameter estimation for the SWIFT model of eye-movement control during reading. | 2019 | Poster presented at the Conference on Cognitive Computational Neuroscience (CCN) 2019, Technical University of Berlin, Berlin, Germany. 13 - 16 September. | Talk or Presentation | |
| Vasishth, S. | Prenominal relatives clauses in Mandarin: Implications for theories of sentence processing. | 2019 | Invited talk at the GK Colloquium, Institut für Linguistik, Goethe-Universität Frankfurt, Frankfurt, Germany. 14 May. | Talk or Presentation | |
| Vasishth, S. | Is pre-registration a bad idea or a very bad idea? | 2019 | Invited talk at the Humboldt-Universität zu Berlin, Berlin, Germany. 24 January. | Talk or Presentation | |
| Paape, D., Vasishth, S., & Engbert, R. | Does Local Coherence Lead to Targeted Regressions and Illusions of Grammaticality? | 2021 | Open Mind (2022) 5: 42–58. DOI: 10.1162/opmi_a_00041 | Peer-Reviewed | |
| Vasishth, S., & Engelmann, F. | Sentence Comprehension as a Cognitive Process: A Computational Approach. | 2021 | Cambridge: Cambridge University Press. | SFB-Related | |
| Yadav, H., Smith, G., Reich, S., & Vasishth, S. | Number feature distortion modulates cue-based retrieval in reading. | 2023 | Journal of Memory and Language, 129, 104400. DOI: 10.1016/j.jml.2022.104400 | Peer-Reviewed | |
| Arkhipova, Y. | N400 as an index of semantic feature preactivation. | 2023 | Paper presented at the Language And Cognition Group Meeting., University of Leiden. Leiden, The Netherlands. 12 January. | Talk or Presentation | |
| Engbert, R., Rabe, M. M., Schwetlick, L., Seelig, S. A., Reich, S., & Vasishth, S. | Data assimilation in dynamical cognitive science. | 2022 | Trends in Cognitive Sciences, 26(2), 99-102. DOI: 10.1016/j.tics.2021.11.006 | Peer-Reviewed | |
| Rabe, M. M., Paape, D., Mertzen, D., Vasishth, S., & Engbert, R. | SEAM: An integrated activation-coupled model of sentence processing and eye movements in reading. | 2024 | Journal of Memory and Language, 135, 104496 DOI: https://doi.org/10.1016/j.jml.2023.104496 | Peer-Reviewed | |
| Mertzen, D., Paape, D., Dillon, B. W., Engbert, R., & Vasishth, S. | Syntactic and semantic interference in sentence comprehension: Support from English and German eye-tracking data. | 2023 | Glossa: Psycholinguistics, 2(1), 8, 1-48. DOI: 10.5070/G60111266 | Peer-Reviewed | |
| Mertzen, D., Laurinavichyute, A., Dillon, B. W., Engbert, R., & Vasishth, S. | Crosslinguistic evidence against interference from extra-sentential distractors | 2024 | Journal of Memory and Language, 137, 104514. DOI: 10.1016/j.jml.2024.104514 | Peer-Reviewed | |
| Schoknecht, P., Yadav, H., & Vasishth, S. | Do syntactic and semantic similarity lead to interference effects? Evidence from self-paced reading and event-related potentials using German. | 2025 | Journal of Memory and Language, 141, 104599. DOI: 10.1016/j.jml.2024.104599 | Peer-Reviewed | |
| Schoknecht, P., & Vasishth, S. | The time course of local coherence in German: Evidence from event-related potentials. | 2024 | Poster presented at the 30th Architectures and Mechanisms for Language Processing Conference (AMLaP 2024), Edinburgh, UK. 05-07 September. | Talk or Presentation | |
| Schoknecht, P., & Vasishth, S. | Do syntactic and semantic similarity lead to interference effects? | 2024 | Paper presented at the Linguistic Evidence 2024, University of Potsdam, Potsdam, Germany. 22-23 February. | Talk or Presentation | |
| Schoknecht, P., & Vasishth, S. | Event-related potentials elicited by similarity-based interference during subject-verb dependency resolution. | 2023 | Lightning talk and poster presented at the 15th Annual Meeting of the Society for the Neurobiology of Language (SNL 2023), Marseille, France. 24-26 October. | Talk or Presentation | |
| Schoknecht, P., & Vasishth, S. | Event-related potentials elicited by similarity-based interference during subject-verb dependency resolution. | 2023 | Poster presented at the 29th Architectures and Mechanisms for Language Processing Conference (AMLaP 2023), San Sebastian, Spain. 31 August-02 September. | Talk or Presentation | |
| Engbert, R., & Rabe, M. M. | A tutorial on Bayesian inference for dynamical modeling of eye-movement control during reading. | 2024 | Journal of Mathematical Psychology, 119, 102843. DOI: 10.1016/j.jmp.2024.102843 | Peer-Reviewed | |
| Mertzen, D. | A cross-linguistic investigation of similarity-based interference in sentence comprehension. | 2022 | PhD Thesis. Potsdam: Universitätsverlag Potsdam. DOI: 10.25932/publishup-55668 | Other | |
| Rabe, M. M. | Modeling the interaction of sentence processing and eye-movement control in reading. | 2024 | PhD Thesis. Potsdam: Universitätsverlag Potsdam. DOI: 10.25932/publishup-62279 | Other |