Theodor Rumetshofer, Lund University, Department of Logopedics, Phoniatrics and Audiology

The impact of second language vocabulary training using technical immersive technologies on brain plasticity

In this talk I will present results from two neuroimaging studies using immersive technologies for vocabulary training. The goal of this work is to investigate if cortical structures within the language control network are dependent on the learning context in particular in technological immersion. We also consider the role of sensorimotor engagement during training and its effect on learning outcome. The results are part of my PhD studies which I am planning to defend in spring 2026.

The first study investigates short term changes after a single 20-minute second language (L2) training session. The training task was to memorize the names of 30 common kitchen objects in Mandarin chinese in a virtual kitchen by moving and/or pointing at virtual objects. One group performed the training on a computer screen (dVE) and another group with high-immersive virtual reality (iVR) using a head-mounted display. A third, non-training group, was also included as a control condition.

The second study focused on long-term changes after two weeks of training. Instead of known objects we used 114 non-objects from the Ancient Farming Equipment (AFE) paradigm. We compared two groups with different levels of sensorimotor engagement. The task in the high interaction group was to correclty assemble the unknown objects using iVR before they could see and memorize the object name. The low interaction group only wachted the objects and the corresponding name on a computer screen without any interaction.

In both studies, morphological and functional brain changes were assessed using ultra-high field magnetic resonance imaging (7 Tesla MRI), before and after training. Results from study one showed that in a short-term setting, the dVE and iVR rely on similar cortical structures. However, there was a difference in GM density in the left angular gyrus when investigating the effect of objects manipulations. Those results indicate that sensorimotor engagement during training might play a more important role than the level of technological immersion. With study two, we want to further investigate these finding and a detailed analysis from study two will be presented at the seminar.