InmersIA

Virtual reality, eye tracking and artificial intelligence for language learning

Virtual reality, eye tracking and AI for language learning

InmersIA is a project funded by the European cross-border cooperation program POCTEFA, created to promote the sustainable development of the border territory of Spain, France and Andorra. InmersIA aims to harness the potential of virtual reality and artificial intelligence to improve foreign language communication skills on both sides of the border.

In an increasingly demanding and internationalized world of work, this cross-border project uses a cutting-edge digital tool - artificial intelligence - to provide current students with language skills, promote multilingualism and improve their employability in the future.

Go to InmersIA!

A European project involving 5 partners

InmersIA has five partners on both sides of the border: the Centro Navarro de Aprendizaje Integral (CNAI), the Government of Navarra, the Navarran company Nautilus Experiencias Digitales, the French company Immersalis Consulting and the Chambre de Métiers et de l'Artisanat Nouvelle-Aquitaine. These entities will cooperate for three years to create a methodology that will serve as the basis for the development of a language learning platform focused on users' oral skills. Among other activities, InmersIA is proposing two pilot exercises in which vocational training students and teachers from Navarre and the French region of Nouvelle-Aquitaine will have the opportunity to experiment with didactic and technological advances in the field of artificial intelligence for language learning. Subsequently, the project's platform and learning will be extended to other entities in both territories to achieve a more equitable society in which citizens have equal opportunities for language learning and digital literacy, thus reducing the digital divide.

Immersalis' role in the project

Immersalis was asked to integrate the use of eyetracking into the project in two main areas:

  • The creation and implementation of visual interactions, in particular avatars, to facilitate and streamline communication between teachers and learners;
  • Using eye tracking, we can measure learners' cognitive load, to help set up and evaluate appropriate exercises.

3 challenges we are addresing

Integrating eye interactions into virtual worlds

Gaze-based interaction drastically extends and fluidifies virtual reality interaction. By capturing the gaze, we capture the user's intention: manipulating an object no longer requires more than a glance.

immersalis-virtual-reality-mobile

Streamline communication between avatars

The gaze plays a key role in communication, directing speech turns and informing attention... Eye tracking makes it possible to reintegrate this essential modality into communication through virtual reality avatars, for even smoother communication.

immersalis-we-choose

Real-time measurement of cognitive load

Ocular information, and in particular pupil diameter, are natural indicators of the cognitive load a learner may experience. By measuring this cognitive load during learning, it becomes possible to adapt content to maintain learner engagement, and facilitate assessment of acquired skills.

Total cost of project: € 947,403.38
Importe de la financiación FEDER: € 615.810,71

The InmersIA project has been 65% co-financed by the European Union through the Interreg VI-A Spain-France-Andorra Program (POCTEFA 2021-2027). The aim of POCTEFA is to strengthen the economic and social integration of the Spain-France-Andorra border area.