Communicate in a more natural way by multiplying the channels
"Put that there." Pointing with my finger, I point to the object to be moved, then to the place to put it. What could be more natural for us? For the computer, it's a different matter: it has to understand the vocal command, recognize the pointing gesture, determine the object pointed to and then the location; and finally, assemble all this information into a coherent whole.
This is what multimodality proposes in practice: to implement and combine various ways of interacting to create a "natural" dialogue, which allows the user to focus his cognitive resources on the business task, and not on the interaction with the computer. Thus, multimodal interaction is becoming an essential part of our digital transformation. With the ever-increasing amount of information to be processed, it is imperative to take advantage of our natural ability to communicate through several vectors simultaneously.
What are the interests for your jobs?
The increase in complexity of the systems induces in the users an increase in cognitive load: instead of focusing on the task at hand, the user dedicates an increasing part of his cognitive resources to how to use the system to achieve his goals. Multimodal systems expand the communication bandwidth between the user and the system. By offering a communication scheme closer to the human one, they do not overload the user cognitively, which reduces the probability of error.
Multimodal design is based on both technical and human considerations. On the one hand, it is necessary to know the different systems available, their strengths and their limitations; on the other hand, it is necessary to take into account the user's functioning, to understand his activity and the ecosystem in which it takes place. Knowing how to choose the technology that will answer a problem is important, but knowing how to implement it within an activity is critical.