Multimodal Usability

Multimodal Usability demonstrates several major generalisations of human-computer interaction and extends the traditional focus on graphical user interfaces to all input/output modalities accessible to vision, hearing, and touch.


Multimodal Usability can help make a multimodal interactive system usable no matter if you are building a work tool or a game, and whether your system models aspects of people, like a virtual (or robot) companion or friend, or not.


Successful implementation can be achieved using the following usability development steps:


(1) Augment system model specification with an AMITUDE model of use specified in terms of Application type, Modalities, Interaction type, Task, User, Device and Environment of use.

(2) Apply usability methods to collect the usability data needed at any time. A toolbox of 24 key methods are presented in a common format. Methods are of five kinds: question-answering, meetings with discussion, observation, imagination, and interaction with the system.

(3) For each method application, post-process, annotate, analyse, report, and act on the data to improve system model usability.


Three multimodal system Cases are included to illustrate usability development from idea to user test of the implemented prototype.


Multimodal Usability assumes no prior knowledge about usability and human-computer interaction.