This paper examines gestural deixis production in a multimodal (natural language and pointing) interaction. Users (N=30) were required to fill in 4 forms by interacting with a simulated system. Labelling of Entry Fields (LEF, Complete-Partial; between-subject) and Feedback (Present-Absent within.-subject) were manipulated in a 2*2 design. Results indicate that deixis occurred more frequently in the Partial-LEF condition. Specific input device constraints influenced intermodal integration: pointing was performed after the end of writing, although feedback presence increased modality shifts. Simulation offered a valuable tool for the development of multimodal interaction models
Interface Features Affecting Deixis Production: A Simulation Study
1996-01-01
Abstract
This paper examines gestural deixis production in a multimodal (natural language and pointing) interaction. Users (N=30) were required to fill in 4 forms by interacting with a simulated system. Labelling of Entry Fields (LEF, Complete-Partial; between-subject) and Feedback (Present-Absent within.-subject) were manipulated in a 2*2 design. Results indicate that deixis occurred more frequently in the Partial-LEF condition. Specific input device constraints influenced intermodal integration: pointing was performed after the end of writing, although feedback presence increased modality shifts. Simulation offered a valuable tool for the development of multimodal interaction modelsI documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
