This 4-ECTS course at Aalborg University, Denmark, provides an overview of multimodal interaction techniques for virtual environments. We start with an overview of multimodal perception to explain how humans behave in virtual environments where incomplete and impoverished sensory cues are reproduced. We then present an overview of technologies for visual-haptic-audio feedback in virtual environments, together with sensing technologies based on capacitive sensing and optical motion capture. We discuss issues of integration of technologies, and we describe algorithms for recognizing input data as well as simulating feedback based on physics modelling. We then introduce evaluation techniques for multimodal environments.
Introduction to multimodal interaction in virtual environments: perceptual illusions, sensory substitution, and multimodal enhancement.
-Visual feedback: screen, projectors, head-mounted display
-Auditory feedback: surround sound, headphones
-Technologies for haptic feedback
-Physics based algorithms for audio-haptic feedback
-Sensing and tracking technologies (capacitive sensors, optical motion capture)
-Integration of technologies
-Evaluation of multimodal interfaces
Dates: May 10,11,12, 13 and June 6, 2011
The course is free but students will have to pay for their own accommodation and board. Registration here
One Response
Stay in touch with the conversation, subscribe to the RSS feed for comments on this post.
Continuing the Discussion
You must be logged in to post a comment.