Multimodal interfaces: ENACTIVE systems
Tuesday, August 30th, 2005. 14:00 - 17:30 (Half Day)
VENUE: Swift Theatre.
||Massimo Bergamasco, Scuola Superiore S.Anna - PERCRO Lab|
||Massimo Bergamasco, (PERCRO)
Outline and Syllabus
Enactive Interfaces are related to a fundamental "interaction"
concept which is not exploited by most of the existing human-computer interface technologies.
The traditional interaction with the information mediated by a computer is mostly
based on symbolic or iconic knowledge, and not on enactive knowledge.
While in the symbolic way of learning knowledge is stored as words, mathematical
symbols or other symbol systems, in the iconic stage knowledge is stored in the
form of visual images, such as diagrams and illustrations that can accompany verbal
information. On the other hand, enactive knowledge is a form of knowledge based on
the active use of the hand for apprehension tasks.
Enactive knowledge is not simply multisensory mediated knowledge, but knowledge stored in the form of motor responses and acquired by the act of "doing". A typical example of enactive knowledge is constituted by the competence required by tasks such as typing, driving a car, dancing, playing a musical instrument, modelling objects from clay, which would be difficult to describe in an iconic or symbolic form. This type of knowledge transmission can be considered the most direct, in the sense that it is natural and intuitive, since it is based on the experience and on the perceptual responses to motor acts.
The proposed tutorial will introduce the present developments in the fields of ENACTIVE systems, including: systems able to cope with more complex information, but also new kinds of interfaces, computing architectures and software modules able to work with the users at a more complex degree of information representation.
- ENACTIVE Systems (20 minutes):
- Haptic interfaces (35 minutes):
- Introduction to haptic interfaces;
- Chronological developments;
- Principles of design and control;
- Future trends of research.
- Enactive interfaces: integration of haptics with vision and sound (20 minutes):
- Technological and scientific aspects of multisensory integration between vision, action and sound.
- Model of the user: kinematic and behavioural model of the user when interacting with Enactive interfaces (20 minutes).
- Haptic rendering: control strategies for rendering the force on Enactive interfaces (20 minutes).
- Physical base modelling: integration of physical models within VEs and their control by means of Enactive devices. Analysis of interaction techniques and numerical integration methods (20 minutes).
- Trends, future and Applications of Enactive interfaces (50 minutes):
- Art and cultural heritage;
- Medicine and rehabilitation;
- General discussion/questions - ALL (15 minutes)
Tutorial Presenter's Information
Massimo Bergamasco is Associate Professor in Applied Mechanics at the Experimental Science Faculty of Scuola Superiore S.Anna, Pisa, Italy.
He is founder and director of the PERCRO Laboratory of the Scuola Superiore. Massimo Bergamasco teaches "Mechanics of Robots" at the Faculty of Engineering, University of Pisa, and "Virtual Environment" at the Faculty of Computer Science, University of Pisa.
His research activity deals with the study and development of haptic interfaces for the control of the interaction between humans and Virtual Environments. In this field he is interested in the kinematics aspects of the design of haptic mechanisms.
Cultural Heritage and the applications of new technologies to Art represent the main fields of exploitation of his present research results. Massimo Bergamasco is author of more than 200 papers on books, journal and Conference Proceedings.