Tutorial 1:
Mixed realities in inhabited worlds
Monday, August 29th, 2005. 8:30 - 17:30 (Full Day)
VENUE: Emmet Theatre.
| ORGANISER: |
Nadia Magnenat-Thalmann, University of Geneva
|
| SPEAKERS: |
Nadia Magnenat-Thalmann (U. of Geneva)
Pascal Fua (EPFL)
Frederic Vexo (EPFL)
Daniel Thalmann (EPFL)
HyungSeok Kim (U. of Geneva) |
Outline and Syllabus
We will first explain what is Mixed Reality covering the
spectrum from Reality to Virtual Reality. We will
emphasize Augmented Reality which augments the user's
view of the real world by composing 3D virtual objects
with their real world counterparts, necessitating that the
user maintains a sense of presence in that world. We also
present the concept of Augmented Virtuality where the real
part is much less important. We then focus on Virtual
Inhabited Worlds. After a State-of-the-Art of the main technologies and
concepts, we will survey a few applications in medicine,
psychiatry, tourism, and entertainment.
- Concepts and State of the Art of mixed realities
in inhabited worlds (45 minutes)
-
Mixed Realities in inhabited worlds (Daniel
Thalmann):
- Definition of Mixed Reality
- Inhabited virtual Worlds
- State-of-the-Art
- Applications of Mixed Reality
- Believability and Presence (Nadia Magnenat-Thalmann
and HyungSeok Kim):
- Concept of Presence and Believability
- Sensory level techniques to enhance presence
and believability
- Affective registration: an example of
illumination registration
- Perceptual level Presence and Believability:
Introducing the interactive future
- Perception, Sensors and Immersive hardware
for MR in Inhabited Worlds (4 hours)
- Vision Based 3D Tracking and Pose Estimation
for MR (Pascal Fua)
- Perception and sensors for Virtual Humans
(Daniel Thalmann)
- Concepts of virtual and real sensors
- Virtual vision, audition and tactile
- Perception of objects
- Perception of real and virtual humans
- Perception of actions and events
- Perception and sensors for groups and crowds
- Immersive hardware needed for Mixed
Realities (Frédéric Vexo)
- Semi Immersive Large Screen
- Miniature display solutions
- Head Mounted Display and Head Mounted
see-through Display
- Wearable Computer
- Wireless Data Transmission devices
- Head and Gaze Tracking
- 3D graphics board for mobile devices
- Low weight Geo-localization devices
- Miniature and Control Video Cameras
- Emotional and conversational virtual humans
(Nadia Magnenat-Thalmann)
- Overview Embodied Conversational Agents
- Personality and Emotion Simulation
- Dialogue Systems
- Facial Animation
- Body Animation
- Case studies: MR in various applications (all
speakers, 1 hour)
- Simulating Life in mixed realities Pompei
world (Nadia Magnenat-Thalmann)
- Simulating actors and audiences in ancient
theaters (Daniel Thalmann, Nadia Magnenat-Thalmann)
MR in an industrial project (Pascal Fua)
- Feeling presence in the treatment of social
phobia (Daniel thalmann and Frederic Vexo)
- Conclusions and Further Discussion (all
speakers, 15 minutes)
Resume of the presenters
Pascal Fua received a degree from Ecole Polytechnique,
Paris, in 1984 and a Ph.D. in Computer Science from
the University of Orsay in 1989. He joined EPFL in 1996
where he is now a. Before that, he worked at SRI
International and at INRIA Sophia-Antipolis as a computer
scientist. His research interests include human body
modeling from images, optimization-based techniques for
image analysis and synthesis, and using information theory
in the area of model-based vision. He has (co)authored over
100 publications in refereed journals and conferences. He is
a member of the editorial board of the IEEE journal
Transactions for Pattern Analysis and Machine Intelligence
and has been a program committee member of several
major vision conferences.
HyungSeok Kim is a post-doctoral assistant at Miralab,
University of Geneva. He received his PhD in Computer
Science in February 2003 at VRLab, KAIST :
"Multiresolution model generation of texture-geometry for
the real-time rendering". His main research field is Real-time
Rendering for Virtual Environments, more specifically
Multiresolution Modeling and Texture Map Generation. He
is also interested in 3D Interaction techniques and Virtual
Reality Systems.
Nadia Magnenat-Thalmann has pioneered research into
virtual humans over the last 25 years. She obtained several
Bachelor's and Master's degrees in various disciplines
(Psychology, Biology and Chemistry) and a PhD in
Quantum Physics from the University of Geneva. From
1977 to 1989, she was a Professor at the University of
Montreal and led the research lab MIRALab in Canada. She
moved to the University of Geneva in 1989, where she
founded the Swiss MIRALab, an internationally
interdisciplinary lab composed of about 30 researchers. She
is author and coauthor of a very high number of research
papers and books in the field of modeling virtual humans,
interacting with them and in augmented life. She has
received several scientific and artistic awards for her work,
mainly on the Virtual Marylin and the film RENDEZ-VOUS
A MONTREAL. She has directed and produced
several films and real-time mixed reality shows, among the
latest are the UTOPIANS (2001), DREAMS OF A
MANNEQUIN (2003) and THE AUGMENTED LIFE IN
POMPEII (2004). She is editor-in-chief of the Visual
Computer Journal published by Springer Verlag and
coeditor-in-chief of the Computer Animation & Virtual
Worlds journal published by John Wiley.
Daniel Thalmann is Professor and Director of The Virtual
Reality Lab (VRlab) at EPFL, Switzerland. He is a pioneer
in research on Virtual Humans. His current research
interests include Real-time Virtual Humans in Virtual
Reality, Networked Virtual Environments, Artificial Life,
and Multimedia. Daniel Thalmann has been Professor at
The University of Montreal. He is coeditor-in-chief of the
Journal of Visualization and Computer Animation, and
member of the editorial board of the Visual Computer and 3
other journals. Daniel Thalmann was Program Chair of
several conferences including IEEE VR 2000. He has also
organized 4 courses at SIGGRAPH on human animation.
Daniel Thalmann was the initiator of the Eurographics
working group on Animation and Simulation which he
cochaired during more than 10 years. Daniel Thalmann has
published more than 250 papers in Graphics, Animation,
and Virtual Reality. He is coeditor of 30 books, and
coauthor of several books including the recent book on
"Avatars in Networked Virtual Environments", published
by John Wiley and Sons. He received his PhD in Computer
Science in 1977 from the University of Geneva and an
Honorary Doctorate (Honoris Causa) from University Paul-Sabatier
in Toulouse, France, in 2003.
Frederic Vexo is currently senior researcher and project
leader at the Virtual Reality Laboratory at the Ecole
Polytechnique Federale de Lausanne, Switzerland. His
research interests are multidisciplinary and include Human
to Inhabited Virtual World, Haptic Interfaces, Tele
Operated System, Multimodal Adaptive Interface for virtual
worlds, Semantic Virtual Environment and new services for
graphic mobile devices. He is author of several papers in
journals and international conferences in the fields of
Human Computer Interaction, Robotics and Computer
Graphics. He is member of several conference program
committees (AAMAS 2005, SMI 2005, SVE 2005 and
IWVR2005) and expert for different institution and
companies. He received his PhD in Computer Science in
2000 from University of Reims and Bachelor’s and
Master’s degrees from University of METZ. He also has
contributed to various European projects.
|
|
