[ieee 2014 ieee virtual reality (vr) - minneapolis, mn, usa (2014.03.29-2014.04.2)] 2014 ieee...

1
CORVETTE: Collaborative Environment for Technical Training and Experiment Rozenn BOUVILLE BERTHELOT * , Thomas LOPEZ, Florian NOUVIALE, Val´ erie GOURANTON and Bruno ARNALDI IRISA/INSA de Rennes ABSTRACT The CORVETTE project aims at producing significant innovations in the field of collaborative virtual training. For that purpose, CORVETTE combines various technologies to enhance the effec- tive collaboration between users and virtual humans performing a common task. First, CORVETTE proposes a model of collabora- tive interaction in virtual environments allowing actors to efficiently collaborate as a team whether they are controlled by a user or by a virtual human [4]. Moreover, the environment is simulated in real- time, at real scale and is using physics as well as physically-based humanoids to improve the realism of the training. Second, thanks to the interaction model, we defined a protocol of exchange of avatars [5, 3, 2]. Thus, an actor can dynamically exchange the control of his/her avatar with the one controlled by another user or by a virtual agent. Moreover, to improve the exchange protocol, we designed a new knowledge model embedded in each avatar. It allows users and virtual humans to retrieve knowledge previously gathered by an avatar following an exchange. The preservation of knowledge is indeed especially crucial for teamwork. Finally, we handle ver- bal communication between users and virtual humans with speech recognition and synthesis. Actors’ knowledge is enhanced through dialogue and used for decision-making and conversation [1]. Figure 1: The CORVETTE training environment ACKNOWLEDGEMENTS This work was supported by the french National Research Agency (ANR) (grant No. ANR-10-CONTINT-CORD-012). REFERENCES [1] M. Barange, P. De loor, V. Louis, R. Querrec, J. Soler, T.-H. Trinh, E. Maisel, and P. Chevaillier. Get involved in an interactive virtual tour of brest harbour: Follow the guide and participate. In Proceedings of * e-mail: rozenn.bouville [email protected] the 11th International Conference on Intelligent Virtual Agents, IVA’11, volume 6895 of Lecture Notes in Artificial Intelligence, pages 93–99, Reykjavick, Iceland, Septembre 2011. Springer-Verlag. [2] T. Lopez, R. Bouville, E. Loup-Escande, F. Nouviale, V. Gouranton, and B. Arnaldi. Exchange of avatars: Toward a better perception and understanding. IEEE Transactions on Visualization and Computer Graphics (to appear), 2014. [3] T. Lopez, F. Nouviale, V. Gouranton, B. Arnaldi, et al. The ghost in the shell paradigm for virtual agents and users in collaborative virtual environments for training. VRIC 2013 Proceedings, 2013. [4] A. S. Luna, V. Gouranton, and B. Arnaldi. Collaborative virtual en- vironments for training: A unified interaction model for real humans and virtual humans. E-Learning and Games for Training, Education, Health and Sports, page 112, 2012. [5] A. S. Luna, V. Gouranton, B. Arnaldi, et al. The perceptive puppet: Seamless embodiment exchange between real and virtual humans in virtual environments for training. International Conference on Com- puter Graphics Theory and Applications, page 16, 2013. 145 IEEE Virtual Reality 2014 29 March - 2 April, Minneapolis, Minnesota, USA 978-1-4799-2871-2/14/$31.00 ©2014 IEEE

Upload: bruno

Post on 02-Mar-2017

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: [IEEE 2014 IEEE Virtual Reality (VR) - Minneapolis, MN, USA (2014.03.29-2014.04.2)] 2014 IEEE Virtual Reality (VR) - CORVETTE: Collaborative environment for technical training and

CORVETTE: Collaborative Environment for Technical Training andExperiment

Rozenn BOUVILLE BERTHELOT∗, Thomas LOPEZ, Florian NOUVIALE, Valerie GOURANTON and Bruno ARNALDI

IRISA/INSA de Rennes

ABSTRACT

The CORVETTE project aims at producing significant innovationsin the field of collaborative virtual training. For that purpose,CORVETTE combines various technologies to enhance the effec-tive collaboration between users and virtual humans performing acommon task. First, CORVETTE proposes a model of collabora-tive interaction in virtual environments allowing actors to efficientlycollaborate as a team whether they are controlled by a user or by avirtual human [4]. Moreover, the environment is simulated in real-time, at real scale and is using physics as well as physically-basedhumanoids to improve the realism of the training. Second, thanks tothe interaction model, we defined a protocol of exchange of avatars[5, 3, 2]. Thus, an actor can dynamically exchange the control ofhis/her avatar with the one controlled by another user or by a virtualagent. Moreover, to improve the exchange protocol, we designed anew knowledge model embedded in each avatar. It allows usersand virtual humans to retrieve knowledge previously gathered byan avatar following an exchange. The preservation of knowledgeis indeed especially crucial for teamwork. Finally, we handle ver-bal communication between users and virtual humans with speechrecognition and synthesis. Actors’ knowledge is enhanced throughdialogue and used for decision-making and conversation [1].

Figure 1: The CORVETTE training environment

ACKNOWLEDGEMENTS

This work was supported by the french National Research Agency(ANR) (grant No. ANR-10-CONTINT-CORD-012).

REFERENCES

[1] M. Barange, P. De loor, V. Louis, R. Querrec, J. Soler, T.-H. Trinh,E. Maisel, and P. Chevaillier. Get involved in an interactive virtual tourof brest harbour: Follow the guide and participate. In Proceedings of

∗e-mail: rozenn.bouville [email protected]

the 11th International Conference on Intelligent Virtual Agents, IVA’11,volume 6895 of Lecture Notes in Artificial Intelligence, pages 93–99,Reykjavick, Iceland, Septembre 2011. Springer-Verlag.

[2] T. Lopez, R. Bouville, E. Loup-Escande, F. Nouviale, V. Gouranton,and B. Arnaldi. Exchange of avatars: Toward a better perceptionand understanding. IEEE Transactions on Visualization and ComputerGraphics (to appear), 2014.

[3] T. Lopez, F. Nouviale, V. Gouranton, B. Arnaldi, et al. The ghost inthe shell paradigm for virtual agents and users in collaborative virtualenvironments for training. VRIC 2013 Proceedings, 2013.

[4] A. S. Luna, V. Gouranton, and B. Arnaldi. Collaborative virtual en-vironments for training: A unified interaction model for real humansand virtual humans. E-Learning and Games for Training, Education,Health and Sports, page 112, 2012.

[5] A. S. Luna, V. Gouranton, B. Arnaldi, et al. The perceptive puppet:Seamless embodiment exchange between real and virtual humans invirtual environments for training. International Conference on Com-puter Graphics Theory and Applications, page 16, 2013.

145

IEEE Virtual Reality 201429 March - 2 April, Minneapolis, Minnesota, USA978-1-4799-2871-2/14/$31.00 ©2014 IEEE