activity presentation
DESCRIPTION
Activity presentation. Director: Jean Caelen (DR CNRS) Vice-Director : Catherine Berrut (Prof. UJF). [email protected] www-clips.imag.fr . Institutions. UMR 5524. Research Topics. Man-Machine Interaction(s) Collaborative interactions with machines Speech, Image, Language Processing - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/1.jpg)
Activity presentation
BP 53 - 38041 Grenoble Cedex 9 - FranceFédération IMAG
Communication Langagière etInteraction Personne-Système
Director: Jean Caelen (DR CNRS)Vice-Director : Catherine Berrut (Prof. UJF)
![Page 2: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/2.jpg)
Institutions
UMR 5524
![Page 3: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/3.jpg)
Research TopicsMan-Machine Interaction(s)Collaborative interactions with machinesSpeech, Image, Language Processing
E-LearningPerceptive Rooms and Augmented RealityMultimedia Document IndexingMan Machine Interaction EngineeringSpeech Recognition and Natural Language DialogueCollaborative and Multimodal InterfacesInformation RetrievalMachine TranslationLanguage Processing
![Page 4: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/4.jpg)
Structure
Direction
Research• ARCADE• GEOD• GETA• IIHM• MRIMLa
bora
toty
cou
nci l
Dire
ctio
n co
unci
l Technical staff• Maintenance• Projects
Administration• Secretariat• People Management• Financial• Subsistance• Communication
Valorisation• MultiCom
People : 72 (staff + PhD students)UJF, CNRS, INPG, UPMF, US
![Page 5: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/5.jpg)
Research Teams
ARCADE (J.P. Peyrin, prof. UJF)e-Learning (Ateliers de Réalisation et de Conception d’Applications Destinées à l’Education)
GEOD (J.F. Serignat, MCF INPG)Speech Group (Groupe d’Etude sur l’Oral et le Dialogue)
GETA (C. Boitet, prof. UJF)Machine Translation Group (Groupe d’Etude sur la Traduction Automatique)
IIHM (J. Coutaz, prof. UJF)Man Machine Interaction Engineering (Ingénierie de l’Interaction Homme-Machine)
MRIM (M.F. Bruandet, prof. UJF)Multimedia Information Retrieval (Modélisation et Recherche d’Informations Multimédia)
![Page 6: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/6.jpg)
People 1/1/2002
Regular Staff 73(a) Profs + Researchers 29(b) Engineers + Admin. 11(c) PhD + Post-docs 26(d) Under contracts 7
(e) Masters and others 24(g) Invited 10Total 107
![Page 7: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/7.jpg)
Technological transfert
MultiCom : Usability platform for the design and the evaluation of interactive systems
Start-up creations
1998 : NOVADIS, ergonomics, cognitive engineering1999 : ARLYS (MENRT, CARMI, Microsoft, Axe et Cible), e-
learning, education software development2000 : DMAILER, e-mail indexing and processing
![Page 8: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/8.jpg)
MultiCom
Technological Platform :• To study human factors in situated tasks• To design and evaluate innovative and interactive services (or
systems)by,• Real usage experimentation• Simulation (Woz for instance)
Partnership Linguists, Sociologists, Ergonomists
![Page 9: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/9.jpg)
Relationship and contractsMultiCom• 6 industrial : (Schneider, France-Télécom, Leti-CEA, STM), • 2 european : SIRLAN IST 5th PCRD, ADAMOS, Finlandia • 2 regional : SHIVA RRA 99 et Thématique 2000Research• 6 industrial : (Thalès, France-Télécom, EDF, Alcatel) in
RNRT, RNTL, CTI CNET, DGA• 2 international : C-STAR, UNL (17 countries)• 5 european : NESPOLE, TACIT, TIPS, ARIADNE, GLOSS,
CAMELEON, FAME• 3 research networks : CNRS (french networks)• 2 regional• 5 local (C-STAR, RICOM, RESIDE-HIS, EPIC, e-Xpérience)
![Page 10: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/10.jpg)
![Page 11: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/11.jpg)
Multi-team projects
C-STAR/NESPOLE! : Face to face speech translation (GEOD, GETA)
RICOM : Multimodal interaction for Multimedia information retrieval (GEOD, IIHM, MRIM)
Smart Rooms : disable people monitoring, home services… (GEOD, IIHM)
FORMID : e-learning, virtual teaching (ARCADE, IIHM)
![Page 12: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/12.jpg)
C-STAR : Consortium for Speech Translation Advanced Research (Japan, Corea, USA, Germany, Italy, France)NESPOLE! (IST project) : NEgotiating through SPOken Language in E-commerce
![Page 13: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/13.jpg)
Projet C-STARSpeech translationApplications to : tourism, hot line, e-commerce
![Page 14: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/14.jpg)
2 ways possible
source
Speech recognition
Translation
Speech synthesis
target
speakingspeaking
listeninglistening
texte IFtexte IF
IF coding
Generation
![Page 15: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/15.jpg)
Interchange Format
• Meaning representation• Based on
– Speech acts• What to want or to do
– Concepts• What to say
– Arguments• Discourse predicates
give-information
+availability+room
room-type=(single ; double)
![Page 16: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/16.jpg)
The 22th july 1999at Grenoble
![Page 17: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/17.jpg)
RICOM : Information Retrieval: Interactive, Collaborative andMultimodale HALPIN : Man-Machine DialogueCoVitesse : Information Representation
![Page 18: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/18.jpg)
I found 1206 documents on the topic artificial intelligence. Do you want refine your research ?
What have you on ... e, artificial intelligence ?
HALPIN
Man-Machine Dialogue : speech recognition + dialogue management + information retrieval + speech synthesis
![Page 19: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/19.jpg)
History of dialogue
Input
Outputs
Documents
Speech ButtonsSpeech Recognition
![Page 20: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/20.jpg)
Collaborative surfingTrace of navigation
Collected documents
Session controlDocument annotation
![Page 21: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/21.jpg)
RESIDE-HIS : Smart Home for disable peopleCOMEDI : Informal Communication
![Page 22: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/22.jpg)
RESIDE-HIS
![Page 23: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/23.jpg)
TelemonitoringRéseau Téléphonique Public
Modem
HModem
Home bus
Physiological and biological sensorsMicrophones
Monitoring on :EventsAlarmsStatistics
![Page 24: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/24.jpg)
Plan HIS
![Page 25: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/25.jpg)
CoMedi : Informal communication
Feed-back, privacy control
Awareness, Focus
Acces control
Feed-back control
![Page 26: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/26.jpg)
Example of filters
Poster
Curtain
EigenSpace
![Page 27: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/27.jpg)
EigenSpace filter: Main Component Analysis
Image base Eigen Space
Image captured Image to send
Eigen vector ArgMin(distance)
![Page 28: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/28.jpg)
FORMID : FORmation Interactive à DistanceMagic Board : Collaborative Space and augmented reality
![Page 29: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/29.jpg)
FORMID : Toolkit for teaching by example I learn what I do.
FORMID
GeneSimuOasis
![Page 30: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/30.jpg)
Mag
ic B
oard
![Page 31: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/31.jpg)
Platform for design and evaluationof interactive systems
![Page 32: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/32.jpg)
Analyse des besoins
Conception
Conception logicielle
Codage
Tests Unitaires
Tests d’intégration
Tests UtilisateursEvaluation
ergonomique
Development
Observations
Task analysis
Design
Software design
Lifecyle
![Page 33: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/33.jpg)
Objectives
To anticipate the usage and to predict the usabilityTo design and to evaluate interactive systems along the lifecycle
Participatory design methodAnd simulation techniques (as Moz) for the experimentation and the test
using
![Page 34: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/34.jpg)
A good starting point : enrich the first idea
Taking into account all the criteria about (a) sociological, (b) ergonomical, (c) economical,(d) technological points of view
Idea
Functions
Specifications
Scenario
ObservationDiagnostic
Validation
Mockup
Evaluation
![Page 35: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/35.jpg)
Sociology…Practice analysisUsage meaning• By questionnaire• By interviews• By recording practicesApplying sociological criteria
Recommendations for the design
![Page 36: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/36.jpg)
Ergonomics...Simulation, Woz, Scenarios…
• Test human perceptive• Test human behavior (after capture) under definite and limited
scenarios• Task and activity analysis
Recommendations for the design
![Page 37: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/37.jpg)
The first cycle ends…
Functionalities definitionDesign constraintsCriteria Evaluation definitionSpecifications
Then development can start along a second iterative cycle
![Page 38: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/38.jpg)
The hardware platform
Client Magicien - Agent
Echange de- images- plans- textes
DATVidéo-disque
1 Magicien "Gestion du dialogue" 1 Magicien "Annotation"
UserDevices for observation
Wizard 1 Wizard 2
Control video
Multimedia recording
Interactive devices
![Page 39: Activity presentation](https://reader035.vdocuments.site/reader035/viewer/2022062501/5681632e550346895dd3a8c5/html5/thumbnails/39.jpg)
Conclusion… CLIPS-IMAG is…
• A research lab on interactive systems• Open on the technological transfert• Focused on user centered design methods
BP 53 - 38041 Grenoble Cedex 9 - FranceFédération IMAG
Communication Langagière etInteraction Personne-Système