Experiences from Context-aware Services in Real World

Download Experiences from Context-aware Services in Real World

Post on 05-Dec-2014




2 download

Embed Size (px)


Ichiro Satoh's talk at the Awareness Workshop - SASO 2012, Lyon, France


  • 1. Experiences from Context-aware Services in Real World National Institute of Informatics, Japan Ichiro Satoh Email: ichiro@nii.ac.jp Ichiro Satoh
  • 2. Self-IntroductionIchiro SatohProfessor, National Institute of InformaticsVisiting researcher of Rank Xerox (at Grenoble) From TV news on my experiments in shopping moles and department stores.Chairs or program committee members of major conferences on ubiquitous computing, e.g., PerCom and Ubicomp. Ichiro Satoh
  • 3. National Institute of Informatics (NII) (Manga) Publishers area Akihabara (electric/geeks/manga/NII otaku town) NII 1.5km The Imperial Palace NII has PhD course / internship programs Tokyo Station If you are interested in the program, NII is 1.5km-near from Tokyo Station please contact with me Ichiro Satoh
  • 4. Outlinen Experiment on context-aware servicesn Experience from context-aware services at the real worldn ConclusionThis presentation focuses on experiences rather than systemissues. Ichiro Satoh
  • 5. Middleware for Context-aware Services n Our middleware can maintain the locations of computing devices and software for defining services in addition to those of physical entities and places in a unified manner. n Application-specific services are defined and executed within virtual counterparts within the location model. n The middleware can naturally provide a location-aware service discovery mechanism and service policy specification language. service provider networked light service provider software control and software deployment software 3.00 3.00 3.00 user-bound proxy light-bound desk-boundcomputer counterpart counterpart counterpart counterpart Specification 3.00 3.00 3.00 3.00 3.00 of the users requiring room-bound room-bound room-bound room-bound 3.00 9.00 3.00 3.00 services counterpart counterpart counterpart counterpart floor-bound counterpart 3.00 3.00 9.00 The model also maintains the location and capabilities of computers and the relocation of software. Ichiro Satoh
  • 6. Experimentsn We had done several experiments in public museums: n The National Science Museum, and etc.n Museums have many visitors whose knowledge about exhibitions are different. n Annotation about exhibitions should be provided for visitors dependently on their knowledge and experience, including the exhibitions that they previously viewed the National Science Museum (Tokyo, Japan) Ichiro Satoh
  • 7. Experimentn In the National Science Museum, each spot was in front of the fossils of dinosaurs in an exhibition room.n When a visitor enters in a spot, the system selected and played audio- based annotation about dinosaurs according to the combination of the current spot, past spots, and his/her selecting course.n The experiment has done for two weeks.n It had more than 200 participants per- day and was evaluated with a group of 262 participants. Ichiro Satoh
  • 8. Experiment (contd)n Each visitor wore a hat equipped with RFID tags.n Each spot had an RFID reader to detect the presence of a visitor within it. Speaker RFID Tag(s) Flat antenna for RFID Reader I am a member of ISO standardization committee for RFID and real-time locating technology Ichiro Satoh
  • 9. How to evaluate context-awareservicesn There is no unified metrics to evaluate context-aware services. n It is difficult to evaluate the effectiveness of context- aware services individually.n (Only) one solution is to compare between our approach and existing approaches. n You should provide context-aware services, which can be fairly compared from other approaches. No evaluation is no academic research. Ichiro Satoh
  • 10. EvaluationTo evaluate the effectiveness of our context-aware visitor-guide system, we experimented four audio/text-annotation systems.A) Mobile Phones/PDAs (iPod Touch) To listen audio-annotation, users input numbers attached to exhibits (120 testees)B) Location-aware PDAs (iPod Touch) When RFID readers detect RFID-tags attached to PDAs, the system automatically enables PDAs to play audio-annotation dependent on their current spots. (56 testees)C) Paper-based posters Text-based annotation located near the exhibitions. (50 testees)D) Our experiments (262 testees)Annotation content were common among the four experiments to offer a unified metrics in comparison of these approaches.Note: the above numbers are the number of testees, which are only 8-12 years children for the reason of a single evaluation metrics. Ichiro Satoh
  • 11. Evaluation (contd)After visitors experienced each courses, we assigned tests to participants to evaluate the achievement of their learning.The percentage of their correct answers:A) Mobile Phones/PDAs: 53%B) Location-aware PDAs: 52%C) Paper posters: 66%D) Our experiments: 68%Problems:1. As problem : half-visitors inputted incorrect numbers and listened incorrect annotations but were aware of their mistakes.2. Bs problem: most visitors paid attention to their PDAs instead of exhibitions. Ichiro Satoh
  • 12. From experiment, we learned..n Context-aware services should play leading or extra roles.n All technically interested approaches are not appropriate in the real world. n Researchers may misunderstand because people tend to evaluate new approaches to be interested, but such approaches may not be effective.n Many traditional approaches have been used because of they are effective. Ichiro Satoh
  • 13. From experiment, we learned..How to inform servicesn It is difficult for users to find/know who/ where/when context-aware services are available.n On the other hand, several users were surprised at the sudden activation of when context-aware services.n We need to instruct users who, where, when, what, and how context-serviced provided. To avoid this problem, we put marks at spots to explicitly specify where context-aware services are available. Ichiro Satoh
  • 14. From experiment, we learned..How to support to legacy spacesn It is more difficult to make legacy spaces than to build new smart spaces, because of their constraints. n There may be no space to deploy devices, e.g., sensors, in legacy spaces, including homes and offices. n Legacy spaces may lack power-line and networks. n Context-aware services must make existing spaces smart without losing any utility of the original spaces. Museums required all devices to be invisible from visitors. Ichiro Satoh
  • 15. From experiment, we learned..How to managen Management systems are important. n Context-aware services need numerous heterogeneous sensors and devices.n Public spaces, including museums, have no spaces for management systems.n They lack any professional administrators. Backyard of a typical experiment for smart rooms. It is often larger than its target rooms. Ichiro Satoh
  • 16. From experiment, we learned..How to manage (contd)n There may be no space for system management in real spaces.n Our experiments supported GUI-based management systems in PDAs. n It enabled curators to monitor and control context-aware services by using their portable devices instead of any stationary terminals. Ichiro Satoh
  • 17. From experiment, we learned..Availability and Reliabilityn Context-aware services are required to be provided anytime. n e.g., the experiment was required to continue to work for 6 days because the devices were deployed close to definitely precious specimens.n There is no silver bullet to develop reliable systems. n Context-aware systems are a mission-critical system. n In fact, student-level programming skills may not be enough. n I designed and implemented all middleware systems in out experiments.In fact, our middleware and services could support more than 200 visitors per-day and continue to work without any reboot and configuration for every 6 days. Ichiro Satoh
  • 18. From experiment, we learned..Availability and Reliabilityn Sensing systems should be selected according to their measurement errors. n Lateration systems can locate users positions, but they may sometimes return incorrect positions far from their real positions. n They may provide incorrect users with incorrect services. n RFID-tag-based proximity systems can detect the existences of users within specified areas but they occasionally lose the positions of tags. n They may not provide users with services even when they are in spaces where they should receive the services.n The latters problem is better than the latters problem in the real world. n Least suffering strategy rather than best-effort one. Ichiro Satoh
  • 19. From experiment, we learned..Availability and Reliabilityn Smart surroundings are stupid and scatterbrain. n Sensing systems are not perfect. n Champion data in experiments are meaningless.n The technology needs to support least suffering strategy instead of best-effort one. n High reliability and availability are needed....


View more >