survey of validation methods in autonomic computing systems ronald stevens and brittany parsons june...
TRANSCRIPT
![Page 1: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/1.jpg)
Survey of Validation Methods in Autonomic Computing
Systems
Ronald Stevens and Brittany ParsonsJune 15, 2006
REU sponsored by NSF
![Page 2: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/2.jpg)
2
Outline of Presentation
1. What is an autonomic computing system?
2. History of autonomic computing
3. Characteristics of ACSs
4. Architecture of ACSs
5. Overview and Evaluation of projects
6. Future Work
7. References
![Page 3: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/3.jpg)
3
1. What is an autonomic computing system (ACS)?
Autonomic computing is a computing environment with the ability to manage itself and dynamically adapt to change in accordance with business policies and objectives [IBM05]
![Page 4: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/4.jpg)
4
2. History of ACSs
• IBM first introduced the idea of Autonomic Computing in March 2001.
• The word autonomic was used to describe this computing because of its biological origins.
• Autonomic systems of the body handle involuntary functions that are needed for the body to live.
![Page 5: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/5.jpg)
5
3. Characteristics of ACSs
- Automatically adapts to
change
- Be able to track changes and act
accordingly
- Able to anticipate and handle security risks
- Diagnose and correct problems
Self Optimizing Self Protecting
Self Configuring Self Healing
Figure 1 Diagram of Autonomic Computing Characteristics [IBM05]
![Page 6: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/6.jpg)
6
4. Architecture of an ACS Element
monitoring - collects detailed data.
analysis - uses the data gathered. planning – comes up with a plan of action
executing - perform
desired actions
Managed Element
Monitor
Plan
Execute
Analyze
Knowledge
Sensors Effectors
Figure 2 Autonomic Manager [KC03]
![Page 7: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/7.jpg)
7
5. Overview and Evaluation of projects
• Impala
• OceanStore
• Model-Driven Autonomic Manager
• Bison
![Page 8: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/8.jpg)
8
Evaluation of projects
• We evaluated each of the four projects based on the criteria and a scale that we came up with for Autonomic Computing Systems.
![Page 9: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/9.jpg)
9
Evaluation criteria for ACSs
• QoS – How well systems perform required tasks
• Cost – cost effectiveness
• Adaptivity – ability to adapt
• Fault Tolerance – ability to deal with problems
• Fault Avoidance – ability to avoid problems
• Fault Detection – ability to find problems
• Degree of Autonomy – amount of human input needed
• Granularity – flexibility of system
• Availability of Source Code
![Page 10: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/10.jpg)
10
Scale for Criteria Evaluation
Rating Description
1 This system does not fit the criteria.
2 This system may possibly fit some part of the criteria.
3 This system has characteristics of the criteria.
4 This system is close to fitting the criteria.
5 This system fits the criteria.
![Page 11: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/11.jpg)
11
Impala• Project Name: Impala
• Organization: Princeton University
• Research Team: Margaret Martonosi (Lead), Steve Lyon, Li-Shiuan Peh, Vince Poor, Dan Rubenstein, Chris Sadler, Philo Juang, Ting Liu, Yong Wang, Pei Zhang
• Purpose of Project: ZebraNet will create a wireless ad-hoc network capable of tracking the movements of wild zebras via tracking collars. [MLP+06] Impala is the middleware that allows each zebra’s collar to act as a node in a wireless network.
![Page 12: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/12.jpg)
12
ImpalaSelf-Healing Self-Protecting Self-Configuring Self Optomizing
Adaptivity 1 1 4 4Cost 1 1 1 1Quality of Service 1 1 3 3Granularity 1 1 3 3Fault Avoidance 1 1 4 2Fault Tolerance 1 1 4 2Fault Detection 1 1 4 1Degree of Autonomy 1 1 5 4Availability of Source Code no
![Page 13: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/13.jpg)
13
OceanStore
• Project Name: OceanStore
• Organization: UC Berekley
• Research Team: John Kubiatowicz(Lead), Byung-Gon Chun,Steven Czerwinski, Patrick Eaton
• Purpose of Project: OceanStore is designed to be a massively scalable storage system. OceanStore employs promiscuous caching and cryptography to ensure that data will not be lost or compromised. [KGC06]
![Page 14: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/14.jpg)
14
OceanStoreSelf-Healing Self-Protecting Self-Configuring Self Optomizing
Adaptivity 1 4 3 1Cost 1 1 1 1Quality of Service 1 4 5 1Granularity 1 3 3 1Fault Avoidance 1 5 5 1Fault Tolerance 1 5 5 1Fault Detection 1 3 2 1Degree of Autonomy 1 4 4 1Availability of Source Code yes
![Page 15: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/15.jpg)
15
Model-Driven Autonomic Manager
• Project Name: Model Driven Autonomic Manager
• Organization: Indiana University• Research Team: Dr. Yuashun Dai (Lead)• Purpose of Project: The purpose of this project
is to develop a model driven autonomic manager. This project focuses on autonomic traits in networks.[DAI06]
![Page 16: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/16.jpg)
16
Model Driven Autonomic Manager
Self-Healing Self-Protecting Self-Configuring Self OptomizingAdaptivity 5 5 5 5Cost 1 1 1 1Quality of Service 1 1 1 1Granularity 5 5 4 5Fault Avoidance 2 2 2 2Fault Tolerance 4 4 4 4Fault Detection 4 4 4 4Degree of Autonomy 5 4 5 5Availability of Source Code no
![Page 17: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/17.jpg)
17
Bison• Project Name: The Bison Project
• Organization: Future & Emerging Technologies initiative of the Information Society Technologies Programme of the European Commission.
• Research Team: The leads for their resepective universities are Ozalp Babaoglu, Geoff Canwright, Luca Maria Gambardella, and Andreas Deutsch.
• Purpose of Project: The Bison Project stands for Biology-Inspired techniques for Self-Organization in dynamic Networks. This project studying biological systems to improve Peer to Peer networks. [DDG05]
![Page 18: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/18.jpg)
18
The Bison Project
Self-Healing Self-Protecting Self-Configuring Self OptomizingAdaptivity 5 5 5 5Cost 1 1 1 1Quality of Service 3 3 3 3Granularity 5 5 5 5Fault Avoidance 5 5 4 5Fault Tolerance 5 5 4 5Fault Detection 5 5 5 4Degree of Autonomy 5 5 4 5Availability of Source Code yes
![Page 19: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/19.jpg)
19
6. Future work• Validating autonomic characteristics in a system.
1. Project in conjunction with graduate students in the Software Testing Research Group.
2. Identify a system (X) with a test history (test cases and actual output)
3. Use the IBM Autonomic Toolkit to log the state of X during execution (Overview of the IBM Autonomic Toolkit)
4. Introduce testing concept.5. Investigate if the logging facility provided by IBM Autonomic
Toolkit (IAT) allows for the validation of the X using the test history.
6. Simulate a change for an autonomic characteristic e.g., self configuration, then use the logs generated by the IAT and the test history of X to check if the behavior of X can be validated.
7. To accomplish the above we will be learning how to use two automated testing tools – JUnit and Rationla Functional Tester.
![Page 20: Survey of Validation Methods in Autonomic Computing Systems Ronald Stevens and Brittany Parsons June 15, 2006 REU sponsored by NSF](https://reader035.vdocuments.site/reader035/viewer/2022070414/5697c0271a28abf838cd637f/html5/thumbnails/20.jpg)
20
7. References[IBM05] IBM Corporation. IBM, 2005. An architectural blueprint for
autonomic computing. June 2005.
[KC03] J. Kephart and D. Chess. The vision of autonomic computing. Computer, vol. 36, no.1, pp. 41-50, January 2003.
[MH04] J. McCann and M. Huebscher. Evaluation issues in autonomic computing. International Workshop
on Agents and Autonomic Computing and Grid Enabled Virtual Organizations (AACGEVO04),
Wuhan, China 2004
[MLP+06] ZebraNet. http://www.princeton.edu/~mrm/zebranet.html
[KGC06] Ocean Store. http://oceanstore.cs.berkeley.edu/info/overview.html
[DAI06] Y. Dai. Model-Driven Autonomic Management. 2006 http://www.cs.iupui.edu/~ydai/AMSCS/MAM.htm
[DDG05] G. Di Caro, F. Ducatelle, and L.M. Gambardella. Project description: BISON: Biology-Inspired techniques for Self-Organization in dynamic Networks. Zeitschrift Knstliche Intelligenz, Special Issue on Swarm Intelligence, November 2005.