decision support for value-based software testing framework

16
University of Southern California Center for Systems and Software Engineering Decision Support for Value-Based Software Testing Framework Qi Li, Barry Boehm, USC-CSSE Ye Yang, ISCAS 11/02/2010

Upload: jude

Post on 06-Jan-2016

27 views

Category:

Documents


2 download

DESCRIPTION

Decision Support for Value-Based Software Testing Framework. Qi Li, Barry Boehm, USC-CSSE Ye Yang, ISCAS 11/02/2010. Value-based Software Engineering 4+1 Theory [1]. Value-based Software Testing Framework [2]. Spreadsheet-based Support. Decision Support for VBST. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Decision Support for Value-Based Software Testing Framework

Qi Li, Barry Boehm, USC-CSSE

Ye Yang, ISCAS

11/02/2010

Page 2: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Value-based Software Engineering 4+1 Theory [1]

Page 3: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Value-based Software Testing Framework [2]

Page 4: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Spreadsheet-based Support

Page 5: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Decision Support for VBST

Page 6: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

USC-WikiWinWin [3]: Tool Support for Feature Business Importance Rating

(Win-Win Agreements m to n are traced to feature i)

Page 7: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

USC-COCOMOⅡ.2000.0 [4] : Tool Support for Feature Testing Cost Estimation

Page 8: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Expert COCOMO [5]: Tool Support for Feature Quality Risk Analysis

Page 9: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Logical Decision [6]: Tool Support for Multi-criteria Feature Prioritization

– Define the Range for Each Criteria (Measure)

Measures RangeBusiness Importance [3-27], ↑ the testing priority is higherQuality Risk Probability [0-1], ↑ the testing priority is higherTesting Cost [1-9], ↓ the testing priority is higher

Page 10: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Logical Decision: Tool Support for Multi-criteria Feature Prioritization

– Define Exponential Value Function for Each Measure

0.5

21

0.5

0.70.5

7

Page 11: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Logical Decision: Tool Support for Multi-criteria Feature Prioritization

– Result

Page 12: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Logical Decision: Tool Support for Multi-criteria Feature Prioritization

– Sensitivity Analysis

Page 13: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Logical Decision: Tool Support for Multi-criteria Feature Prioritization

– Uncertainty

Page 14: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Conclusion

– Investigate several state of art software engineering tools from USC-CSSE & a business decision supporting tool to support Value-based Software Testing Framework

• USC-WikiWinWin-> Business Importance Rating• USC-Expert COCOMO-> Quality Risk Estimation• USC-COCOMO II-> Testing Cost Estimation• Logical Decision-> Multi-criteria Decision Making

Page 15: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Future Work

– Investigate more tools

– Implement & Integrate those tools

Page 16: Decision Support for Value-Based Software Testing Framework

University of Southern California

Center for Systems and Software Engineering

Reference

1) Boehm, B. and A. Jain, An Initial Theory of Value-Based Software Engineering, Value-Based Software Engineering. 2005, Springer. pp. 16-37.

2) Li, Q., et al., Bridge the Gap between Software Test Process and Business Value: A Case Study. In Proceedings of International Conference on Software Process:2009, pp 212-223

3) http://pattaya.usc.edu/twiki/bin/view/WikiWinWin/WebHome

4) http://sunset.usc.edu/csse/research/COCOMOII/cocomo_main.html

5) http://sunset.usc.edu/research/COCOMOII/expert_cocomo/expert_cocomo2000.html

6) http://www.logicaldecisions.com/