research projects in software testing -...
TRANSCRIPT
Research projects in software
testing
Ossi Taipale
2012
Lappeenranta University of Tech.
STX among the other software
testing research projects
Top down approach in the research projects :
ANTI-project:
Basic research
of SW testing,
2004 - 2007
MASTO-project:
Reference model
of SW testing,
2008 - 2011
STX-project:
Intended
quality,
2011 - 2014
ISO/IEC 29119:
SW testing
standard
ISO/IEC 29119,
33063,
25000 series
SW testing in
the cloud
Cloud
Testing
Laboratory
2014 -
Publications of the ANTI-project
(2004-2007)
1. Finding and Ranking Research Directions for Software Testing, EuroSPI, Budapest,
Taipale, O., K. Smolander, H. Kälviäinen.
2. Cost Reduction and Quality Improvement in Software Testing, SQM, Southampton,
UK, Taipale, O., K. Smolander, H. Kälviäinen.
3. A Survey on Software Testing, SPICE Conference , Luxembourg, SPICE ,Taipale, O.,
K. Smolander, H. Kälviäinen (2006).
4. Factors Affecting Software Testing Time Schedule, ASWEC, Sydney, Australia,
Taipale, O., K. Smolander, H. Kälviäinen (2006).
5. Improving Software Testing by Observing Practice, ISESE, Rio de Janeiro, Brazil,
Taipale, O., K. Smolander.
6. Observing Software Testing Practice from the Viewpoint of Organizations and
Knowledge Management, ESEM, Madrid, Spain, Taipale, O., K. Karhu, K. Smolander.
7. Triangulating Testing Schedule Over-runs from Knowledge Transfer Viewpoint,
Lappeenranta University of Technology, Research Report 104, Taipale, O., K. Karhu, K.
Smolander .
8. Outsourcing and Knowledge Management in Software Testing, EASE, Staffordshire,
UK, K. Karhu, O. Taipale, K. Smolander.
Overview on MASTO-project (2008-
2011)
ISO/IEC 29119 Test processes
According to ISO/IEC 25010 (Software product quality), the
quality in the software product is a composition of several
quality attributes
These quality attributes
define the quality objectives for software
Software
Product
Quality
Stability
Re
liab
ility
Efficiency
Op
era
bili
ty
Security
Com
patib
ility
Maintainability
Trans
fera
bility
Quality and quality objectives
Combination of Test Improvement model (TIM) maturity
levels and ISO/IEC 29119 processes. Preliminary study for
ISO/IEC 33063 “Testing SPICE”.
Two results:
General maturity and conformance with the standard model.
Process improvement objectives to develop test process.
Processes from ISO/IEC 29119
Maturity levels from TIM
Individual assessment of each
process area, development ideas
General maturity/conformance
estimation
Assessment framework
Publications from the MASTO
project (2008 -2011)
1. Test Case Selection and Prioritization: Risk-Based or Design-Based? Jussi Kasurinen, Ossi Taipale and Kari Smolander, ESEM 2. A Self-Assessment Framework for Finding Improvement Objectives with ISO/IEC 29119 Test Standard, Jussi Kasurinen, Per Runeson, Leah Riungu and Kari Smolander, EuroSPI 3. Software Test Automation in Practice: Empirical Observations, Jussi Kasurinen, Ossi Taipale, Kari Smolander, AiSE 4. Exploring Perceived Quality in Software Organizations, Jussi Kasurinen, Ossi Taipale, Jari Vanhanen and Kari Smolander, IEEE 5. Analysis of Problems in Testing Practices, Jussi Kasurinen, Ossi Taipale and Kari Smolander, APSEC 6. A Study on Agility and Testing Processes in Software Organizations, Vesa Kettunen, Jussi Kasurinen, Ossi Taipale, and Kari Smolander, ISSTA 7. How Test Organizations Adopt New Testing Practices and Methods? Jussi Kasurinen, Ossi Taipale and Kari Smolander, TAICPART 8. Exploring the Perceived End-Product Quality in Software-Developing Organizations, accepted for publication in International Journal of Information System Modelling and Design, IGI Global, Jussi Kasurinen, Ossi Taipale, Jari Vanhanen and Kari Smolander. 9. Trade-off between Automated and Manual Software Testing, Taipale, O., Karhu, K., Kasurinen, J. and Smolander, K, International Journal of Systems Assurance Engineering and Management.
Software testing and development
for intended quality, STX (2011-
2014)
Research Problem
OU’s are evaluated through an assessment framework
Intended
Software Quality
ISO/IEC 25000
series, Software
Quality
Software Testing
ISO/IEC 29119, 33063,
IEEE Std 1012, cloud
testing
Software
Development
•Software Products
ISO/IEC 12207
ISO/IEC 33000
series
•New Services,
Cloud computing
Objective
To show how software development, software testing and intended quality depend on one another.
Traditional software development and service models
Emerging XaaS (Everything as a Service) architectures, technologies and service models.
The project results help the participating companies in improving the efficiency of their quality management and software testing and hence the efficiency of their software development as a whole.
Testing techniques
Testing as a service
Testing of Quality Characteristics
Software testing standard 29119
Part 4 contains information on
how to map Quality
Characteristics to Test Design
Techniques and how to map
Quality Characteristics to Types of
Testing. This is used as reference
in this study.
Software Testing in the Cloud
Cloud based testing offers a new delivery, operation and maintenance model that is enabled by the internet.
It affects the actual testing work and the way testing services are delivered. It also engages the management in paying attention to aspects such as pricing and security.
Objective: This is an empirical study aimed at understanding how organizations can successfully use the cloud for testing and how cloud based testing facilitates or hinders in reaching for quality requirements or quality attributes.
1a. SaaS
software
3. Testing the cloud
2. Testing environments
in the cloud
1b. Non-SaaS
software
1. The system or
application under test is
available online
2. Testing infrastructure
and platforms are
hosted in the cloud
(Including
crowdsourcing/Human
as a Service-(Haas))
3. Testing of the cloud
itself Facets of testing in the cloud
Software Testing in the Cloud
Software Testing in the Cloud
Testing in the cloud affects:
Acquisition (cloud based testing emphasizes services)
Business (cloud based testing emphasizes pay per use instead of license fees)
Access (services are accessed over internet)
Technical models of testing e.g. scalability
Publications from the STX project
(2011-2014) Peer-reviewed articles
1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Testing in the
Cloud: Exploring the Practice", Preprint for Special Issue on Software
Engineering for Cloud Computing, IEEE Software (March/April 2012).
2. Pesonen, T., and Smolander, K., "Observations on eBusiness
Implementation Capabilities in Heterogeneous Business Networks", IFIP
International Federation for Information Processing, pp. 212-226, 2011.
3. Riungu L.M., Taipale O., and Smolander K., "Research Issues for
Software Testing in the Cloud" IEEE Second International Conference on
Cloud Computing Technology and Science (CloudCom), pp.557-564, Nov-Dec
2010.
4. Riungu L.M., Taipale O,, and Smolander K., "Software Testing as an
Online Service: Observations from Practice", 3rd International Conference
on Software Testing, Verification, and Validation Workshops (ICSTW), pp.418-
423, April 2010.
Theses
M.Sc.
1. Aoke L., "Use of Standards in Software Development, Testing and
Quality Assurance: Special Focus on China", M.Sc Thesis, April 2012.
2. Timilsina U., "Security Issues on Testing of Public Cloud Applications",
M.Sc Thesis, February 2012.
Publications from the STX project
(2011-2014)
Publications from the STX project
(2011-2014)
In Review
1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Software Testing as a
Service: Perceptions from Practice", Book chapter in review for Software Testing
in the Cloud: Perspectives on an Emerging Discipline, IGI Global (2012).
2. Timilsina U., Riungu-Kalliosaari L., Taipale O., Smolander K., "Security Issues
on Testing of Public Cloud Applications", Submitted to a Chinese journal, May
2012.
3. Seth F.P., Mustonen-Ollila E., Taipale O., and Smolander K., "Software Quality
Construction: Empirical Study on the Role of Requirements, Stakeholders
and Resources", Submitted to the 19th Asia-Pacific Software Engineering
Conference (APSEC 2012), June 2012.
4. Riungu-Kalliosaari L., Taipale O., Smolander K., and Richardson I., "A
Framework and Strategy for Cloud-based Testing in Practice", on-going 2012.
.