STX project and software testing

Ossi Taipale2012Lappeenranta University of Tech.

STX among the other software testing research projects

Top down approach in the research projects:

ANTI-project: Basic researchof SW testing, 2004 - 2007

MASTO-project: Reference modelof SW testing, 2008 - 2011

STX-project: Intendedquality,2011 - 2014

ISO/IEC 29119: SW testing standard

ISO/IEC 29119,33063, 25000 series

SW testing in the cloud

CloudTestingLaboratory2014 -

ANTI-project (2004 – 2007) : Factors affecting software testing , for example:

• Product orientation, explicit knowledge, documented information, SPL, product variants, outsourcing, repetitive testing , reuse, testing automation.

• Service orientation, tacit knowledge, domain knowledge, new delivery models, adaptive testing, explorative and manual testing.

MASTO-project (2008 – 2011):• Reference model of software testing (ISO/IEC 29119)• Assessment model of software testing (ISO/IEC

33063)• Software testing in the cloud• Mapping between software product attributes and

software testing (ISO/IEC 25010)

Software testing research

Software testing and development for intended quality, STX (2011-2014)

Research Problem

OU’s are evaluated through an assessment framework

Intended Software Quality

ISO/IEC 25000 series, Software Quality

Software Testing

ISO/IEC 29119, 33063, IEEE Std 1012, cloud testing

Software Development•Software ProductsISO/IEC 12207ISO/IEC 33000 series•New Services,Cloud computing

Objective

To show how software development, software testing and intended quality depend on one another. Traditional software development and service models Emerging XaaS (Everything as a Service) architectures,

technologies and service models.

The project results help the participating companies in improving the efficiency of their quality management and software testing and hence the efficiency of their software development as a whole. Testing techniques Testing as a service

Testing of Quality Characteristics

Software testing standard 29119 Part 4 contains information on how to map Quality Characteristics to Test Design Techniques and how to map Quality Characteristics to Types of Testing. This is used as reference in this study.

Software Testing in the Cloud

Cloud based testing offers a new delivery, operation and maintenance model that is enabled by the internet.

It affects the actual testing work and the way testing services are delivered. It also engages the management in paying attention to aspects such as pricing and security.

Objective: This is an empirical study aimed at understanding how organizations can successfully use the cloud for testing and how cloud based testing facilitates or hinders in reaching for quality requirements or quality attributes.

Software Testing in the Cloud

Testing in the cloud affects:

Acquisition (cloud based testing emphasizes services) Business (cloud based testing emphasizes pay per use

instead of license fees) Access (services are accessed over internet) Technical models of testing e.g. scalability

Publications from the STX project (2011-2014)

Peer-reviewed articles1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Testing in the Cloud: Exploring the Practice", Preprint for Special Issue on Software Engineering for Cloud Computing, IEEE Software (March/April 2012).2. Pesonen, T., and Smolander, K., "Observations on eBusiness Implementation Capabilities in Heterogeneous Business Networks", IFIP International Federation for Information Processing, pp. 212-226, 2011.3. Riungu L.M., Taipale O., and Smolander K., "Research Issues for Software Testing in the Cloud" IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp.557-564, Nov-Dec 2010.4. Riungu L.M., Taipale O,, and Smolander K., "Software Testing as an Online Service: Observations from Practice", 3rd International Conference on Software Testing, Verification, and Validation Workshops (ICSTW), pp.418-423, April 2010.

ThesesM.Sc.1.Aoke L., "Use of Standards in Software Development, Testing and Quality Assurance: Special Focus on China", M.Sc Thesis, April 2012. 2. Timilsina U., "Security Issues on Testing of Public Cloud Applications", M.Sc Thesis, February 2012.

Publications from the STX project (2011-2014)

Publications from the STX project (2011-2014)

In Review1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Software Testing as a Service: Perceptions from Practice", Book chapter in review for Software Testing in the Cloud: Perspectives on an Emerging Discipline, IGI Global (2012). 2. Timilsina U., Riungu-Kalliosaari L., Taipale O., Smolander K., "Security Issues on Testing of Public Cloud Applications", Submitted to a Chinese journal, May 2012. 3. Seth F.P., Mustonen-Ollila E., Taipale O., and Smolander K., "Software Quality Construction: Empirical Study on the Role of Requirements, Stakeholders and Resources", Submitted to the 19th Asia-Pacific Software Engineering Conference (APSEC 2012), June 2012. 4. Riungu-Kalliosaari L., Taipale O., Smolander K., and Richardson I., "A Framework and Strategy for Cloud-based Testing in Practice", on-going 2012. .

Cloud-toimitusmalli edustaa uutta ohjelmistojen toimitusmallia (delivery model). Tutkimusyhtiö Gartner arvioi cloud-toimitusmallin mullistavan ohjelmistotuotannon rakenteen seuraavan kymmenen vuoden aikana. Tämä muutos vaikuttaa sekä olemassa olevaan ohjelmistotuotantoon että avaa uusia mahdollisuuksia suomalaisille yrityksille pääsyyn maailman markkinoille. Muutoksen on arvioitu sisältävän esimerkiksi ohjelmiston hankintamallin muuttumisen ostomallista palvelumalliksi ja liiketoimintamalli muuttumisen lisenssimaksupohjaisesta käytön perusteella veloitettavaksi. Lisäksi ohjelmistoa käytetään ilman asennusta omalle työasemalle Internetin yli ja cloud-toteutuksen tekninen malli tukee esimerkiksi laajennettavuutta, uudelleen käyttöä, ylläpidettävyyttä, ja pääsyä globaaleille markkinoille.

Cloud testing laboratory 2014…