Abd Azis Bin Bon Cao Jing

Edward Bauer

Herman Bin Md Tahir

Jongkwan Lee

Magnus Ohlson

Muhammad Azam Bin Alias

Risto Nevalainen Susan Burgess

Ton van Bergeijk

Adalberto Crespo

Celestina Bianco Eric Gauthier Hohaeng Cho

Juichi Takahashi

Manikandan K

N Swaminathan Rolf Ziegler

Sylvia Veeraraghavan

Tristan Brown

Alistair Walker Cerys Giddings Fernando Gebara Filho

Hyung jin Yoon

Jung-hwan Kim

Manus Chakraborty

Nathalie van Delft

Satomi Yoshizawa

Tafline Ramos (Murnane)

Tsuneo Yamaura

Alphonse PhilipeCerys Willoughby Francois Coallier Ian Hurst

Kazuo Yabuta

Mariye Akkaya Ogawa Kiyoshi

Satoshi Masuda Tan Liqun Ursula Parker

Amiruddin Jaafar Sidek Chai Afeng

Francois Darphin

Ine Lutterman

Keerthishankar K N

Mastura Abu Samah Ola Perman

Shankaranarayanan G A Terry Rout

Vijay Sampath

Anne Mette Hass Cheng (Kevin) Geng Gary Roedler James Moore

Keum-Ran Lee Matt Mansell Ossi Taipale Shinji Iwata

Theresa Hunt Wonil Kwon

Arun Kumar Melkote

Cheong Jeong Seo Grantham Daniels Javier Tuya

Klaudia Dussa-Zieger

Matthias Daigl

Patricia Huyos

Soo-yeon Lee

Thomas George

Yasuhara Nishi

Atsushi Mitomi

Cheryl George

Guizhi (Tracy) Yang

Jean-Louis Michel

Kouichi Akiyama

Matthias Rasking

Paula Angeieri

Steve Wilsher

Thomas Kurihara

Yu-Whoan Ahn

Barbara Huisman Cheryl JonesGustavo Valencia Jim Moore Kwangik Seo Michael Crerar Qin Liu Stuart Reid Tim Archer Yuji Shinoki

Beatrix Barafort

Dan-Hyung Lee Hack-Youp Noh Jon Hagar Kwanho Kim Moohee Han

Radoslaw Hofman SuJin Choi

Tohru Matsuodani

Yumoto Tsuyoshi

Boris PozinDnyanada Wagh

Hareton Leung

Jonathan Earthy Leon Gerber

Magnus Ohlson

Ricardo Cristalli Sunny Kwon Tom Wissink

Liliana Gomez Arenas

Alistair Walker, Alphonse Phillipe, Anne Mette Hass, Jon Hagar, Matthias Daigl, Qin Liu

Stuart Reid, Sylvia Veeraraghavan,Tafline Ramos (Murnane), Tom Wissink, Ursula Parker, Wonil Kwon

PROCESS

BS 7925-1

BS 7925-2 IEEE 829

Concepts & Vocabulary

Part 1

ISO/IEC 29119 –Structure

ProcessAssessment

‘Part 5’

TestingTechniques

Part 4

Documentation

Part 3Part 2

Processes

Actually ISO/IEC 33063

Part 1 Software Testing Concepts

UPDATED PART 1

SOFTWARE TESTING CONCEPTS

Scope, Conformance, Normative References

TESTING IN DIFFERENT LIFE CYCLE MODELS

ROLES AND RESPONSIBILITIES IN TESTING

ANNEXES – Metrics, Examples, Bibliography

Static Testing

Static Analysis

Reviews, Inspections, etc.

REF: IEEE 1028

Part 1 view on heuristics

“5.1.3 Testing as a Heuristic In engineering (and software engineering) a heuristic is an experience-based (trial and error) method that can be used as an aid to problem solving and design. However, while heuristics can be used to solve problems, they are fallible in that sometimes they may not solve, or only partially solve, a problem.

“Recognition that the manner in which testing is undertaken may be fallible allows us to mitigate the risk of an ineffective test strategy by employing multiple test strategies.”

PART 2 - BEFORE

TEST MANAGEMENT PROCESSES

ORGANIZATIONAL TEST PROCESS

DYNAMIC TEST

PROCESSES

STATIC TEST

PROCESSES

PART 2 - AFTER

TEST MANAGEMENT PROCESSES

ORGANIZATIONAL TEST PROCESS

DYNAMIC TEST PROCESSES

Part 2 – Test Process

X

Part 3 – Test Documentation

PART 3

TEST DOCUMENTATION

ANNEXESEXAMPLES

Scope, Conformance,

Normative References

Agreed text based on IEEE 829 (making it normative)

Part 3 Test Documentation

Part 3 Test Documentation

Part 3 Test Documentation

• Part 5 Keyword Driven Testing

• Part 6 ISO/IEC 33063Process Assessment Model for Software Testing

• Agile extension?!

Washington 2010• Vote 1: Static testing is a part of

testing. • For: 6 (countries voted for:

Australia, China, Denmark, India, South Korea, Sweden)

• Against: 4 (countries voted against: Canada, Japan, South Africa, USA)

• Abstain: none• Majority is for. Static testing is a

part of testing.• Vote 2: Inspections are a separate

approach (not part of testing). • For: 4 (countries voted for:

Canada, Japan, South Africa, USA) • Against: 5 (countries voted

against: Australia, China, Denmark, India, South Korea)

• Abstain: 1 (Sweden)• Majority is against. Inspections

are not a separate approach (i.e. inspections are a part of testing).

ISO Liaisons• V&V Study Group• WG4 (Tools NWIP)• WG7 (12207/Static Testing)• WG10 (Test Process Assessment)• WG42 (Architecture Evaluation NWIP)• DIN (Keywords NWIP)• WG6 (Metrics/Definitions)• Framework for Product Quality Achievement SG• System Integration SG

Liaison with TMMi

Benefits of a liaison with TMMi:• Free marketing of the 29119 standard by

TMMi, which would be a new market for WG26• The opportunity for sales of the 29119 standard

to members of the TMMi community and users of TMMi material

• Access to experts from TMMi to contribute to and comment on 29119standards

Other Liasons

• European Telecommunications Standards Institute– Methods for Testing Specifications– Free marketing of the 29119 standard by ETSI to a

market of security testers who may not have visibility of the standard at present

• ISTQB– Request, by Rex Black, in November 2008 but not

finalised then. Re-proposed in November 2014

Petition

To the President of the International Organization for Standardisation,

We, the undersigned, hereby petition the International Organization for Standardisation to suspend publication of ISO/IEC/IEEE 29119-4 and ISO/IEC/IEEE 29119-5, and to withdraw ISO/IEC/IEEE 29119-1, ISO/IEC/IEEE 29119-2 and ISO/IEC/IEEE 29119-3.

It is our view that significant disagreement and sustained opposition exists amongst professional testers as to the validity of these standards, and that there is no consensus (per definition 1.7 of ISO/IEC Guide 2:2004) as to their content.

The working group discussed the „Stop 29119‟ campaign

• The working group agreed that the article that Stuart published on the softwaretestingstandard.org website rebutting the arguments of the 29119 campaign was a suitable response to the campaign.

• The working group agreed that it would be beneficial to upload links and documents to the softwaretestingstandard.org website that debunk the myths that are being spread on the standards and on the working group by the campaigners.