requirements verification and validation on a global · pdf filerequirements verification and...
TRANSCRIPT
![Page 1: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/1.jpg)
Requirements Verification and Validation on a Global Project
![Page 2: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/2.jpg)
Requirements Verification and Validation on a Global Project
GE Healthcare ITGary Greenberg, CSQA, [email protected]
![Page 3: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/3.jpg)
Would you tell me please, which way I ought to go from here? That depends a good deal on where you want to get to, said the cat. I don't much care where, said Alice. Then it doesn't matter which way you go, said the cat.
Lewis Carroll, Alice in Wonderland, Chapter 6. quoted by Tom Gilb, Competitive Engineering(Illustration by Sir John Tenniel)
![Page 4: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/4.jpg)
Presentation Objectives
• Requirement types and how to use them
• Techniques for test case coverage of requirements
• Recommendations for success
![Page 5: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/5.jpg)
Agenda
Definitions
Project Overview
Requirement Types
Coverage
Keys to Success
![Page 6: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/6.jpg)
Definitions (CSQA CBOK)
Verification
– Verification ensures that the system (software, hardware, documentation, and personnel) complies with an organization’s standards and processes, relying on review of non-executable methods
Validation
– Validation physically ensures that the system operates according to plan by executing the system functions through a series of tests that can be observed and evaluated
![Page 7: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/7.jpg)
Definitions (CSQA CBOK)
Verification
– All QC activities throughout the life cycle that assure that interim product deliverables process their inputs in accordance with specifications and standards.
Validation
– Any activity that helps assure that the end product (e.g., system) under defined operating conditions meets its currently approved requirements and expectations.
![Page 8: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/8.jpg)
Definitions (CMMI and Six Sigma)
Verification
– Verification answers the question, “Was the product built right?”
Validation
– Validation answers the question, “Was the right product built?”
![Page 9: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/9.jpg)
Definitions (FDA)
Verification
– Verification means confirmation by examination and provision of objective evidence that specified requirements have been fulfilled
Validation
– Validation means confirmation by examination and provision of objective evidence that the particular requirements for a specific intended use can be consistently fulfilled
![Page 10: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/10.jpg)
Definitions
Which definition to follow?
Focus on the needs. Be consistent with your organization.
"In theory there is no difference between theory and practice. In practice there is."
Yogi Berra
![Page 11: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/11.jpg)
Project Overview
PACS: Picture Archiving and Communication System• In medical imaging, picture archiving and communication systems (PACS)
are computers or networks dedicated to the storage, retrieval, distribution and presentation of images…including ultrasound, magnetic resonance, PET, computed tomography, endoscopy, mammograms, DR/CR etc.
Headline: GE wins £110m PACS contract for South of Englandhttp://www.e-health-insider.com/News/940/ge_wins_%C2%A3110m_pacs_contract_for_south_of_england
• “GE Healthcare has signed with Fujitsu Services Ltd to provide Picture Archiving and Communications System (PACS) across the whole of the Southern region of the English National Health Service under the National Programme for IT (NPfIT)…”
• “…GE Healthcare should install PACS in the 72 hospitals run by 42 NHS hospital trusts across the South of England…”
![Page 12: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/12.jpg)
Project Overview
International Project
Government Regulations
Sub-Contract
Certification Required
Test Witnessing
New Processes
Significant Penalty Potential
![Page 13: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/13.jpg)
Requirement Types
Process
User/System
Features
Use Cases
Contractual
Test Areas
![Page 14: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/14.jpg)
Unit Test Areas
• Data and data input handling
• Data display formatting
• Screen layout
• Max/Min values
• Context data through screen navigation
• Error handling and reporting
• Database content and locking
• Data Integrity at the data commit point
![Page 15: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/15.jpg)
System Test Areas• End to end cross system data and process flows
• Data integrity across the system
• Continuity of processing across the system
• Systematic prevention of potentially damaging processes
• Max/Min value handling across the system
• Business process exception handling
• Use of simulated live data
• Interface testing
• Volume testing
• Security
• Installation and configuration
• Usability testing
![Page 16: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/16.jpg)
Coverage
Process/Contractual Requirements:• Documentation
• Test Phases
• Defect Tracking
• Results Reporting
Proof of Coverage:• Document Reviews
• Official Testing Announcements
• Defect Reviews
• Test Witnesses
![Page 17: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/17.jpg)
Coverage
User/System Requirements:• Requirements/Design Documentation
• Typically includes Features and Use Cases
Proof of Coverage:• Traceability Matrix
Requirement 1 Requirement 2 Requirement 3
Test 1 X
Test 2 X
Test 3 X
Test 4 X
![Page 18: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/18.jpg)
Coverage
Test Areas:• Can be used with or without defined functional requirements
• Cover at the requirement or feature level
Proof of Coverage:• Traceability Matrix
Feature Test Areas
New UI Undo Screen Layout Security Data Integrity
Test 1 X X
Test 2 X X
Test 3 X X
Test 4 X X
![Page 19: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/19.jpg)
Challenges
• Vague requirements
• New processes
• Late involvement
• Initial pessimism
![Page 20: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/20.jpg)
Keys to Success
• Plan a strategy for execution
• Do your part correctly
• Communicate
• Management support
![Page 21: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/21.jpg)
Presentation Objectives
Requirement types and how to use them
Techniques for test case coverage of requirements
Recommendations for success
![Page 22: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/22.jpg)
Questions?
![Page 23: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/23.jpg)
1 /
GE /
Requirements Verification and Validation on a Global Project
Requirements Verification and Validation on a Global Project
GE Healthcare ITGary Greenberg, CSQA, [email protected]
Would you tell me please, which way I ought to go from here? That depends a good deal on where you want to get to, said the cat. I don't much care where, said Alice. Then it doesn't matter which way you go, said the cat.
Lewis Carroll, Alice in Wonderland, Chapter 6. quoted by Tom Gilb, Competitive Engineering(Illustration by Sir John Tenniel)
![Page 24: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/24.jpg)
2 /
GE /
Presentation Objectives
• Requirement types and how to use them
• Techniques for test case coverage of requirements
• Recommendations for success
Agenda
Definitions
Project Overview
Requirement Types
Coverage
Keys to Success
Definitions (CSQA CBOK)
Verification
– Verification ensures that the system (software, hardware, documentation, and personnel) complies with an organization’s standards and processes, relying on review of non-executable methods
Validation
– Validation physically ensures that the system operates according to plan by executing the system functions through a series of tests that can be observed and evaluated
![Page 25: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/25.jpg)
3 /
GE /
Definitions (CSQA CBOK)
Verification
– All QC activities throughout the life cycle that assure that interim product deliverables process their inputs in accordance with specifications and standards.
Validation
– Any activity that helps assure that the end product (e.g., system) under defined operating conditions meets its currently approved requirements and expectations.
Definitions (CMMI and Six Sigma)
Verification
– Verification answers the question, “Was the product built right?”
Validation
– Validation answers the question, “Was the right product built?”
Definitions (FDA)
Verification
– Verification means confirmation by examination and provision of objective evidence that specified requirements have been fulfilled
Validation
– Validation means confirmation by examination and provision of objective evidence that the particular requirements for a specific intended use can be consistently fulfilled
![Page 26: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/26.jpg)
4 /
GE /
Definitions
Which definition to follow?
Focus on the needs. Be consistent with your organization.
"In theory there is no difference between theory and practice. In practice there is."
Yogi Berra
Project Overview
PACS: Picture Archiving and Communication System• In medical imaging, picture archiving and communication systems (PACS)
are computers or networks dedicated to the storage, retrieval, distribution and presentation of images…including ultrasound, magnetic resonance, PET, computed tomography, endoscopy, mammograms, DR/CR etc.
Headline: GE wins £110m PACS contract for South of Englandhttp://www.e-health-insider.com/News/940/ge_wins_%C2%A3110m_pacs_contract_for_south_of_england
• “GE Healthcare has signed with Fujitsu Services Ltd to provide Picture Archiving and Communications System (PACS) across the whole of the Southern region of the English National Health Service under the National Programme for IT (NPfIT)…”
• “…GE Healthcare should install PACS in the 72 hospitals run by 42 NHS hospital trusts across the South of England…”
Project Overview
International Project
Government Regulations
Sub-Contract
Certification Required
Test Witnessing
New Processes
Significant Penalty Potential
![Page 27: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/27.jpg)
5 /
GE /
Requirement Types
Process
User/System
Features
Use Cases
Contractual
Test Areas
Unit Test Areas
• Data and data input handling
• Data display formatting
• Screen layout
• Max/Min values
• Context data through screen navigation
• Error handling and reporting
• Database content and locking
• Data Integrity at the data commit point
System Test Areas• End to end cross system data and process flows
• Data integrity across the system
• Continuity of processing across the system
• Systematic prevention of potentially damaging processes
• Max/Min value handling across the system
• Business process exception handling
• Use of simulated live data
• Interface testing
• Volume testing
• Security
• Installation and configuration
• Usability testing
![Page 28: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/28.jpg)
6 /
GE /
Coverage
Process/Contractual Requirements:• Documentation
• Test Phases
• Defect Tracking
• Results Reporting
Proof of Coverage:• Document Reviews
• Official Testing Announcements
• Defect Reviews
• Test Witnesses
Coverage
User/System Requirements:• Requirements/Design Documentation
• Typically includes Features and Use Cases
Proof of Coverage:• Traceability Matrix
Requirement 1 Requirement 2 Requirement 3
Test 1 X
Test 2 X
Test 3 X
Test 4 X
Coverage
Test Areas:• Can be used with or without defined functional requirements
• Cover at the requirement or feature level
Proof of Coverage:• Traceability Matrix
Feature Test Areas
New UI Undo Screen Layout Security Data Integrity
Test 1 X X
Test 2 X X
Test 3 X X
Test 4 X X
![Page 29: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/29.jpg)
7 /
GE /
Challenges
• Vague requirements
• New processes
• Late involvement
• Initial pessimism
Keys to Success
• Plan a strategy for execution
• Do your part correctly
• Communicate
• Management support
Presentation Objectives
Requirement types and how to use them
Techniques for test case coverage of requirements
Recommendations for success
![Page 30: Requirements Verification and Validation on a Global · PDF fileRequirements Verification and Validation on a Global Project ... Alice in Wonderland, ... • Document Reviews](https://reader031.vdocuments.site/reader031/viewer/2022022419/5a76756d7f8b9aa3688d3ee8/html5/thumbnails/30.jpg)
8 /
GE /
Questions?