© 2000 hans schaefer slide no. 1 integration between reviews and test can you save test work after...
TRANSCRIPT
© 2000 Hans Schaefer Slide no. 1Integration between reviews and test
Can you save test work after inspections?Self assessment about how you do inspections
Integration between reviews and testing
Hans [email protected]
© 2000 Hans Schaefer Slide no. 2Integration between reviews and test
Can you cut down test after good reviews and inspections?
Can you rely on inspections alone?
What is a good inspection?
How to know?
What to cut down?
© 2000 Hans Schaefer Slide no. 3Integration between reviews and test
Can you rely on inspections alone?
NO!
You need to measure the FINAL quality.
Test finds issues inspections don't find well: • Issues that are hidden in the connections between many
parts.• Performance problems• New errors introduced after inspection• Surviving errors
© 2000 Hans Schaefer Slide no. 4Integration between reviews and test
Cleanroom Software Engineering and Testing
Cleanroom heavily relies on inspections.
Inspections replace unit test. System test replaced by statistical usage testing (software reliability engineering).
Reasoning:
”If you have no chance to test your unit, you will de better inspections!”
But: This has never been verified in large projects.
Conclusion: Cleanroom PLUS traditional testing!
© 2000 Hans Schaefer Slide no. 5Integration between reviews and test
What is a good inspection?
• The right (qualified) people attended• They had time to prepare• Well led meeting• 3 to 7 people• Meeting in chunks of <= 2 hours• Material met entry criteria• Check lists• Concentration on MAJOR issues• Follow up of issues found• People know inspection technique• Defect detection percentage known
Assess yourself!
© 2000 Hans Schaefer Slide no. 6Integration between reviews and test
How to know inspections were good enough? And the results as well?
Inspection database
Check against other inspections
Experience in how testing goes after good inspections - in YOUR organization!
Experience in which defects disappear from testing
© 2000 Hans Schaefer Slide no. 7Integration between reviews and test
What you can cut down after inspections
Defect repair time during testing
Test re-execution (less faults require less repairs and regression test)
Getting the test to execute at all (Start trouble)
Some, but not all unit testing
Other testing only after experience data available
Do more test where inspection found many defects!
© 2000 Hans Schaefer Slide no. 8Integration between reviews and test
Danger
If an inspection finds few defects:
Maybe the software is good?
Maybe the inspection was bad?