automating test generation
TRANSCRIPT
-
8/2/2019 Automating Test Generation
1/16
International Conference OnS ft T ti A l i & R i
P R E S E N T A T I O N
Thursday, May 4, 20001:30PM
AUTOMATI NG TEST GENERATI ON TO M INIMIZE
TEST WRI TI NG
Linda MierTaratec Development Corporation
T11
Presentation
Bio
Return to Main Menu
http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
2/1628-Feb-2000 Linda Mier, Taratec Development Corp. 1
Copyright 1996 Dale Carnegie &
Automating TestGeneration to Minimize
Test Writing
Linda Mier
Taratec Development Corp.
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
3/1628-Feb-2000 Linda Mier, Taratec Development Corp. 2
Test Generation
Automation Overview
Automation objectives
When to automate
What to automate
Automation prep work
Automated test writing example
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
4/1628-Feb-2000 Linda Mier, Taratec Development Corp. 3
Objectives of Test
Writing Automation
Reduce test writing/update times
l
Eliminate repetitive typingDecrease the number of errors in
the test
l Missing test cases
l Missing test steps
l Cut-and-paste errors
Standardize test set wording
Ensure requirements coverage
Assist with test documentation
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
5/1628-Feb-2000 Linda Mier, Taratec Development Corp. 4
When to Automate
Test Writing
Multiple test sets
Multiple applications requiringthe same type(s) of testing
Consistent end-user interface
l Predictable application behavior
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
6/1628-Feb-2000 Linda Mier, Taratec Development Corp. 5
What to Automate
Test writing automation depends
on:
l Test step granularity
Keystroke by keystroke
High level information (experienced
testers)
l Test reuse potential
l Best return on investment
Test step numbering
Test setup
Standard test information Text of frequently repeated steps
Test section layout/formatting
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
7/1628-Feb-2000 Linda Mier, Taratec Development Corp. 6
Automation Prep Work
Data evidence requirements
Test set content requirements.
Agreement on standard wording
Requirements to be tested
Test organizationl by application component
l by testing requirement
l by application unit
Material lot in an inventory system
Patient in a Clinical Trial system
Product in a manufacturing system
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
8/1628-Feb-2000 Linda Mier, Taratec Development Corp. 7
Automation Example:Application Being Tested
Access 97 Pharmaceutical
clinical trial applicationl Remote data entry of patient
information
l Separate component for data
validation
No messages during data entry
Requirements based on patient
data validationl Data ranges and consistency
l Missing data
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
9/1628-Feb-2000 Linda Mier, Taratec Development Corp. 8
Automation Example:
Test Layout Requirements
Test number and description
Requirements verified by the test
Test executer information fields
Instructions for testers
l Global - included in each test
Special Instructions for testers
l Unique to that test set
Numbered test steps
l Patient creation and data entry
l Running the validation component
l Verification of data checks
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
10/1628-Feb-2000 Linda Mier, Taratec Development Corp. 9
Automation Example:
Test Writing AutomationDesign (Access 97)
Patients are the primary test
componentl Test writer types in the data
entered into the application for
each patient
l Test writer links each patient to
the requirement(s) proved by that
patient
Tests created by linking patientsto tests
Supports manual test step entry
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
11/1628-Feb-2000 Linda Mier, Taratec Development Corp. 10
Automation Example:Test Writing Automation
Design (Word 97)
Word template divided into
sections required in the test
l Wording standard for each test
included
Imports test content from the
Access 97 databasel Test number and description
l Special instructions
l Patient creation and data entry
l Running the validation component
l Verifying the requirements
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
12/1628-Feb-2000 Linda Mier, Taratec Development Corp. 11
Automation Example:
CoverageReports/QueriesRequirements Coverage
l Requirements by Patient
l Patients by Requirement
Test/Patient Coverage
l Patients by Test
l Tests by Patient
Missing/Unused Components
l Requirements without a link to a
patient
l Requirements not linked to a test
l Patients not linked to a test
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
13/1628-Feb-2000 Linda Mier, Taratec Development Corp. 12
Automation Example:
Test Building Tool Structure
Screen for corrections
Requirements
Data entry System Time
Data entry Screen/Path
Patient data
PatientTypical entry
Data entry System Tim
Data entry Screen/Pat
Typed Test StepsFree-style entry
Test
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
14/1628-Feb-2000 Linda Mier, Taratec Development Corp. 13
Automation Example:Test Writing Main Menu
http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
15/1628-Feb-2000 Linda Mier, Taratec Development Corp. 14
Test Writing Tool:
Summary of Benefits
Decreased typing
l Automatically inserted canned teststep text
Automatically generated
requirement checksEasy creation of new tests by
selecting different patient
combinations
Easily obtained statistics on the
test content/coverage
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/ -
8/2/2019 Automating Test Generation
16/16
Linda Mier
About a year ago, Linda Mier joined the Software Testing Solutions division ofTaratec Development Corp., a consulting organization specializing in regulatedindustries. In the last year Ms. Mier worked with Y2K testing, module testing, useracceptance testing, and testing tool development.
Ms. Mier designed and developed a prototype of an application to automategeneration of user acceptance tests for an Access 97 clinical trial application. Shealso designed, wrote, reviewed, and executed module tests for Presidio RDCclinical trial applications. Additionally, as part of a process improvement team, Ms.Mier created MS Office product templates to automate various module testing andevidence collection activities.
Before working for Taratec, Ms Mier spent about 4 years working withpharmaceutical MES products at Base Ten Systems, Inc. in a Client/Serverenvironment (Win95 and WinNT using Oracle and SQL databases). In addition toworking on all phases of unit and system testing, Ms. Mier also did some factoryand site acceptance testing, on-site customer support, customer training, andcreation/modification of Standard Operating Procedures (SOPs).
Ms. Mier hasnt always worked with PCs, however; she started out in the LargeSystems Performance area at IBM Corp. in Poughkeepsie, NY. Ms Mier worked ona variety of things during her 11 years there, including channel performance, batch
performance and batch workload development for both hardware and MVSoperating system announcements and multi-level cache simulation modeling for theTPF operating system used by the airlines, and she acted as the performance arearepresentative to IBMs GUIDE Users Group.
http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/http://cover.pdf/