bai-tap-2 dynamic static whitebox blachbox-testing

Upload: ho-thi-le-nhung

Post on 06-Jul-2015

404 views

Category:

Documents


0 download

TRANSCRIPT

SWT TeamWork [CTH08B] Bi tp 2

Mn: Software Testing Bi tp 2

TM HIU BLACK BOX TESTING, WHITE BOX TESTING, STATIC TESTING, DYNAMIC TESTING1.BLACK BOX TESTING :L phng php test da trn u vo v u ra ca chng trnh test m khng quan tm ti code bn trong c vit ra sao,bao gm cc c t yu cu(requirements), cc s kin(events). Phng php ny thng dng test chc nng ca chng trnh.

V d : kim tra chc nng ng nhp : c t : nhp username v password ,nu ng th bo thnh cng. Nu sai th bo sai mt khu. INPUT : Username password OUTPUT : Sai username v password. ng username v password.

1

SWT TeamWork [CTH08B] Bi tp 2

C nhiu phng php dnh cho Black Box Testing nhng nhn trung tri qua 3 bc sau: o Phn chia gi tr u vo thnh cc min gi tr khc nhau. o hp cc min gi tr ca cc u vo, mi t hp l 1 test case. o Da trn rng buc gia cc u vo gim bt s lng test case. Cc phng php testing ph bin : o Equivalence Class Partition o Boundary Value Analysis o Cause Effect Graph 1.1 Cc phng php testing ph bin : 1.1.1 Phng php phn on tng ng (Equivalence Class Partitioning): Chia d liu vo thnh cc on, mi on i din cho mt s d liu v vy vic kim th ch thc hin trn i din .Mc ch lm gim s lng test bng cch chn cc tp d liu i din.Phng php ny thng c dng test cc yu cu mc tru tng hn l test theo trng.p dng test mn hnh,menu hay test mc qu trnh.

1.1.2 Phng Php Phn Tch Gi Tr Bin (Boundary Value Analysis) : L trng hp ring ca phng php phn on tng ng (Equivalence Partitioning).Phng php ny thng dng test gi tr bin ca cc gi tr u vo, cc min gi tr. Thng s dng test module chc nng ca chng trnh. V d : Nu min gi tr l thng th gi tr l 0 hay > 0 l khng hp l.

1.1.3 K Thut Cause-Effect Graphing :2

SWT TeamWork [CTH08B] Bi tp 2

Ta thy rng 2 k thut trn d liu u vo c phn loi phn tch. Tuy nhin k i vi k thut Cause-Effect Graphing cho php xc nh ra cc trng hp kim th hiu qu nht ngay c trong lc d liu u vo l kh phn loi thnh cc lp nh trong 2 k thut trn. K thut ny gm 4 bc nh sau : o Xc nh Cause ( iu kin nhp vo) v effect ( l hnh ng) cho mi mt module cn kim nh. o Xy dng th cause-effect. o th c chuyn thnh bng quyt nh. o Nhng phn/lut trong bng quyt nh c chuyn thnh cc trng hp kim th. V d :

Bng quyt nh :

KT LUN :3

SWT TeamWork [CTH08B] Bi tp 2

Li im ca Black Box Testing l kh nng n gin ha vic kim th ti cc mc c nh gi l kh kim th. Yu im l kh nh gi nhng gi tr no cha c kim th hay khng.

2. WHITE BOX TESTING : i vi cch test Black Box Testing th ch quan tm dn gi tr u vo v gi tr u ra c ng khng m khng qun tm n code bn trong ra sao.Nhng i vi cch test White Box Testing khng nhng kim tra gi tr u vo v u ra m cn test da trn code ca chng trnh.Phng php test ny kim tra cht ch hn , to ra cc trng hp th nghim thc hin chng trnh 1 cch logic hn.

C 2 loi test White Box Testing l Control flow v Data flow. 2.1 Control Flow : L vic test da vo cc lnh trong cch ngn ng lp trnh nh lnh tun t,lnh r nhnh(nh if... else...) ,vng lp (for, while, loop). Nh vy nu lp ra cc trng hp test cho ph kn cc cu trc no th coi nh t yu cu.

4

SWT TeamWork [CTH08B] Bi tp 2

2.2 . Data Flow : L tp trung vo kim tra gi tr ca cc bin trong chng trnh Bin s xut hin theo 2 dng: khai bo v gn gi tr Bin s c s dng theo 2 cch: predicate (kim tra iu kin) v computational (tnh ton) Trn thc t, hin thc cch test ny phi xy dng s Control Flow Diagram hoc Data Flow Diagram. Vic ny c th thc hin t ng bng cch phn mm h tr. Sau khi vit cc test case, c th chy cc Coverage Tool xem ph code bao nhiu, ch no cn phi vit thm test case. 2.2.1 Statement coverage

T hnh trn xc nh % s cu lnh c ving thm trong test case. 100% => Mi cu lnh c ving thm t nht 1 ln.5

SWT TeamWork [CTH08B] Bi tp 2

2.2.2 Branch coverage:

Phn trm s nhnh quyt nh ving thm trn test case. 100% => t nht mi nhnh u c ving thm t nht 1 ln. 2.2.3 Path coverage :

Phn trm cc path c ving thm trn test case 100% mi ng u c ving thm t nht 1 ln. Vi 3 cch xy dng coverage ta thy : 100% statement coverage m khng t 100% branch coverage.6

SWT TeamWork [CTH08B] Bi tp 2

100% branch coverage m khng t c 100% path coverage.

3. STATIC TESTING: K thut kim th tnh c s dng tm li sa cha trc khi phn mm c a ra s dng trn thc t; n tri ngc vi k thut kim tra ng (dynamic testing) c p dng cho mt cng vic trong h thng. 3.1. Mc tiu: Sau khi tm hiu module ny, bn s: o Hiu c cc k thut nh gi khc nhau m bn c th p dng cho ti liu hay cc on m. o nh gi cao s khc bit gia xem qua 1 ln, nh gi chnh thc v kim tra. o Hiu th no l k thut phn tch tnh c th pht hin cc li trong cc on m x l o Hiu c 02 s hiu phc tp (lines of code and McCabes metric).7

SWT TeamWork [CTH08B] Bi tp 2

3.2. Cc loi nh gi: Xem xt 1 ln (walk-through), nh gi chnh thc (informal reviews), nh gi k thut (technical reviews) v xem xt k lng (inspections) l cc k thut c bn phi c s dng trong sut qu trnh pht trin phn mm. Nu p cc loi nh gi trn th l im mnh, im yu v v tr ca bn trong chu k pht trin d n. Tt c cc k thut trn u c mt s nguyn tc c bn chung nh sau: o Phng php cu trc l mt qu trnh xem xt. o Hy chc chn bit nhng g ang c xem xt li, mi thnh phn phi c nhng nt c o, cch nhn din ring. o Thay i phi iu khin c cu hnh. o Ngi phn bin phi c s chun b. o Ngi phn bin phi tp trung vo chuyn mn ca mnh. o Phi chc chn l bn ang xt cc sn phm. o Phi: o C nhm phi c trch nhim. o Nhm xem xt ng thc lc ca mnh. o Phn b ng thi gian. o p dng ng cc tiu chun ra. 3.2 Thnh phn v s lng nhm nh gi: Vn vi cc nhm nh cn phi trnh; mang trong ngi thm (c th s dng i kim tra) mang li tm tr thm chu v cc vn . kin thng phn chia nh c hay khng cc tc gi nn tham gia vo mt xem xt. C li th c hai kch bn. T chi tit k thut v thit k phi c kh nng c hiu m khng c s hin din tc gi, mt thanh tra m khng c h kim tra ti liu. Mt l do khc loi tr cc tc gi t vic xem xt l nn c quyn s hu ca cc i trch nhim sn phm v nhm nghin cu cho cht lng ca tt c cc phn phi, duy tr quyn s hu thng qua cc tc gi chng li chy Ngoi ra, bao gm c cc tc gi c th l mt tr gip c gi tr xy dng nhm. Tng t, mt Tc gi cng c th lm sng t nhng hiu lm trong mt ti liu nhanh hn hn mt thnh vin trong nhm, do tit kim cc nhn xt c gi tr thi gian. T mt thc t Tuy nhin quan im, l ng ghi nh rng tc gi l ngi t c kh nng xc nh li trong ti liu. Ngoi ra, bao gm c cc tc gi c th l mt tr gip c gi tr xy dng nhm. Tng t, mt Tc gi cng c th lm sng t nhng hiu lm trong mt ti liu nhanh hn hn mt thnh vin trong nhm, do tit kim cc nhn xt c gi tr thi gian. T mt thc t Tuy nhin quan im, l ng ghi nh rng tc gi l ngi t c kh nng xc nh li trong ti liu.

8

SWT TeamWork [CTH08B] Bi tp 2

3.2.1. 1 Loi, 2 V 3 nh Qu Trnh: nh gi qu trnh l c hai phng php xt nghim hiu qu nht v ph qut v qun l nhu cu m bo rng qu trnh xem xt l lm vic mt cch hiu qu nht c th. Hu ch m hnh cho m hnh qun l l 1,2,3. 1, 2, m hnh 3 l bt ngun t cng vic ca cc bn lm vic u tin ca British Computer Society Chuyn gia nhm li ch trong kim th phn mm v sch m n t cng vic ny; trong Pht trin phn mm Loi 1 th nghim l qu trnh m bo rng sn phm (ti liu, chng trnh, mn hnh thit k, vn th, th tc hoc chc nng k thut) c xy dng theo tiu chun v c nhng tnh nng m chng ti mong ch t tn ca sn phm . l mt th nghim m bo rng sn xut ph hp vi tiu chun, l ni b ph hp, chnh xc, r rng.... Loi 2 th nghim l qu trnh th nghim xem c sn phm ph hp vi yu cu nh xc nh bi u ra ca d n giai on trc v cui cng s k thut ca Yu cu i vi ton b d n. Loi 2 kim tra ngc tm kim v c kim tra sn phm ph hp vi trc ti liu (bao gm c thng tin v... Loi 3 th nghim l hng ti tng lai v l v c im k thut ca qu trnh cp giy chng nhn v th nghim s c thc hin trn sn phm giao nhn. l cu hi yu cu - C th chng ta c th xy dng cc phn phi (th nghim vt liu, ti liu o to, tip theo giai on phn tch ti liu) ? 3.2.2. Tng r sot th tc cho cc ti liu Kim tra nhm s cn th tc chung i vi cc ti liu xem xt li, v iu ny s c th mt phn ln cng vic ca nhm: 1. Thit lp cc tiu chun v nh dng cho ti liu. 2. Kim tra danh sch ni dung. 3. Kim tra danh sch cc ph lc. 4. Theo di ti liu tham kho cc ti liu bn ngoi. 5. Cross kim tra ti liu tham kho trong ti liu. 6. Kim tra cc kt qu chnh xc v cn thit. 7. Xem tng b tr mn hnh chng li tiu chun thch hp, d liu t in, ch bin quy tc v cc tp tin / d liu c bn truy cp. 8. Xem tng b tr bo co vi tiu chun thch hp, d liu t in, ch bin quy tc v cc tp tin / d liu c bn truy cp. 9. Xem xt kin v bo co v andreviews cng vic thc hin trc khi xem xt li ny. 10. Vn bn s xem xt li ton b t cc bo co nh c im ca yu cu cc trang t u ra rng h thng l sn xut. Tt c cc ti liu s cn gim st cn thn. 3.3 Reviews and walk-through: Nhn xt v walkthrough thng peer hot ng tho lun nhm - m khng nhiu tp trung vo vic xc nh li v sa cha, nh chng ta thy. Chng thng9

SWT TeamWork [CTH08B] Bi tp 2

m khng c s ci thin cht lng thng k, m l mt phn thit yu ca Thanh tra. Walkthrough ni chung l mt qu trnh o to, v tp trung vo hc tp v mt n ti liu. nh gi tp trung hn vo s ng thun v mua vo mt ti liu c th. Kim tra khng phi l mt thay th cho wal1cthroughs o to, hoc nh gi cho s ng thun. Trong mt s trng hp, n l mt iu kin tin quyt. Cc quy trnh khc nhau c khc nhau mc ch. Bn khng th mong i loi b nhng li lm c hiu qu vi walkthrough, nh gi hoc phn phi cc ti liu nhn xt. Tuy nhin, trong cc trng hp khc n c th l lng ph Kim tra vn bn, cha nh cu k thut. Chi tiu thi gian tm kim v loi b nhng li lm trong bn cp ln, l sau b i, khng phi l mt tng tt. Trong trng hp ny c th tt hn nhm mc ch cho vn bn nht tr gn ng. Cc hng gio dc c th xy ra trc hoc sau khi kim tra. 3.4 S khc bit gia kim tra v th nghim: Kim tra c th c s dng lu trc khi thc thi m c sn chy th nghim. Kim tra c th c p dng bn sm hn so vi th nghim nng ng, nhng cng c th c p dng sm hn so vi cc hot ng thit k th nghim. Test ch c th c nh ngha khi mt yu cu hoc c im k thut thit k c vit, v c im k thut l ngun bit kt qu d kin ca mt thc nghim. 3.5 Li ch ca thanh tra: kin c chia v vic liu kim tra l mt yu t ng gi ca sn phm bt k "pht trin" qu trnh. Cc nh ph bnh cho rng n rt tn km, n yu cu "tr trc" qu nhiuthi gian v quan liu khng cn thit. ng h cho rng cc khon tit kim cui cng vli ch ln hn chi ph v u t ngn hn l rt quan trng cho lu di tit kim trc tip. Pht trin nng sut c ci thin. Fagan, trong bi vit gc ca mnh, bo co mt s gia tng 23% trong m ha nng sut mt mnh Kim tra bng cch s dng [Fagan, nm 1976, Tp ch H thng IBM, p 187]. ng sau bo co tip tc tng vi vic gii thiu thit k ngi iu tit, o to v thay i m kim sot, theo di v kim tra li Khong thi gian pht trin l gim. Xem xt cc khong thi gian ch pht trin, tit kim in hnh mng cho d n pht trin l 35% n 50%. Chi ph v thi gian thc hin th nghim l gim. Kim tra lm gim s li vn cn ti ch khi th nghim bt u bi v h c loi b giai on trc . Th nghim do chy m hn, c t g li v lm li v giai on th nghim l ngn hn. Ti hu ht cc trang kim tra loi b 50% n 90% ca nhng li lm trong qu trnh pht trin trc khi thc hin th nghim bt u. Chi ph trn i, c gim xung v phn mm tng tin cy. Kim tra c th c d kin s lm gim tng chi ph bo tr h thng do khng gim v ci thin d hiu ti liu, do cung cp mt nhiu hn sn phm cnh tranh. Tit kim gin tip Qun l li ch. Qua kim tra, qun l c th mong i truy cp vo cc s kin lin quan, s liu v phn mm mi trng k thut ca h, c ngha l h s c th xc nh vn trc v hiu c hon tr i ph vi nhng vn ny.10

SWT TeamWork [CTH08B] Bi tp 2

3.6. Chi ph kim tra: Cc chi ph iu hnh mt kim tra c khong 10% - 15% ca s pht trin ngn sch. T l ny cng tng t nh hng khc v phng php xem xt. Tuy nhin, Thanh tra, pht hin li hn cho thi gian mt v cc chi ph u ngun c th c chng minh bng cc li ch ca vic pht hin sm v cc chi ph bo tr thp hn kt qu. Nh cp trc , chi ph kim tra bao gm thm 'ln pha trc "thi gian trong qu trnh pht trin v thi gian tng chi tiu ca cc tc gi vit cc ti liu h bit s c thanh tra. Thc hin v chy Kim tra s bao gm vic lu di chi ph trong cc lnh vc mi. Mt t chc s thy rng thi gian v tin bc i vo: o Gim nh hng u o to. o Qun l o to. o Qun l cc nh lnh o Thanh tra. o S liu phn tch o Th nghim vi cc k thut mi c gng ci thin kt qu thanh tra. o K hoch, kim tra v p ng cc hot ng: Kim tra ton b qu trnh . o Ci thin cht lng: cng vic ca cc nhm ci tin qui trnh. Cng ty cng c th tm thy n hu hiu xem xt cc cng c my tnh cho ti liu hng dn v kim tra tnh nht qun. Mt u t tt c th l ci thin phng hp hoc cch m cc thnh vin ca on thanh tra c th tp trung trong thi gian kim tra. 3.7 Cc bc kim tra sn phm: Qu trnh kim tra c bt u vi mt yu cu kim tra ca tc gi hoc ch s hu ca mt ti liu sn phm cng vic. Cc nh lnh o Thanh tra kim tra cc ti liu chng li cc tiu chun nhp cnh, gim xc sut ca lng ph ngun lc vo mt sn phm s tht bi. Cc mc tiu kim sot v chin thut c ln k hoch. Thc hnh chi tit c quyt nh thun v lnh o pht trin mt k hoch tng th cho i bng. Mt cuc hp Kickoff c t chc m bo rng nhng ngi kim tra nhn thc ca h vai tr c nhn v cc mc tiu cui cng ca qu trnh thanh tra. ang lm vic c lp trn sn phm, ti liu s dng ngun cc vn bn, quy nh, th tc v danh sch kim tra. Li tim nng c xc nh v ghi li. Mt cuc hp c triu tp khai thc g, trong li v cc vn tim nng yu cu gii trnh, xc nh bng kim tra c nhn, c lu li. Cc c by gi lm vic nh mt nhm nhm pht hin li hn. V cui cng xut phng php ci tin quy trnh t c lu li. Mt bin tp vin (thng l tc gi) c cho ng nhp ca vn gii quyt. Li c hin nay phn loi l nh vy v yu cu cho php thc hin vic sa v ci tin sn phm c thc hin cho ch s hu ca ti liu. Ch thch c th c thm vo trnh hiu sai. Cc bin tp vin cng c th lm thm ci tin qui trnh xut. Lnh o bo m rng cc bin tp vin hnh ng sa cha tt c cc li c bit n, mc d cc nh lnh o khng cn kim tra sa cha thc t.11

SWT TeamWork [CTH08B] Bi tp 2

Quy trnh xut cnh c thc hin bi cc nh lnh o Thanh tra nhng ngi s dng ng dng chung v c th tiu chun xut cnh. Qu trnh kim tra c ng li v cc sn phm lm sn c vi mt c tnh ca cc li cn li trong "nhn cnh bo".

4. DYNAMIC TESTING: 4.1 Tng quan: Gii thiu tng ca k thut th nghim trong trng hp l mt thit k. Ni chung, nhng phn loi ny l kim tra v k thut, chc nng hoc cu trc. Li th ca s dng phng php thit k ny c chng minh l n cung cp cc chc nng kim tra thng minh hn v hiu qu; c ngha l xc nh th nghim trn mt cch tip cn hon ton trc quan. Bn s c bit hai chc nng k thut v hai kt cu k thut c th; c bit c rt nhiu k thut khc c th c p dng kim tra thit k trn trong cc trng hp. 4.2 Mc ch: Sau khi tm hiu cn k v kim th ng, bn s: Hiu c s khc bit gia Black-box testing (kim th chc nng) v Whitebox testing (kim th cu trc). Hiu c cch s dng phn vng tng ng v gi tr gii, thit k trng hp th nghim. nh gi cao vic s dng th nghim bng cch chuyn trng thi. Hiu c ngha ca kim tra bo co v kim tra chi nhnh. Bit rng tt c nhng k thut th nghim u c th c b sung bi li on. Cc k thut chng ta cp ti l m t nhng im mnh v im yu ca n. Mt nguyn tc hu ch l nu bn ang gp kh khn trong vic p dng mt k thut c bit cho mt vn th nghim th c l bn nn th mt k thut khc nhau. 4.3 Chc nng kim tra k thut: K thut kim tra chc nng thng c gi k thut kim tra "black-box" l ph bin, ni nm na l lm kim tra hp en. Mt k thut xem xt cc chc nng s gip cc trng hp th nghim thit k da trn chc nng ca thnh phn hoc h thng c th nghim, m khng nht thit phi hiu chi tit c bn ca phn mm thit k. Xem xt chc nng ca h thng kim tra, xc nh yu t u vo v kt qu d kin. K thut kim tra kt cu i khi c gi l k thut white-box, s dng rng ri i vi trng hp kim tra cu trc thit k. Kt cu k thut kim tra gip trng hp th nghim thit k da trn cu trc ni b v thit k cc thnh phn hoc h thng c12

SWT TeamWork [CTH08B] Bi tp 2

th nghim. Hy nhn vo code, c s d liu c t k thut, d liu m hnh, xc nh u vo th nghim v kt qu mong i. S khc bit gia en v kim tra hp trng l g? LOI Black Box White Box DA VO Yu cu Chc nng Cu trc bn trong C S DNG BI Ngi kim th c lp Ngi s dng Ngi pht trin Ngi thit k THCH HP CHO Kim th h thng Kim th s chp nhn n v kim tra Kim th lien kt

4.4 Tng kt: Dynamic tesing l phng php kim th phn mm thng qua vic dng my chy chngtrnh kim tra trng thi ca chng trnh. l kim th da trn cc kim th xc nh bng s thc hin cc i tng kim th hay chy cc chng trnh. Kim th ng - kim tra cch thc hot ng ca m lnh, tc l kim tra s phn ng vt l t h thng ti cc bin lun thay i theo thi gian. Trong kim th ng, phn mm phi thc s c bin dch v chy. Kim th ng thc s bao gm lm vic vi phn mm, nhp cc gi tr u vo v kim tra xem liu u ra c nh mong mun hay khng. Cc phng php kim th ng gm c kim th Unit Unit Tests, kim th tch hp Intergration Tests, kim th h thng System Tests v kim th chp nhn sn phm Acceptance Tests.

13