method validation and verification
TRANSCRIPT
![Page 1: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/1.jpg)
1
Method validation and verification
W. W. WongSenior Accreditation Officer
HKAS29 July 2009
![Page 2: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/2.jpg)
2
Method Validation and verification
• What is it?• When is it required?• Why is it necessary?• What are required?• How much is adequate?• How should it be done?• Any questions on the questions?
![Page 3: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/3.jpg)
3
Method Validation – what is it
Definition –• validation is the confirmation by
examination and the provision of objective evidence that the particular requirements for a specific intended use are fulfilled (ISO/IEC 17025:2005 cl. 5.4.5.1)
• verification, where the specified requirements are adequate for an intended use (ISO/IEC Guide 99:2007)
![Page 4: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/4.jpg)
4
Method Verification – what it is
• Verification – provision of objective evidence that a given item fulfils specified requirements (ISO/IEC Guide 99:2007)
![Page 5: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/5.jpg)
5
Method Validation – why is it necessary
Quality of test results
Samples
Ref
eren
ce m
ater
ials
Val
idat
ed m
etho
ds
Pro
ficie
ncy
test
ing
![Page 6: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/6.jpg)
6
Method Verification
ISO/IEC 17025 cl. 5.4.2• The laboratory shall confirm that it can
properly operate standard methods before introducing the tests or calibrations. If the standard method changes, the confirmation shall be repeated.
![Page 7: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/7.jpg)
7
Laboratory internal validation and verification
Existing information
Fully validated standard methods (have been studied in a collaborative trail)
Standard methods – amplifications and modifications e.g. new instrument
Standard methods – outside their intended scope
Laboratory – developed and non-standard methods
Laboratory requirement
Verification (Secondary validation)
Validation
Validation
Validation(Primary validation)
![Page 8: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/8.jpg)
8
Method Verification – what are required
HOKLAS SC No. 20 Section 5.4Verification of methods• A laboratory using standard methods has to confirm
that it has the ability to carry out those methods….Verification is usually carried out by comparing the performance data obtained by the laboratory when performing a standard method with those claimed by the same method.
(note: specified requirements include the method performance of the std methods)
![Page 9: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/9.jpg)
9
Method verification
• Released early 2008
• http://www.aoac.org/alacc_guide_2008.pdf
![Page 10: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/10.jpg)
10
Method Verification
• importing a validated method• show that laboratory can do it at its site• demonstrate that laboratory can repeat the
method performance
![Page 11: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/11.jpg)
11
Method Verification
Standard methods shall be verified for:1. the equipment
2. the required reference materials/standard, reagents
3. the environmental conditions
4. testing staff member competence to perform the test
5. capability to achieve the method performance
![Page 12: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/12.jpg)
12
Method Verification
To demonstrate you can repeat the method performance, including:
• Detection limits• Precision• Bias
![Page 13: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/13.jpg)
13
Method Verification –Method detection limit
• Spike matrix blanks at the level close to the method detection limit given in the standard method
• Perform the analysis on the spike matrix blank at least 7 times over a period of at least 3 days
• Calculate the recoveries and the RSD• Compare the values with those given in the
standard method
![Page 14: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/14.jpg)
14
Method Verification –Method detection limit
Factors to consider:• How many matrices are needed? • How are the values obtained compared with
those of the standard method?
![Page 15: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/15.jpg)
15
Method Verification0%
%FA
T
%PROTEIN
%CARBOHYDRATES0%
0%
100%
100%
100%
J. AOAC, 83 (2), 413 (2000)“The Referee”, AOAC Int’l, July 1993
![Page 16: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/16.jpg)
16
Method Verification –Method detection limit
How many food matrices are needed? • Less than validation• Professional judgment needed on the possible
matrix effects on the detection limits• Most difficult food matrices• How far can the light shine?
![Page 17: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/17.jpg)
17
Method Verification –Method detection limit
How are the values obtained compared with those of the standard method?
• RSD not significantly different from std method and
• Mean recovery within acceptable limits
![Page 18: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/18.jpg)
18
Method Verification –Precision
• Perform a precision study by analysing a homogenous sample at least 7 times
• Calculate the std dev• Use F test to determine if there is statistical
significant difference between the std dev found and the std method
• Should use repeatability std dev
![Page 19: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/19.jpg)
19
Method Verification –Precision
- comparison of precision of the two methods
where = repeatability std dev of lab B
= repeatability std dev of std method A if F<F(95%) (νrA,νrB): statistically no significant difference
ASBSF
r
r2
2
=
BSr2
ASr2
![Page 20: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/20.jpg)
20
Method Verification –Precision
- comparison of precision obtained against the required value
The precision of the measurement process is assessed by comparing the within-laboratory std dev under repeatable conditions with the required value of the within-lab std dev
![Page 21: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/21.jpg)
21
Method Verification –Precision
- Computeχc
2 = { sw/σwo}2
Where σwo is the required value of the within-lab std dev
χ2table = χ2
(n-1);0.95 / n-1= 0.95th quantile of the χ2 distribution at degrees of
freedom (n-1) divided by the degree of freedom (n-1)
![Page 22: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/22.jpg)
22
Method Verification –Precision
- Decision
χc2≦χ2
table : No evidence that the process is not as precise as required.
χc2 >χ2
table: Evidence that process is not as precise as required
![Page 23: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/23.jpg)
23
Method Verification –Bias
• To demonstrate the absence of lab bias• Proficiency tests/interlaboratory comparisons • Analysis of CRMs
![Page 24: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/24.jpg)
24
Method Verification –Bias
• Estimate of lab bias is, in itself, uncertain• Choose n such that √sw/n< 0.2sR
• Certified value, µ, is subtracted from the mean of the results, m, to obtain an estimate of the lab bias, Δ
Δ= m - µ• Acceptable if
∣Δ∣<2sD
Where sD is the uncertainty of the measurement process and sD
2 = sL2 + sw
2/n
![Page 25: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/25.jpg)
25
Method Verification –Bias
Given sR2 = sL
2 + sr2
∴sD2 = sR
2 - sr2 + sw
2/nHence, Δ < 2 √(sR
2 - sr2 + sw
2/n)
Which is the acceptability test for Δ
![Page 26: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/26.jpg)
26
Method Verification –Bias
• comparison of results with another laboratory- the means of the two laboratories, y1 and y2, are compared
if ∣ y1-y2∣< √ (2.8σR )2 - (2.8 σr )2(1-1/2n1-1/2n2) ,
then statistically no significant differencewhere σr = repeatability standard deviation
σR = reproducibility standard deviation
![Page 27: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/27.jpg)
27
Method Verification –Bias
• When each lab has obtained only one test result, the absolute difference between the two test results should be tested against the reproducibility limit R=2.8σR.
• If the absolute difference between the two test results does not exceed R, the two test results are considered to be in agreement. ∣ y1-y2∣< 2.8σR
![Page 28: Method validation and verification](https://reader031.vdocuments.site/reader031/viewer/2022021007/62039b3ada24ad121e4b5c8f/html5/thumbnails/28.jpg)
28
Thank you