5b routine tests with test weights - iffiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf ·...

28
Routine Testing with Test Weights

Upload: vocong

Post on 12-Mar-2018

218 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

Routine Testing with Test Weights

Page 2: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

2

FDA – Questions and Answers on cGMP‘s

http://www.fda.gov/cder/guidance/cGMPs/

Supplier`s Question“Many leading analytical balance manufacturers provide built-in "auto calibration" features in their balances. Are such auto-calibration procedures acceptable instead of external performance checks? If not, then what should the schedule for calibration be?”

FDA AnswerExternal performance checks still have to be carried out, but less frequently. Risk analysis (criticality and tolerance of the process) and frequencyof use determine the frequency of performance checks. The calibration of an “auto-calibrator” should be periodically verified –usual frequency is once per year - using […] traceable standards.

Page 3: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

3

Our Experience put into Practice

Higher Risk

⇒More Testing

Impact (for business and for consumer)

Wei

ghin

gac

cura

cy

low medium high

1 %

0.1 %

0.01 %

10 %

Page 4: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

4

Which tests should I carry out to minimize my risk ?

Risik Management

Let us look at the parameters that reallyinfluence your weighing results. Werecommend that you test only therelevant parameters.

Page 5: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

5

Repeatability (RP)

Sensitivity Offset (SE)

Linearity Deviation „Nonlinearity“ (NL)

Eccentric Load Deviation (EC)

Readability

Parameters influencing Weighing Accuracy

Page 6: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

6

Rel

ativ

e E

xpan

ded

Wei

ghin

gU

ncer

tain

ty[%

]Influence of Weighing Parameters on Accuracy

0.00001

0.0001

0.001

0.01

0.1

1

0.01 0.1 1 10 100 1000

U_totU_RPU_ECU_NLU_SE

Model XP204: Individual Uncertainty Contributions (@k=2)

Sample Mass [g]

Page 7: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

7

Repeatability: Dominant influencing factor near the lowend of the measurement range

Sensitivity and eccentricity:Dominant influencing factors near the upperend of the measurement range

Nonlinearity:Not dominant throughout the wholemeasurement range

Influence of Weighing Parameters on Accuracy

Page 8: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

8

All User Tests can be done with 2 Weights

Weight 1: Largest OIML/ASTM weight which isbelow the balance capacity

Weight 2: Largest OIML/ASTM weight whichequals or is below 5% of the capacity

XP205: XP4002S:2000 g and 200 g200 g and 10 g

Page 9: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

9

Sensitivity [SE]

Indication

Load

• Ideal characteristic curve

• Characteristic curve withsensitivity deviation

Example: XP205

The calibration of sensitivity is most efficient if done near the upperend of the measurement range

Weight 1:200g F2

Page 10: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

10

Sensitivity [SE]For even smaller test weights, sensitivity calibration is useless

- The absolute sensitivity deviation is very small and very difficult if impossible to detect- Near the lower end of the measurement range, the effect of repeatability is dominant

See e.g. USP <41>: For small loads, the determination of measurementuncertainty is executed by means of a repeatability test

Indication

Load

• Ideal characteristic curve

• Characteristic curve withsensitivity deviation

Page 11: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

11

Sensitivity TestsTest sensitivity with a test weight close to nominal capacity (1).

Using a smaller test weight (a) results in a smaller offset, which is partially disturbed by repeatability (pink band).

Using an even smaller test weight (b) results in the sensitivity offset being buried entirely in the deviations of repeatability.

Load

• Ideal characteristic curve

• Characteristic curve withsensitivity deviation

1ab

Best

Feasible

Wrong

Page 12: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

12

Repeatability Test at 5% of weighing range

Indication

Load

Standard deviation of the repeatability

Lower end (< 5%) of measurementrange: Repeatability almost constantWeight 2

Repeatability is almost constant at the lower end of the measurement range. That is why the weight 2 can be used to determine the minimum weight, which is of course much smaller than weight 2.

Page 13: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

13

Repeatability is constant at the lower end

Page 14: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

14

Nonlinearity [NL]

Nonlinearity normally doesnot play a dominant role foranalytical and low-loadprecision balances and isnegligible for small netloads, so that the usernormally does not have to test nonlinearity.

Nonlinearity is assessed in the framework of theservice by an accreditedservice technician.

Indication

Load

Page 15: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

15

Eccentricity [EC]

Eccentricity errors can be minimized by use of specialaccessories as e.g. ErgoClips

Page 16: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

16

Frequency of User Tests

Higher Risk

⇒More Testing

Impact (for business and for consumer)

Wei

ghin

gac

cura

cy

low medium high

1 %

0.1 %

0.01 %

10 %

Page 17: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

17

Test weights for User Tests

Weight 2 Weight 1Weight 1 Weight 2

( )If required

Page 18: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

18

CarePacs for Routine Testing

User BenefitsCost savings – only two weights rather than entire weight set

Time savings – easy and quick tests supported by METTLER TOLEDO SOP’s

Option to add 3rd weight for specific testing

Ergonomically designed weight handling accessories included

Page 19: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

19

Frequency of User Tests: Sensitivity

Sensitivity calibration is an integral part of the functional control of a measurement device

Sensitivity tests are very simple and fast

For a balance with activated FACT, sensitivity calibrations withexternal weights can be carried out less frequently

Page 20: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

20

Frequency of User Tests: Repeatability

The repeatability is important for the determination of the minimumweight

In many cases, economic and safety reasons play an important rolefor the determination of the minimum weight (weighing of precioussubstances; flavor of food, etc.)

Some regulations as e.g. USP explicitely require the determinationof minimum weight

Page 21: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

21

Frequency of User Tests: Eccentricity

Eccentricity may play a role if the tare vessel is removed for filling;The tare may be placed on a different location of the weighing pan

Eccentricity may also be important when larger amounts are weighed in, with the tare vessel being placed non-centric on the pan

The use of accessories such as ergo clips minimizes eccentricity errors, in that case it is enough if eccentricity tests are carried out by the MT service technician.

Page 22: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

22

Frequency of User Tests: Nonlinearity

The influence of nonlinearity on the weighing result is often negligible

The determination of nonlinearity is time consuming, since not onlyone or two weights but a whole set of weights have to be used

For almost all of the cases, it is justified to leave the determination of nonlinearity to the service techician

For higher risk, the calibration performed the service technician shallbe carried out more frequently; this calibration includes nonlinearity

Page 23: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

23

Example of a GWP® Recommendation

Page 24: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

24

Test Tolerances

Control limit exceeded: Balance has to be markedas „out of control limits“ and shall not be usedanymore. MT has be contacted.

Warning limit exceeded: No immediate actionnecessary, but balance has to be kept undersurveillance

GWP SOP‘s for Routine Testingprovide more information for the user

Page 25: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

25

SOP‘s for Routine Testing

GWP SOP‘s for Routine Testingprovide more information for the user

Page 26: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

26

Example of a GWP® Recommendation

The weight classes are chosen so that theuncertainty of the weights can be neglectedcompared to the process accuracyrequirements.

Page 27: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

27

Straightforward routine testing with GWP®

Page 28: 5b Routine Tests with Test Weights - IFFiff.nu/_files/per/gwp2009riskbasedroutinetesting2.pdf · “Many leading analytical balance manufacturers provide built-in ... METTLER TOLEDO

Routine Testing with Test Weights