evaluating out of tolerance instruments webinar
TRANSCRIPT
![Page 1: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/1.jpg)
Webinar
January 21, 2015
Presenter: Phil Mistretta, Metrology Manager
As-Found: Out-of-Tolerance ….
…now what do I do?
![Page 2: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/2.jpg)
What’s the Big Deal about Out-of-Tolerance Equipment?
• There is additional risk to all products on which it was used
• The potential risk can lead to dangerous situations and additional business costs
• So where do you turn for guidance?
![Page 3: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/3.jpg)
Objectives
1. Practical guidance on evaluating Out-of-Tolerance conditions through a systematic approach to help concentrate your efforts to identify those areas that will need further analysis.
2. Key elements in developing a Measurement Assurance Program which will make OOT evaluations quicker and easier
BonusGood Metrology Practice (GMetP) tips
![Page 4: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/4.jpg)
Calibration
• Lets define a few things ……
• Calibration is ... a comparison to a metrology laboratory standard of known performance and documented uncertainty, to the unknown behavior of a unit submitted for calibration
• When it fails expected performance, non-compliant, Out-of-Tolerance (OOT)
![Page 5: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/5.jpg)
Traceability
![Page 6: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/6.jpg)
Statement of Compliance
![Page 7: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/7.jpg)
Out-of-Tolerance Investigation
1. What – Review the calibration certificate in detail
2. When – Determine the time frame that needs to be examined
3. Where – Determine where the instrument was used
4. How – Determine what the instrument was to measure
5. Mechanics / mathematics of the evaluation
![Page 8: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/8.jpg)
What
• What Functions / Parameters?• What Range?• What test point?• How many OOT Test Points?• Was the entire Range OOT?• Was the a linearity issue?• Was it just the Zero point?• Was it just the Full Scale point?• Are there any test point at the limits?• Are there any test point just in-side the limits?
![Page 9: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/9.jpg)
What - Example
Range: -10°C to 160°C
Accuracy: ± 0.06°C
OOT: 2 points, 100°C and 150°C
![Page 10: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/10.jpg)
When
• What time frame do I need to investigate?• When was it last KNOWN to be in-tolerance?• Is there any measurement data to support a shorter time
frame?• Are there any Preventative Maintenance documents?
• GMetP Tip• Document, document, document• Process control charts• Mid-cycle checks, inter-comparisons, cross-checks• Calibration Interval Change Policy• ……..Document
![Page 11: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/11.jpg)
When - ExampleLast know In-Tolerance Date: As-Left date of Previous CalibrationFrom: January 5, 2014To : January 15, 2015
GMetP TipDocument any time the unit is removed from service
![Page 12: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/12.jpg)
Where
• Where was the unit used during the time frame?• What department?• What area?• What product line?
• GMetP Tip• Area-ID-Location• Rack mounted equipment does not walk• 5S / Visual Management – shadow boards• Tool Cribs – Sign-Out, Sign-In• Electronic tracking, Bar codes, RF ID tags, etc• Work Station or Bench assignments
![Page 13: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/13.jpg)
Where - Example
• Where: the unit was used in the Thermometry Lab Only
![Page 14: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/14.jpg)
How
During the time frame in question, in all locations where it was used, for the OOT Parameters, Ranges Test Points…
• Check end user procedures?
• Check work Instructions?
• Check Engineering Specifications?
• Check Process Documentation?
• Check All Revision of the documents?
![Page 15: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/15.jpg)
How - Example
• This unit is called out by Calibration Procedure CP-0303 R3, and CP-0310 R0
• CP-0303 R3 states this unit is used to monitor a 25°C Bath
• CP-0303 R3 is dated 1/1/2010
• CP-0310 R0 states this unit is used to monitor a 100°C Bath
![Page 16: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/16.jpg)
Analysis
• We know:– What
– When
– Where
– How
• Assessment of error – did the error impact product?
• Magnitude and Direction of error
• Error Impact on Product
![Page 17: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/17.jpg)
Analysis - Example
We know:– What: All reading above 100°C were OOT
– When: 5 Jan 2014 to 15 Jan 15
– Where: Thermometry Lab Only
– How: 100°C Bath
Magnitude : 0.04°C
Direction: Thermometer read too high
![Page 18: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/18.jpg)
Analysis - Example
We need to know what the product would have read at 100°C • Since the UUT was reading too
high, all products readings will also be too high, by this amount
• Since all reported product readings were too high, we must subtract the UUT’s error from the Products reported readings to get the products actual behavior at 100°C
• Now check the corrected Product indication against the Process tolerances
• Did it still Pass?• Did it now Fail? • Repeat for all product meeting
our investigation criterion.
![Page 19: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/19.jpg)
Measurement Assurance Programs1. R&D Product Specifications2. Manufacturing Process & Documentation
- Tip: Identify Critical Measurements- Tip: Set Warning Tolerances
3. Selection of Suitable Test Equipment– Tip: Select single parameter vs. multifunction– Tip: Smart Accuracy Ratios
4. Quality Control Program- Tip: Process control charts for critical measurement- Tip: Mid-cycle checks, cross checks
5. Preventative Maintenance Program– a) Regular Calibration– b) Calibration with As-found / As-Left & Uncertainties– c) Calibration Interval Adjustment Policy
![Page 20: Evaluating Out Of Tolerance Instruments Webinar](https://reader031.vdocuments.site/reader031/viewer/2022032616/55a684911a28ab37498b4822/html5/thumbnails/20.jpg)
Summary• Out-of-Tolerance Statements• OOT Investigation
• What• Where• When• How• Mechanics and Mathematics
• Measurement Assurance Program Elements• R&D• Equipment Selection• Process & Documentation • Quality Control• Preventative Maintenance• Equipment Control• Product Traceability