feedback presentation for saamf meeting - 05.05.2005 as modified after sqa managers meeting

Your measurement technology partner for global competitiveness

CSIR National Metrology Laboratory

The National Metrology Laboratory of South Africa

Feedback presentation for SAAMF meeting – 05 May 2005

Eddie Tarnow

Metrologist

CSIR-NML



Standards in the Automotive IndustryStandards in the Automotive Industry



• Can an ISO/TS 16949: 2002 certification programme ensure systems and processes which deliver products which conform to a technical specification?

• Are customer specific MSA requirements addressed in ISO/TS 16949: 2002 audits?

• To what degree are customer specific MSA requirements addressed in ISO/TS 16949: 2002 audits?

• Would ISO/TS 16949:2002 auditors benefit from additional training in Measurement System Analysis?

Questions for SAACBQuestions for SAACB



Definitions

““Calibration”Calibration”

““International Vocabulary of Basic and General Terms in International Vocabulary of Basic and General Terms in Metrology” – Second Edition, 1993.Metrology” – Second Edition, 1993.

“Set of operations that establish, under specified conditions, the relationship between values of quantities indicated by a measuring instrument or measuring system, or values represented by a material measure or a reference material, and the corresponding values realised by standards.”

NOTES:

1. The result of a calibration permits either the assignment of values of measureands to the indications or the determination of corrections with respect to the indications.

2. A calibration may also determine other metrological properties such as the effect of influence quantities.

3. The result of a calibration may be recorded in a document, sometimes called a calibration certificate or a calibration report.



Definitions

““Calibration”Calibration”

““Measurement Systems Analysis” - MSA Third Edition, Measurement Systems Analysis” - MSA Third Edition, March 2005.March 2005.

“A set of operations that establish, under specified conditions, the relationship between a measuring device and a traceable standard of known reference value and uncertainty. Calibration may also include steps to detect, correlate, report, or eliminate by adjustment any discrepancy in accuracy of the measuring device being compared.”



Definitions

““Verification”Verification”

““Eddie’s definition.”Eddie’s definition.”

“Periodic measurements of a traceable standard of known reference value and uncertainty for the purpose of maintaining confidence in the ability of an instrument or measuring system to continue to perform measurements with the required accuracy.”



Definitions

““Validation”Validation”

““Eddie’s definition.”Eddie’s definition.”

“A set of operations which prove that a system is fit for its intended purpose .”

NOTES:

1. A system can be a measuring instrument, a measuring system, a software programme or a spreadsheet.

2. The intended purpose for a measuring instrument or measuring system implies that the required measurement is performed with the desired accuracy, (uncertainty of measurement).

3. Validation need only be performed once, during a system commissioning or after a change has been made.



Definitions

““Uncertainty of Measurement”Uncertainty of Measurement”


“The parameter, associated with the result of a measurement, that characterises the dispersion of the values that could reasonably be attributed to the measureand.”

NOTES:

1. The parameter may be, for example, a standard deviation (or a given multiple of it), or the half-width of an interval having a stated level of confidence.

2. Uncertainty of measurement comprises, in general, many components. Some of these components may be evaluated from the statistical distribution of the results of series of measurements and can be characterised by experimental deviations. The other components, which can also be characterised by standard deviations, are evaluated from assumed probability distributions based on experience or other information.



Definitions

““Uncertainty of Measurement cont.”Uncertainty of Measurement cont.”


NOTES:

3. It is understood that the result of the measurement is the best estimate of the value of the measureand, and that all components of uncertainty, including those arising from systematic effects, such as components associated with corrections and reference standards, contribute to the dispersion.



Definitions

““Uncertainty of Measurement ”Uncertainty of Measurement ”

““Measurement Systems Analysis” - MSA Third Edition, Measurement Systems Analysis” - MSA Third Edition, March 2005.March 2005.

“A parameter associated with the result of a measurement that characterises the dispersion of the values that could reasonably be attributed to the measureand; the range assigned to a measurement result that describes, within a defined level of confidence, the limits expected to contain the true measurement result. Uncertainty is a quantified expression of the measurement reliability.



Uncertainty of measurement

Result of a measurement, Result of a measurement, yy, and result of measurement, , and result of measurement, complete statement complete statement y’y’




Example of conformance provedExample of conformance proved




Example of non - conformance provedExample of non - conformance proved




Example of neither conformance nor non - conformance Example of neither conformance nor non - conformance provedproved



ISO/TS 14253-1

Uncertainty of measurement reduces conformance rangeUncertainty of measurement reduces conformance range



MSA DiscussionMSA Discussion

Is an MSAconducted?

Why not adequatelyaudited as part

of 16949?

Why not? Notnecessary?

Are 16949 auditorsexpected to do this?

An unreasonableexpectation?

Can they do it? Who is? The OEMs?OEMs need to take

responsibility – control plan?

YES

YES NO

NO

Then who checks themeasurement system?

But they don’t - Action required

Don’t have the skills,training required

YES

NO

YES

NO

Auditors need toput in the effort

YES

Must be done, thenby whom?

NO

Do they have theskills?

YES

How comemeasurement

problems?

YES

NO



• Who conducts the MSA? (supplier/OEM?)

• Are FOP, (first of production), tests conducted?

• Who is responsible for conducting these tests, OEMs or suppliers?

• Who is responsible for evaluating that the measurement system is capable of performing the required measurements with the desired level of accuracy?

• Do these tests form part of the control plan?

• Is the understanding that an MSA addresses the measurement accuracy of a measurement system or merely its repeatability/reproducibility?

MSA DiscussionMSA Discussion

feedback presentation for saamf meeting - 05.05.2005 as modified after sqa managers meeting

Business

result of measurement

required measurement

measurement reliability

measurement system analysis

true measurement result

components of uncertainty

measuring system

measuring instrument