www.eu-etics.org infsom-ri-026753 a quality certification model for grid research projects the etics...
Post on 25-Dec-2015
218 Views
Preview:
TRANSCRIPT
www.eu-etics.org
INFSOM-RI-026753
A Quality Certification Model for A Quality Certification Model for Grid Research ProjectsGrid Research Projects
the ETICS feasibility Studythe ETICS feasibility Study
Adriano RippaAdriano Rippa((adriano.rippa@eng.itadriano.rippa@eng.it)) - Engineering Ingegneria Informatica s.p.a.- Engineering Ingegneria Informatica s.p.a.On behalf of ETICS ProjectOn behalf of ETICS Project
EGEE '07 Conference - Budapest 01-05/10/2007 2INFSOM-RI-026753
Summary
• Introduction to QA conceptsIntroduction to QA concepts
• The starting point of the present studyThe starting point of the present study
• The proposed The proposed Grid Quality Certification ModelGrid Quality Certification Model (GQCM) (GQCM)
• Comparing GQCM and other QA standardsComparing GQCM and other QA standards
• Using GQCM in Industries: the Engineering Using GQCM in Industries: the Engineering experimentationexperimentation
• ConclusionsConclusions
EGEE '07 Conference - Budapest 01-05/10/2007 3INFSOM-RI-026753
Quality Assurance refers to several concepts
• Quality of the implementation Quality of the implementation process process – High level steps of the software High level steps of the software
production cycle suggesting what production cycle suggesting what the organization must do (not how) the organization must do (not how) to have effective development to have effective development processes that “processes that “may leadmay lead” to good ” to good software.software.
• Quality of the requirements Quality of the requirements management management – Correct collection/management of Correct collection/management of
requirements and relation with the requirements and relation with the customer and stakeholders, to customer and stakeholders, to reduce the percentage of failures reduce the percentage of failures due to misinterpreted requirements.due to misinterpreted requirements.
• Quality of the service Quality of the service – Performances and correctness of Performances and correctness of
the service providethe service provide
• Finally quality of the software…Finally quality of the software…
QUALITY
Quality of Product
Quality of Process
GQCMGQCMCMMCMM
ITILITILISO – 900xISO – 900x
EGEE '07 Conference - Budapest 01-05/10/2007 4INFSOM-RI-026753
Some QA Terminology
• Measure: Measure: a value (number or category) assigned to an a value (number or category) assigned to an attribute of an entity (e.g. software component)attribute of an entity (e.g. software component)
• MeasurementMeasurement: : The act or process of assigning a The act or process of assigning a number or category to an entity to describe an attribute number or category to an entity to describe an attribute of that entity. of that entity.
• MetricMetric: : A function whose inputs are software measures A function whose inputs are software measures and whose output is a single numerical value that can and whose output is a single numerical value that can be interpreted as the degree to which software be interpreted as the degree to which software possesses a given attribute that affects its quality.possesses a given attribute that affects its quality.
EGEE '07 Conference - Budapest 01-05/10/2007 5INFSOM-RI-026753
Quality is a matter of measure!
• State-of-the-art provide hundreds of measuresState-of-the-art provide hundreds of measures– The most commonThe most common
– Cyclomatic complexityCyclomatic complexity– Lines of CodeLines of Code– Function PointsFunction Points– Mean Time Between(to) failureMean Time Between(to) failure– Bugs densityBugs density– ……
– Other approaches (Goal Question Metric - GQM) promote user Other approaches (Goal Question Metric - GQM) promote user defined metricsdefined metrics
– Anomalies distributionAnomalies distribution– Effort used to solve anomaliesEffort used to solve anomalies– Cost of not founded anomaliesCost of not founded anomalies– ……
EGEE '07 Conference - Budapest 01-05/10/2007 6INFSOM-RI-026753
Quality Standards
• There are There are many standardsmany standards to asses the quality of the to asses the quality of the processes of an organization processes of an organization – CMMCMM– ISO familyISO family– ITILITIL– AQAPAQAP
• But QA means initial investments and managing QA But QA means initial investments and managing QA means devote resources to it!means devote resources to it!
• Several studies show that lot of companies (e.g. many Several studies show that lot of companies (e.g. many Small/Medium Enterprises) Small/Medium Enterprises) can’t afford the initial effortcan’t afford the initial effort and don’t recognise the promised and don’t recognise the promised increase of valueincrease of value..
EGEE '07 Conference - Budapest 01-05/10/2007 7INFSOM-RI-026753
e.g. CMM-I
• CMM-I levels:CMM-I levels:– 1 Initial: Processes are low managed and controlled. There is a first 1 Initial: Processes are low managed and controlled. There is a first
tentative to look at the qualitytentative to look at the quality– 2 Managed: Processes are specific, controlled, applied, replicable2 Managed: Processes are specific, controlled, applied, replicable– 3 Defined: There is homogeneity in the processes between all the 3 Defined: There is homogeneity in the processes between all the
projects. They are defined by the organizationprojects. They are defined by the organization– 4 Quantitatively Managed: Processes are measured and controlled4 Quantitatively Managed: Processes are measured and controlled– 5 Optimising: Focus on the continuous improvement process5 Optimising: Focus on the continuous improvement process
• Only ~70 companies in the world are certified at level 5Only ~70 companies in the world are certified at level 5– 50 of them are in India50 of them are in India
• Only 25% of the companies in the world are level 2 or aboveOnly 25% of the companies in the world are level 2 or above
EGEE '07 Conference - Budapest 01-05/10/2007 8INFSOM-RI-026753
QA in research project is missing!
• Current quality assurance standards are useful Current quality assurance standards are useful butbut
– They are They are process orientedprocess oriented, the organisation need to be , the organisation need to be structured and certified. What for the short-live structured and certified. What for the short-live consortia?consortia?
– They They provide only theoretical guidelinesprovide only theoretical guidelines that need to be that need to be adapted and realisedadapted and realised
– It’s It’s hard to systematically verify goodnesshard to systematically verify goodness of results: of results: managing tools neededmanaging tools needed
– They They need resourcesneed resources to be devoted to. to be devoted to.– People need to be trainedPeople need to be trained and certification needs and certification needs
inspections and time to be achievedinspections and time to be achieved (usually about two (usually about two or three years depending on the organisation or three years depending on the organisation complexity).complexity).
EGEE '07 Conference - Budapest 01-05/10/2007 9INFSOM-RI-026753
QA in grids: our solution
• GQCM is aGQCM is a modelmodel forfor quality assurance that isquality assurance that is
– fully automatablefully automatable in measuring and verifying activities to in measuring and verifying activities to reduce investments and management effort,reduce investments and management effort,
– not subjectivenot subjective, to certify the object not the process nor the , to certify the object not the process nor the organization,organization,
– product orientedproduct oriented, not process oriented,, not process oriented,
• ……easily adoptable within grid Research Projectseasily adoptable within grid Research Projects
EGEE '07 Conference - Budapest 01-05/10/2007 10INFSOM-RI-026753
The timeline
FIRST BETA FIRST BETA
VERSIONVERSIONFINAL BETA FINAL BETA
VERSIONVERSION
OCTOBEROCTOBER
FIRST OFFICIALFIRST OFFICIAL
VERSIONVERSION
DECEMBERDECEMBER
ECHOGRID/EUChinagridECHOGRID/EUChinagrid
Conference 24-25 AprilConference 24-25 April
MAYMAYFEBRUARYFEBRUARY
OGF 20/EGEE UFOGF 20/EGEE UF
7-11 May7-11 May
Belief ConferenceBelief Conference
25-28 June25-28 June
OGF 21OGF 21
15-19 Oct15-19 Oct
QUALIPSO QUALIPSO ConferenceConference
16-17 Jan 200816-17 Jan 2008
NowNow
EGEE ’07EGEE ’07
1-5 Oct1-5 Oct
EELA 3° EELA 3° Conference 3-5 Conference 3-5
Dec 2007Dec 2007
EGEE '07 Conference - Budapest 01-05/10/2007 11INFSOM-RI-026753
Grid Quality Certification Model
• Some QA Standards areSome QA Standards are– Waterfall-likeWaterfall-like– BooleanBoolean
• GQCM could be seen as a GQCM could be seen as a model that looks at the model that looks at the quality by independent quality by independent points of view, tested points of view, tested separately to provide user-separately to provide user-friendly resultsfriendly results
AA
BB
CC
AA
BB
CC
EGEE '07 Conference - Budapest 01-05/10/2007 12INFSOM-RI-026753
GQCM: Preliminary remarks
• GQCM is GQCM is independentindependent from the ETICS tools from the ETICS tools
• Any GQCM implementation needs justAny GQCM implementation needs just “automation” “automation” !!
• GQCM has been developed and described according to GQCM has been developed and described according to several ISO standards (e.g. ISO/IEC 25000, 14598) and several ISO standards (e.g. ISO/IEC 25000, 14598) and will be experimented in a ISO/CMM certified will be experimented in a ISO/CMM certified organizationorganization
EGEE '07 Conference - Budapest 01-05/10/2007 13INFSOM-RI-026753
GQCM: Structure
• GQCM is structured in GQCM is structured in Evaluation Modules (EM)Evaluation Modules (EM)..
• The set of evaluation techniques are grouped in The set of evaluation techniques are grouped in families. Every family is an EMfamilies. Every family is an EM
• 5 EMs:5 EMs:
– EM: Static analysisEM: Static analysis– EM: Coding styleEM: Coding style– EM: Structural testingEM: Structural testing– EM: Functional testingEM: Functional testing– EM: Standards complianceEM: Standards compliance
EGEE '07 Conference - Budapest 01-05/10/2007 14INFSOM-RI-026753
Evaluation Modules 1/5
• EM Static analysisEM Static analysis– Quality characteristics:Quality characteristics:
– Reliability – maturityReliability – maturity– Maintainability – analysabilityMaintainability – analysability– Maintainability – changeabilityMaintainability – changeability– Maintainability – testabilityMaintainability – testability
– Technique:Technique: – Static analysis of classes. Statistics on measures are used as Static analysis of classes. Statistics on measures are used as
predictor of quality characteristics. This analysis is expected to be predictor of quality characteristics. This analysis is expected to be supported by an analysis tool.supported by an analysis tool.
– Applicability:Applicability:– Object oriented programming languages. Object oriented programming languages.
– Input:Input:– source code, each class of the code is analysed source code, each class of the code is analysed
EGEE '07 Conference - Budapest 01-05/10/2007 15INFSOM-RI-026753
Evaluation Modules 2/5
• EM Coding styleEM Coding style– Quality characteristics:Quality characteristics:
– Maintainability – analysabilityMaintainability – analysability
– Technique: Technique: – Static analysis of the source code. This analysis is expected to be Static analysis of the source code. This analysis is expected to be
supported by an analysis tool.supported by an analysis tool.
– Applicability:Applicability:– Most programming languageMost programming language
– Input:Input:– source codesource code
EGEE '07 Conference - Budapest 01-05/10/2007 16INFSOM-RI-026753
Evaluation Modules 3/5
• EM Structural testingEM Structural testing– Quality characteristics:Quality characteristics:
– Functionality – accuracyFunctionality – accuracy– Reliability – maturityReliability – maturity
– Technique:Technique:– Structural testing. The intention of this EM is to test specific classes Structural testing. The intention of this EM is to test specific classes
that are identified by static measures as being statistically more that are identified by static measures as being statistically more likely to have many errors. likely to have many errors.
– Applicability:Applicability:– Object oriented programming languagesObject oriented programming languages
– Input:Input:– source codesource code
EGEE '07 Conference - Budapest 01-05/10/2007 17INFSOM-RI-026753
Evaluation Modules 4/5
• EM Functional testingEM Functional testing– Quality characteristics:Quality characteristics:
– Functionality – accuracyFunctionality – accuracy– Functionality – interoperabilityFunctionality – interoperability– Reliability – maturityReliability – maturity– Portability – adaptabilityPortability – adaptability– Portability - installabilityPortability - installability
– Technique:Technique:– Functional testingFunctional testing
– The purpose of this EM is both to check platform compliance and The purpose of this EM is both to check platform compliance and to check to functional abilities of the software product.to check to functional abilities of the software product.
– Applicability:Applicability:– GeneralGeneral
– Input:Input:– compiled codecompiled code– user documentationuser documentation
EGEE '07 Conference - Budapest 01-05/10/2007 18INFSOM-RI-026753
Evaluation Modules 5/5
• EM Standards complianceEM Standards compliance– Quality characteristics:Quality characteristics:
– Functionality – standards complianceFunctionality – standards compliance
– Technique:Technique:– Functional testing Functional testing
– This EM has a good potential for automating the test. This EM has a good potential for automating the test.
– Applicability:Applicability:– Standard specificStandard specific
– Input:Input:– compiled codecompiled code
EGEE '07 Conference - Budapest 01-05/10/2007 19INFSOM-RI-026753
GQCM: EMs and QA points of view
• Testing results could be virtually grouped in three Testing results could be virtually grouped in three summarizing points of view to have a more direct summarizing points of view to have a more direct vision of what is evaluated :vision of what is evaluated :
– QualityQuality– PlatformsPlatforms– StandardsStandards
Quality
Platforms
Standards
Good quality
Medium quality
Poor quality
Window
s
UN
IX
Linux
OASIS: WS-I
OGF: OGSA-BES
MacO
S
EGEE '07 Conference - Budapest 01-05/10/2007 20INFSOM-RI-026753
GQCM: Final Score
• Final score should be provided according to the following Final score should be provided according to the following schema. The items which should be available for the users are:schema. The items which should be available for the users are:– A A table summarizing the resultstable summarizing the results– A A list of passed and non passed testslist of passed and non passed tests– All the All the important informationimportant information as: as:
– Software product (e.g. name, version, executable code, documentation..)Software product (e.g. name, version, executable code, documentation..)
– Platform (name, version, date)Platform (name, version, date)
– Quality characteristics (name, evaluation result, evaluation module Quality characteristics (name, evaluation result, evaluation module identification)identification)
– Standard compliance (for each standard: name, version, date)Standard compliance (for each standard: name, version, date)
– Identification of evaluation report (organization, report number, date)Identification of evaluation report (organization, report number, date)
– Identification of certification body (organization, contact information)Identification of certification body (organization, contact information)
– Certification data (dates, certification number)Certification data (dates, certification number)
– Electronic signature of certification record Electronic signature of certification record
EGEE '07 Conference - Budapest 01-05/10/2007 21INFSOM-RI-026753
Summarizing Table structure
EMStatic EM Coding EM Structural EM Functional EM Std compl.
Functionality X X
Accuracy X X
Interoperability X
Compliance (X)
Reliability X X X
Maturity X X X
Maintainability X X
Analyzability X X
Changeability X
Testability X
Portability X
Adaptability X
Installability X
EGEE '07 Conference - Budapest 01-05/10/2007 22INFSOM-RI-026753
GQCM: Summarizing Table example
Consolidated eval. result
EM Static
EM Coding
EM structural
EM Functional
EM Std compliance
EM eval. result M M G G G Y
Functionality G G G
Accuracy G G G
Interoperability G G
Compliance Y (Y)
Reliability M M G G
Maturity M M G G
Maintainability M M G
Analyzability M M G
Changeability M M
Testability M M
Portability G G
Adaptability G G
Installability G G
G = GoodM = MediumP = Poor
EGEE '07 Conference - Budapest 01-05/10/2007 23INFSOM-RI-026753
Do you see any cons?
• I can’t add any overhead to my projectI can’t add any overhead to my project– This model (and the capability of automate) will reduce the effort This model (and the capability of automate) will reduce the effort
in performing continuous build and test activities (e.g. coverage in performing continuous build and test activities (e.g. coverage tests) on different releasestests) on different releases
• How much costs adopting it?How much costs adopting it?– Nothing, the model will be discussed publicly and the final Nothing, the model will be discussed publicly and the final
version will be released under open license (e.g. Creative version will be released under open license (e.g. Creative Commons)Commons)
– The ETICS framework is provided as a service running on a The ETICS framework is provided as a service running on a dedicated infrastructure, free of charge for Research Project dedicated infrastructure, free of charge for Research Project
• My organisation is certified ISO/CMMi so I…?My organisation is certified ISO/CMMi so I…?– See next slides…See next slides…
• Other? Please criticise…Other? Please criticise…
EGEE '07 Conference - Budapest 01-05/10/2007 24INFSOM-RI-026753
GQCM integration in an ISO 9126 certified organization
• Facts:Facts:– ISO 9126 define quality attributes ISO 9126 define quality attributes – GQCM support the measure and evaluation of quality metricsGQCM support the measure and evaluation of quality metrics
• Hypothesis:Hypothesis:– ISO9126 Portability: adaptability, installabilityISO9126 Portability: adaptability, installability
– ISO9126 asks OS adaptability and installability for software of ISO9126 asks OS adaptability and installability for software of certified organizationscertified organizations
– GQCM may test deployment of SW on different platforms (HW+OS)GQCM may test deployment of SW on different platforms (HW+OS)
– ISO9126 Maintainability: all.ISO9126 Maintainability: all.– ISO9126 asks to develop a software that is easy to analyse, easy to ISO9126 asks to develop a software that is easy to analyse, easy to
modify, Stablemodify, Stable– GQCM metrics (such as the CK for OO or coding convetions GQCM metrics (such as the CK for OO or coding convetions
metrics) helps to verify in concrete these requirementsmetrics) helps to verify in concrete these requirements
EGEE '07 Conference - Budapest 01-05/10/2007 25INFSOM-RI-026753
GQCM integration in an ISO 9126 certified organization
• ISO9126 Functionality: accuracy.ISO9126 Functionality: accuracy.– ISO9126 asks that a software have to give results according with ISO9126 asks that a software have to give results according with
requirements.requirements.– GQCM certification can run functional test (or plug-in external test suits) GQCM certification can run functional test (or plug-in external test suits)
of declared compliances.of declared compliances.
• ISO9126 Functionality: adequacy.ISO9126 Functionality: adequacy.– ISO9126 asks for correct functions with specific goals.ISO9126 asks for correct functions with specific goals.– GQCM may check not dead functions.GQCM may check not dead functions.
• Our thesis:Our thesis:– Many ISO9126 quality metrics can be measured and evaluated based Many ISO9126 quality metrics can be measured and evaluated based
on GQCMon GQCM– Any tool implementing it and can be integrated as supporting ISO9126 Any tool implementing it and can be integrated as supporting ISO9126
adoptionadoption
EGEE '07 Conference - Budapest 01-05/10/2007 26INFSOM-RI-026753
GQCM integration in a CMMi certified organization
• FactsFacts– CMM is process oriented (it gives guidelines).CMM is process oriented (it gives guidelines).– GQCM is product oriented.GQCM is product oriented.
• Hypotesis:Hypotesis:– CMM2 CMM2
– asks to “control and value”asks to “control and value”– GQCM proposes the measures and metrics to be collected, hence GQCM proposes the measures and metrics to be collected, hence
controlling and evaluating specific sw related itemscontrolling and evaluating specific sw related items
– CMM3 CMM3 – asks to “use internal standards and have a reference model”asks to “use internal standards and have a reference model”– GQCM proposes code and implementation conventions (how to GQCM proposes code and implementation conventions (how to
organise and structure code, how to define tests, etc.)organise and structure code, how to define tests, etc.)
EGEE '07 Conference - Budapest 01-05/10/2007 27INFSOM-RI-026753
GQCM integration in a CMM certified organization
• CMM4 CMM4 – asks to “have measured and controlled processes using quantitative asks to “have measured and controlled processes using quantitative
and statistical techniques”and statistical techniques”– GQCM proposes the continuous collection of quality data to perform GQCM proposes the continuous collection of quality data to perform
trends analysis.trends analysis.
• CMM5 CMM5 – asks to have an “improvement process and quality based on asks to have an “improvement process and quality based on
measurement”measurement”– GQCM provides numerical reference to set the improvement GQCM provides numerical reference to set the improvement
processes.processes.
– Our ThesisOur Thesis– GQCM is not in contrast with CMMI and can be integrated in GQCM is not in contrast with CMMI and can be integrated in
organization as a tool to support CMMI adoptionorganization as a tool to support CMMI adoption
EGEE '07 Conference - Budapest 01-05/10/2007 28INFSOM-RI-026753
Engineering: Certifications 1/2
• All this work is born from internal needs ofAll this work is born from internal needs of– The research areaThe research area– The production areaThe production area
• Engineering is certified as follows:Engineering is certified as follows:– ISO 9001ISO 9001
– For all the ICT sector in which the organization is involvedFor all the ICT sector in which the organization is involved
– Since 1994 ( ISO9001:2000 from December 2002)Since 1994 ( ISO9001:2000 from December 2002)
– CMM 2 CMM 2 – Since February 2005Since February 2005
– For all production divisionsFor all production divisions
– NATO AQAP 2110/160NATO AQAP 2110/160– Since December 1996 (from 1996 to 2005 there were different rules)Since December 1996 (from 1996 to 2005 there were different rules)
• TThe company is managing the process to be certified at level 3he company is managing the process to be certified at level 3
EGEE '07 Conference - Budapest 01-05/10/2007 29INFSOM-RI-026753
Engineering: Certifications 2/2
• To reach the level 3 we are selecting tools for test and To reach the level 3 we are selecting tools for test and quality managementquality management
• Engineering is developing Spago4Q (Engineering is developing Spago4Q (www.spago4q.orgwww.spago4q.org) ) – integrated with other tools measure processes, performances integrated with other tools measure processes, performances
and bugs.and bugs.– Examples of calculated metrics:Examples of calculated metrics:
– Test CoverageTest Coverage– Anomalies distributionAnomalies distribution– Effort used to solve anomaliesEffort used to solve anomalies– Cost of not founded anomaliesCost of not founded anomalies– Metrics about requirementsMetrics about requirements– Metrics about risk managementMetrics about risk management– ……
EGEE '07 Conference - Budapest 01-05/10/2007 30INFSOM-RI-026753
Engineering: Certifications 2/2
• GQCM + ETICS b&t tool will help to measure the left GQCM + ETICS b&t tool will help to measure the left quality aspects as:quality aspects as:– The quality of the codeThe quality of the code– The compliance with standardsThe compliance with standards– The compliance with OSThe compliance with OS– ……
EGEE '07 Conference - Budapest 01-05/10/2007 31INFSOM-RI-026753
Engineering: objectives and QA
• EngineeringEngineering looks at:looks at:– Client satisfactionClient satisfaction– Company successCompany success– Monitoring of the previous pointsMonitoring of the previous points
• Client satisfaction is seen as a necessary assumption Client satisfaction is seen as a necessary assumption to confirm and enhance Engineering’s successto confirm and enhance Engineering’s success
• The way to obtain it is the supply of quality productsThe way to obtain it is the supply of quality products
• Engineering has a Quality Management System (QMS) defined Engineering has a Quality Management System (QMS) defined pursuing the following principles:pursuing the following principles:– Client-oriented attitudeClient-oriented attitude– Continuous improvementContinuous improvement– Focus on processFocus on process– Involvement of all human resourcesInvolvement of all human resources
EGEE '07 Conference - Budapest 01-05/10/2007 32INFSOM-RI-026753
The QMS model
Continuous Enhancing of Quality Management System
ManagementResponsibility
CL
IEN
T
RE
QU
IRE
ME
NT
S
SA
TIS
FA
CT
ION
CL
IEN
T
Pro
duct
/Ser
vice
Input Output
Measurement, Analisys, Enhancing
Resources Management
Product / ServiceRealization
based on UNI EN ISO 9001:2000 processesbased on UNI EN ISO 9001:2000 processes
EGEE '07 Conference - Budapest 01-05/10/2007 33INFSOM-RI-026753
QA and Engineering
• Engineering’s Quality Management System:Engineering’s Quality Management System:
– involves the entire organizational structureinvolves the entire organizational structure
– operates on processesoperates on processes
– adopts proceduresadopts procedures
– uses resourcesuses resources
EGEE '07 Conference - Budapest 01-05/10/2007 34INFSOM-RI-026753
Engineering: Quality in projects
• Activities to reach the qualityActivities to reach the quality
– identification, formalization, verification and filing of reference identification, formalization, verification and filing of reference documentation (contractual and technical)documentation (contractual and technical)
– drafting a Quality Plan, a document listing project requirements, drafting a Quality Plan, a document listing project requirements, the operational and management choices aiming at the the operational and management choices aiming at the implementation of requirementsimplementation of requirements
– development in conformity with outlined production processdevelopment in conformity with outlined production process
– verification of intermediate and final results (concerning in verification of intermediate and final results (concerning in particular the design, testing activities and documentation)particular the design, testing activities and documentation)
– evolution management, during the different job phases and evolution management, during the different job phases and releases, of software and documentation;releases, of software and documentation;
– check-ups of monthly work progress compared with the actual check-ups of monthly work progress compared with the actual project planning; project planning;
– formalization of project’s main events, through recurrent formalization of project’s main events, through recurrent technical and work in progress meetings with the Client.technical and work in progress meetings with the Client.
EGEE '07 Conference - Budapest 01-05/10/2007 35INFSOM-RI-026753
Engineering: Quality Plan 1/3
• At the beginning of the project, the Project Manager At the beginning of the project, the Project Manager should draft a “Quality Plan” that handle:should draft a “Quality Plan” that handle:
– Contractual documentation analysisContractual documentation analysis– must be clear that the Project Manager has understood and must be clear that the Project Manager has understood and
verified all aspects concerning the contractual relationship with the verified all aspects concerning the contractual relationship with the Client Client
– Project organizationProject organization– defined in terms of defined in terms of
– ResourcesResources
– RolesRoles
– ResponsibilitiesResponsibilities
EGEE '07 Conference - Budapest 01-05/10/2007 36INFSOM-RI-026753
Engineering: Quality Plan 2/3
– Product/service supply and project requirements Product/service supply and project requirements – description on:description on:
– product/service to be suppliedproduct/service to be supplied
– product/service’s requirementsproduct/service’s requirements
– resolutions in case of eventual vaguenessresolutions in case of eventual vagueness
– evidence of possible divergences compared to the contractual evidence of possible divergences compared to the contractual documentationdocumentation
– Projecting and Development Process Projecting and Development Process – the adopted process, used methodology, output, support toolsthe adopted process, used methodology, output, support tools
– Configuration Management Configuration Management – what it has been decided for check of work-status of product what it has been decided for check of work-status of product
components, for its back-up procedurescomponents, for its back-up procedures
EGEE '07 Conference - Budapest 01-05/10/2007 37INFSOM-RI-026753
Engineering: Quality Plan 3/3
– Suppliers’ Management (sub-contractors) and interactions with Suppliers’ Management (sub-contractors) and interactions with Third PartiesThird Parties
– only in presence of sub-supplies, even if internalonly in presence of sub-supplies, even if internal
– Materials to be delivered/activities to be carried out Materials to be delivered/activities to be carried out – all objects/materials to be delivered to Client or the activities to be all objects/materials to be delivered to Client or the activities to be
carried out for the Clientcarried out for the Client
– Verifications and validations modes. Verifications and validations modes. – projecting and development verification (functional and technical);projecting and development verification (functional and technical);– validation of function projecting and developmentvalidation of function projecting and development
EGEE '07 Conference - Budapest 01-05/10/2007 38INFSOM-RI-026753
Engineering: Quality Control 1/2
• Quality Assurance and Internal Auditing Division has Quality Assurance and Internal Auditing Division has the responsibility:the responsibility:– to verify the execution of targeted activities to eliminate possible to verify the execution of targeted activities to eliminate possible
anomalies arisenanomalies arisen– to identify, describe and execute corrective actions in order to to identify, describe and execute corrective actions in order to
eliminate anomalies’ causeseliminate anomalies’ causes– to identify, describe and carry out preventive actions in order to to identify, describe and carry out preventive actions in order to
eliminate possible anomalies’ causeseliminate possible anomalies’ causes– to undertake any initiative which could improve the effectiveness to undertake any initiative which could improve the effectiveness
and efficiency of the Quality Management Systemand efficiency of the Quality Management System
EGEE '07 Conference - Budapest 01-05/10/2007 39INFSOM-RI-026753
Engineering: Quality Control 2/2
• On an annual basis, this division drafts reports on On an annual basis, this division drafts reports on details gathered by the different corporate divisions, details gathered by the different corporate divisions, regarding the fulfilment of Quality goals set at the regarding the fulfilment of Quality goals set at the beginning of the year, allowing the identification of beginning of the year, allowing the identification of possible improvementspossible improvements
• Control activities, on a periodical basis, carried out the Control activities, on a periodical basis, carried out the Quality Assurance and Internal Audition Division within Quality Assurance and Internal Audition Division within an IT project are classifies as follows:an IT project are classifies as follows:– official check-upsofficial check-ups– content check-upscontent check-ups– work -in progress check-upswork -in progress check-ups– results’ validationresults’ validation
EGEE '07 Conference - Budapest 01-05/10/2007 40INFSOM-RI-026753
Conclusions
• GQCM is a certification modelGQCM is a certification model– AutomatableAutomatable– Not in contrast with classical standardsNot in contrast with classical standards– Ready to be integrated with classical standards Ready to be integrated with classical standards – FreeFree– Not limited to the ETICS build and test toolNot limited to the ETICS build and test tool– Not limited to research projectsNot limited to research projects
• GQCM require less human effort to be used because it GQCM require less human effort to be used because it is almost fully automatableis almost fully automatable
• ETICS tool is ready to implement GQCMETICS tool is ready to implement GQCM
EGEE '07 Conference - Budapest 01-05/10/2007 41INFSOM-RI-026753
E-mail addresses
• We want it to be as We want it to be as simple and effective as possible to simple and effective as possible to useuse. For this . For this we need your feedbackwe need your feedback::
ETICS-ETICS-QAstudy@cern.chQAstudy@cern.ch
ETICS-ETICS-discuss@cern.chdiscuss@cern.ch
ETICS-ETICS-support@cern.chsupport@cern.ch
EGEE '07 Conference - Budapest 01-05/10/2007 42INFSOM-RI-026753
Q&A
http://www.eu-etics.org• Acknowledgements:Acknowledgements:
• Many thanks for their contribution to Many thanks for their contribution to • Daniela VaghegginiDaniela Vagheggini• Gabriele RuffattiGabriele Ruffatti• Andrea ManieriAndrea Manieri
top related