www.methoda.com methodassess system assessment. methoda computers ltd 2 list of subjects 1....

www.methoda.com

MethodAssessMethodAssess

System AssessmentSystem Assessment

2Methoda Computers Ltd

List of Subjects

1. Introduction1. Introduction

2. Actions and deliverables2. Actions and deliverables

3. Lessons and decisions3. Lessons and decisions

5. In conclusion5. In conclusion

4. Quality assurance4. Quality assurance


System Assessment - Definition

System assessment is a life-cycle phase in which the system is evaluated:

From the perspective of time By a party from outside the project

The assessment stresses: Malfunctions & problems that occurred Benefits that can be cultivated Anything else that happened, if unusual


System Assessment - Goal

Presenting the project comprehensively, in all its stages, so that lessons can be implemented at:

The project level The organizational level

Infrastructure

Other projects

Assess – Study – Learn – ActAssess – Study – Learn – ActAssess – Study – Learn – ActAssess – Study – Learn – Act


When to assess a system

Methoda’s standard recommendations: Size 3 and up, 6 months into production Any project cancelled during or after Analysis Schedule or cost deviation of 50% or more Unexpected threat to project completion Extremely negative risk analysis

At management’s discretion Strategic considerations A bad feeling about the project Any other reason, any project size, any stage of the

life cycle


List of Subjects







Lessons learned

Holding the concluding discussion

Producing the exec. presentation

Distributing the Assessment doc

Writing the Assessment Doc

User Satisfaction Questionnaire

Interviews

Collecting input

Informing the involved parties

Preparing a work plan

Appointing the assessor

Starting the process

Assessment Tasks

Preliminary Activities

Assessing the Project

Final Activities


Assessm

ent

Assessm

ent

do

cum

ent

do

cum

ent

Main Input

Quality assurance documents Quality assurance documents

Personal interviewsPersonal interviews

Steering committee summaries, reviews & discussion summaries

Steering committee summaries, reviews & discussion summaries

Contracts and agreementsContracts and agreements

System documents(Analysis, Design, Testing)

System documents(Analysis, Design, Testing)


Deliverables

Preliminary Activities

Assessing the Project Final Activities

Work order

Management & infrastructure commitment

Assignments

Work plan



Draft Assessment document

Draft Assessment document

Final Assessment document including executive summary

Final Assessment document including executive summary

Executive presentation

Executive presentation

Analysis of User Satisfaction

Questionnaire

Analysis of User Satisfaction

Questionnaire



1. How satisfactory do you find overall system operation? 1. How satisfactory do you find overall system operation?

5Excellent

4Very good

3Good

2Fair

1Poor

2. Judged by the Analysis requirements, how is the system?2. Judged by the Analysis requirements, how is the system?

5Excellent

4Very good

3Good

2Fair

1Poor

3. How does the system contributes to your ongoing work?3. How does the system contributes to your ongoing work?

5Excellent

4Very good

3Good

2Fair

1Poor

4. How do you rate the system’s user-friendliness?4. How do you rate the system’s user-friendliness?

5Excellent

4Very good

3Good

2Fair

1Poor



5. How do you rate the level of data security?5. How do you rate the level of data security?

5Excellent

4Very good

3Good

2Fair

1Poor

6. How do you rate the availability & reliability of the system?6. How do you rate the availability & reliability of the system?Poor

5Excellent

4Very good

3Good

2Fair

1Poor

7. How do you rate change management and repair work?7. How do you rate change management and repair work?

5Excellent

4Very good

3Good

2Fair

1Poor

8. How do you rate the Users’ forum?8. How do you rate the Users’ forum?

5Excellent

4Very good

3Good

2Fair

1Poor


Assessment Document

Executive summary Background & general description Findings & recommendations Lessons for the organization

0. Administration Participants in the Assessment Relevant documentation Assessment chronology, including noteworthy events


Assessment Document

What did Analysis establish? What are the

industry/organization standards?

What changed during system development?

What was actually implemented?

Are there problems? If so, what should be done?

Are there benefits? If so, can they be replicated elsewhere in the organization?

Assessment according

to the SCT:

1. Goals

2. Application

3. Technology

4. Implementation

5. Cost


Assessment Document

4.2 Project work plan – Assessment of project life cycle

Was each phase orderly? How was the cost, in relation to norms of the industry

or organization? Was orderly documentation produced in accordance

with MethodA? Were custom procedures written? Were systematic reviews conducted?


Assessment Document

Appendices Analysis of the User Satisfaction Questionnaire Additional topics

The process of analyzing alternatives and making decisions

Problem solving

Degree of user satisfaction

Use of methodologies


Taking the system off line

System in development

System in operation &

maintenance

Cancel or freeze the project

Fix problems and prevent new

problems

Bring the system down temporarily

for repair

Bring a new system in or

an old one back

On-the-fly improvements

Fix problems

Improve next version

Life cycle

Decision

Project-level Decisions


Lessons from Assessment

About project management for the organization Time estimates and scheduling Building and managing teams Working with outsiders Cost estimation Professional training Management tools & engineering tools


Lessons from Assessment

About the whole organization’s infrastructure Applicability of new technology Communications

With clients and users

With individual workers

With other departments

Time management Knowledge sharing Professional up-skilling


List of Subjects







Quality Assurance

Who is the Assessor, and how connected to the project?

Any similar assessments in the past?

What’s the exact mandate? Does it define what to assess and what not to?

Was a steering committee appointed? Limited to the project, or with wider authority?

Was the mandate fulfilled, nothing skipped?

Are the lessons being applied?


List of Subjects







In conclusion

Words from the Sages Who is wise? The one who learns from every person

(Avot 4:1) No one else brings wisdom like a person who brings

experience (Milei Avot 10)

Words from the street To err once is understandable, to err twice is

unforgivable (Anon.) Smart people get out of situations that wise people

don’t get into (Anon.)

Be a wise project manager, not a Be a wise project manager, not a smart onesmart one

Be a wise project manager, not a Be a wise project manager, not a smart onesmart one


www.methoda.com

www.methoda.com methodassess system assessment. methoda computers ltd 2 list of subjects 1....

Documents

methoda computers

poor slide

system assessment goal

assessment stresses

project level

testing slide

act slide

unusual slide