mse studio: automated test framework

30
The Mappers: “We find MSE Studio: Automated Test Framework Middle of Semester Presentation 1 Presenter: António Pedro Alvim The Mappers team 2008-10-17

Upload: makana

Post on 24-Feb-2016

32 views

Category:

Documents


0 download

DESCRIPTION

MSE Studio: Automated Test Framework. Middle of Semester Presentation. 2008-10-17. Presenter: António Pedro Alvim The Mappers team. 1. Agenda. Project background Team organization Project roadmap Reflections Questions. 2. Agenda. Project background Team organization - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

MSE Studio: Automated Test

FrameworkMiddle of Semester Presentation

1

Presenter: António Pedro AlvimThe Mappers team

2008-10-17

Page 2: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions

2

Page 3: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions

3

Page 4: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Project background

Q/A Department– Internal/external projects quality assurance

ATF will be one integrated tool which facilitates the testing process by taking into consideration the Q/A unit best practices and enables to work in a more efficient way.

4

Page 5: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Project background

Our understanding:

– Reduced test time– Time consuming

methodology– Manual and repetitive work

process– Varied tools and artifacts– Varied testing approaches

5

Client view:

– Lack of traceability between requirements and test

– Best practices to be implemented

– Lack of automation

Page 6: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Client negotiation– Scope– Expectations management

Definition of threshold of success:– Information system?– Automation of test cases generation from

requirements?– Integration with other tools currently used?

Major Challenges

6

Page 7: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions

7

Page 8: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Team

Name

António Pedro Alvim

Paulo Casanova

Filipe Pontes

Pedro Mota

Pedro Saraiva

Role

Team LeaderCommunication

ManagerProcess Manager

Configuration and

Team ManagerClient Manager Support

Manager

Functions

• Plan, WBS, Task management• Meetings schedule

• Define Processes

• Control Versions• Control team roles• Deliverables Coherency

• Manage Client Interaction

• Tools instalation and Management

Mentors: Mário Rela, David Root, Marco Vieira8

Page 9: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

ProcessesMeetings:– Internal (weekly)

status | brainstorming |reflection– Mentors (weekly)– Client - Project Manager

• Phone, e-mail (weekly), personal– Agenda and minute tracking for all meetings– Action item tracking

Tools:– Mediawiki, SVN, Bugzilla

9

Page 10: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

ProcessesPlanning:– WBS and time allocation:

• Top down definition• Bottom up time estimation

– Weekly data gathering of all team members– On going measure of expected/actual budget

• re-adapt wrong estimations

Earned Value ManagementRisk analysis:– Identification and plan on mitigation

10

Page 11: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions

11

Page 12: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Roadmap

Logistical setupTeam organizationDocumentation analysisFall Semester planning– WBS– Schedule

Outlines for fall deliverablesContextual Interviews

Wrapping up contextual design– Consolidation– Client Walkthroughs

Drafts for fall deliverablesOn going reflections– Meetings and

processes– Schedule reviewing

Get client feedbackScope negotiationRisk WorkshopFinish Studio Fall DeliverablesRequirements specification

We’ve done We’re doing We’re going to do

12

Page 13: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

RequirementsTechniques for elicitation used:– Client Interviews

• Needs for the application– Contextual Design

• 2 rounds of interviews with 20% of end-users

Analyzing techniques for specification

13

Page 14: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

ScheduleSection of planning detail:

Note: not effort, but calendar and sequence indication

14

Page 15: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Note: time excluding bootcamp.

15

0/100% Rule

Page 16: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Next StepsChoose appropriate software development processStart requirements specificationRisk assessment workshop – After better defined requirements

16

Page 17: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions

17

Page 18: MSE Studio:  Automated Test Framework

The Mappers: “We find your way” 18

ReflectionsTeam work– Entire team involved on major decisions– Trade-off: budget vs. information sharing– Meeting time keeper helps to keep focus– Information record

• Rationale behind decisions

Client presented solution upfront– Understand problem before solution– Currently mitigated with requirements elicitation

18

Page 19: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

ReflectionsPlan ahead is important– Proactive: Risk and Impact discovery– Future work (calendar deadline identification)– Estimations should consider technique learning curve

Need to improve our EVM usageContextual design– Multi dimensional analysis of the problem– Unveils hidden information– Useful to understand client’s culture– Expensive

19

Page 20: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions

20

Page 21: MSE Studio:  Automated Test Framework

The Mappers: “We find your way” 21

Questions for mentorsEVM – to improve project control:– Break the management tasks across the different

weeks?• Meetings• Support• Processes Management• Configuration Management• …

21

Page 22: MSE Studio:  Automated Test Framework

The Mappers: “We find your way” 22

Questions for mentorsBest timing for scope discussion with client?Our approach:– 1st : Present our Vision

• Result from Contextual Design Consolidation• Show new solution identified by our vision

– 2nd: Present UED Diagram • Estimates for focus areas• Teams’ studio budget• Let the costumer decide what to build

22

Page 23: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Questions

We want to listen to your questions!

23

Page 24: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Roles - DetailedName Role Responsibility

António Pedro Alvim

Team Leader

Communications Manager

Control calendar and WBSSchedule meetingsMeetings agenda/minutesDefine document templatesTask management in bugzilla

Paulo Casanova Process Manager Define processes Pedro Mota Client Manager Client interaction

Filipe PontesTeam Manager

Configuration Manager

Control Team RolesMaintain Team Contacts Guarantee that deliverables are coherent Control versions

Pedro Saraiva Support Manager Tools Installation/ManagementSupport

24

Page 25: MSE Studio:  Automated Test Framework

The Mappers: “We find your way” 25

Contextual Design – Why?Need to understand work process and Q/A Context – Share information across team

Identify users involved in the work process– end users: Tester / Team Leader / Project Manager– Artifact/tool usage in projects

End-user involvement– 20% interview coverage– identification of relevant work issues:

– Flow, sequence, culture, artifacts– New technique for team

Page 26: MSE Studio:  Automated Test Framework

The Mappers: “We find your way” 26

Software Development Lifecycle

Still have to define what final application will include:– Information System– Automated Prototype– Management dashboard

This will influence the choice of an appropriate lifecycle

Page 27: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Mitigation plan available No mitigation plan available Risk mitigated

Risk assessmentRisk and mitigation plan (if available) Status

Client has a solution to the problem; we might not be able to perform requirements elicitationShare our vision that resulted from contextual design – which addresses most of the problems identified in interviews

Client has a different vision than we do; she might requires us to change our visionWe will show that our vision is broader than hers and brings more benefits

Our project schedule is tight; this may cause a project delayClosely monitor progress and deliveries. Re-plan accordingly.

27

Page 28: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Planning – Process

When Task Team Leader

All Team

Everyday Register Studio hours in personal file

Sunday Report Studio hours in a Central Repository

Monday Analyze Reported vs Planned hours for meeting discussion

Monday Internal Meeting: Point-of-Situation, Plan discussion

Monday Plan and report changes approved in internal meeting

Wednesday Mentors Meeting status report

28

Page 29: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Planning – EstimationEstimation Methods:– Expert Judger– Based on prior experience– Tailored Wideband Delphi

Estimation period:– For recurrent weekly tasks– Total task time

To do: define process for planning reschedule

29

Page 30: MSE Studio:  Automated Test Framework

The Mappers: “We find your way”

Planning - StrategiesMeasures of Plan Success

AvailableEffort

PlannedEffort

ActualEffort

BCW Scheduled

BCWPerformed

30