mse studio: automated test framework
DESCRIPTION
MSE Studio: Automated Test Framework. Middle of Semester Presentation. 2008-10-17. Presenter: António Pedro Alvim The Mappers team. 1. Agenda. Project background Team organization Project roadmap Reflections Questions. 2. Agenda. Project background Team organization - PowerPoint PPT PresentationTRANSCRIPT
The Mappers: “We find your way”
MSE Studio: Automated Test
FrameworkMiddle of Semester Presentation
1
Presenter: António Pedro AlvimThe Mappers team
2008-10-17
The Mappers: “We find your way”
AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions
2
The Mappers: “We find your way”
AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions
3
The Mappers: “We find your way”
Project background
Q/A Department– Internal/external projects quality assurance
ATF will be one integrated tool which facilitates the testing process by taking into consideration the Q/A unit best practices and enables to work in a more efficient way.
4
The Mappers: “We find your way”
Project background
Our understanding:
– Reduced test time– Time consuming
methodology– Manual and repetitive work
process– Varied tools and artifacts– Varied testing approaches
5
Client view:
– Lack of traceability between requirements and test
– Best practices to be implemented
– Lack of automation
The Mappers: “We find your way”
Client negotiation– Scope– Expectations management
Definition of threshold of success:– Information system?– Automation of test cases generation from
requirements?– Integration with other tools currently used?
Major Challenges
6
The Mappers: “We find your way”
AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions
7
The Mappers: “We find your way”
Team
Name
António Pedro Alvim
Paulo Casanova
Filipe Pontes
Pedro Mota
Pedro Saraiva
Role
Team LeaderCommunication
ManagerProcess Manager
Configuration and
Team ManagerClient Manager Support
Manager
Functions
• Plan, WBS, Task management• Meetings schedule
• Define Processes
• Control Versions• Control team roles• Deliverables Coherency
• Manage Client Interaction
• Tools instalation and Management
Mentors: Mário Rela, David Root, Marco Vieira8
The Mappers: “We find your way”
ProcessesMeetings:– Internal (weekly)
status | brainstorming |reflection– Mentors (weekly)– Client - Project Manager
• Phone, e-mail (weekly), personal– Agenda and minute tracking for all meetings– Action item tracking
Tools:– Mediawiki, SVN, Bugzilla
9
The Mappers: “We find your way”
ProcessesPlanning:– WBS and time allocation:
• Top down definition• Bottom up time estimation
– Weekly data gathering of all team members– On going measure of expected/actual budget
• re-adapt wrong estimations
Earned Value ManagementRisk analysis:– Identification and plan on mitigation
10
The Mappers: “We find your way”
AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions
11
The Mappers: “We find your way”
Roadmap
Logistical setupTeam organizationDocumentation analysisFall Semester planning– WBS– Schedule
Outlines for fall deliverablesContextual Interviews
Wrapping up contextual design– Consolidation– Client Walkthroughs
Drafts for fall deliverablesOn going reflections– Meetings and
processes– Schedule reviewing
Get client feedbackScope negotiationRisk WorkshopFinish Studio Fall DeliverablesRequirements specification
We’ve done We’re doing We’re going to do
12
The Mappers: “We find your way”
RequirementsTechniques for elicitation used:– Client Interviews
• Needs for the application– Contextual Design
• 2 rounds of interviews with 20% of end-users
Analyzing techniques for specification
13
The Mappers: “We find your way”
ScheduleSection of planning detail:
Note: not effort, but calendar and sequence indication
14
The Mappers: “We find your way”
Note: time excluding bootcamp.
15
0/100% Rule
The Mappers: “We find your way”
Next StepsChoose appropriate software development processStart requirements specificationRisk assessment workshop – After better defined requirements
16
The Mappers: “We find your way”
AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions
17
The Mappers: “We find your way” 18
ReflectionsTeam work– Entire team involved on major decisions– Trade-off: budget vs. information sharing– Meeting time keeper helps to keep focus– Information record
• Rationale behind decisions
Client presented solution upfront– Understand problem before solution– Currently mitigated with requirements elicitation
18
The Mappers: “We find your way”
ReflectionsPlan ahead is important– Proactive: Risk and Impact discovery– Future work (calendar deadline identification)– Estimations should consider technique learning curve
Need to improve our EVM usageContextual design– Multi dimensional analysis of the problem– Unveils hidden information– Useful to understand client’s culture– Expensive
19
The Mappers: “We find your way”
AgendaProject backgroundTeam organizationProject roadmapReflectionsQuestions
20
The Mappers: “We find your way” 21
Questions for mentorsEVM – to improve project control:– Break the management tasks across the different
weeks?• Meetings• Support• Processes Management• Configuration Management• …
21
The Mappers: “We find your way” 22
Questions for mentorsBest timing for scope discussion with client?Our approach:– 1st : Present our Vision
• Result from Contextual Design Consolidation• Show new solution identified by our vision
– 2nd: Present UED Diagram • Estimates for focus areas• Teams’ studio budget• Let the costumer decide what to build
22
The Mappers: “We find your way”
Questions
We want to listen to your questions!
23
The Mappers: “We find your way”
Roles - DetailedName Role Responsibility
António Pedro Alvim
Team Leader
Communications Manager
Control calendar and WBSSchedule meetingsMeetings agenda/minutesDefine document templatesTask management in bugzilla
Paulo Casanova Process Manager Define processes Pedro Mota Client Manager Client interaction
Filipe PontesTeam Manager
Configuration Manager
Control Team RolesMaintain Team Contacts Guarantee that deliverables are coherent Control versions
Pedro Saraiva Support Manager Tools Installation/ManagementSupport
24
The Mappers: “We find your way” 25
Contextual Design – Why?Need to understand work process and Q/A Context – Share information across team
Identify users involved in the work process– end users: Tester / Team Leader / Project Manager– Artifact/tool usage in projects
End-user involvement– 20% interview coverage– identification of relevant work issues:
– Flow, sequence, culture, artifacts– New technique for team
The Mappers: “We find your way” 26
Software Development Lifecycle
Still have to define what final application will include:– Information System– Automated Prototype– Management dashboard
This will influence the choice of an appropriate lifecycle
The Mappers: “We find your way”
Mitigation plan available No mitigation plan available Risk mitigated
Risk assessmentRisk and mitigation plan (if available) Status
Client has a solution to the problem; we might not be able to perform requirements elicitationShare our vision that resulted from contextual design – which addresses most of the problems identified in interviews
Client has a different vision than we do; she might requires us to change our visionWe will show that our vision is broader than hers and brings more benefits
Our project schedule is tight; this may cause a project delayClosely monitor progress and deliveries. Re-plan accordingly.
27
The Mappers: “We find your way”
Planning – Process
When Task Team Leader
All Team
Everyday Register Studio hours in personal file
Sunday Report Studio hours in a Central Repository
Monday Analyze Reported vs Planned hours for meeting discussion
Monday Internal Meeting: Point-of-Situation, Plan discussion
Monday Plan and report changes approved in internal meeting
Wednesday Mentors Meeting status report
28
The Mappers: “We find your way”
Planning – EstimationEstimation Methods:– Expert Judger– Based on prior experience– Tailored Wideband Delphi
Estimation period:– For recurrent weekly tasks– Total task time
To do: define process for planning reschedule
29
The Mappers: “We find your way”
Planning - StrategiesMeasures of Plan Success
AvailableEffort
PlannedEffort
ActualEffort
BCW Scheduled
BCWPerformed
30