be agile, test! a partnership to implement testing in agile · life of a sct agile tester tomorrow...
TRANSCRIPT
© 2019 Sogeti. All rights reserved.
Be agile, test!A Partnership to Implement Testing in Agile
© 2019 Sogeti. All rights reserved.
AirFrance-KLM Service Center Test Testimony
© 2019 Sogeti. All rights reserved. 3
AF-KLM Context
AF-KLM: An alliance born in 2004
Group priority was to make use of existing synergies
between Air France and KLM
AF-KLM launched a transformation plan in 2012 to cope with the air transport crisis: “Transform
2015” aimed to improve customer service, increase competitiveness and return to a balanced
budget
In 2015, AF-KLM continues its transformation with a new plan based on the previous one:
“Perform 2020” aims to reduce costs by 1.5% every year over the period
“Perform 2000” harnesses IT service centres with requests for synergies, productivity gains and
implementation of Agile methodologies
© 2019 Sogeti. All rights reserved. 4
“Perform 2020” impact on Service Center Test (SCT)
AF-KLM test organisation in 2015:
• 2 independent test centres in Valbonne, Toulouse and Paris for Air France and Schiphol for KLM
• Providing testers to the projects but with some test projects in Toulouse
• V-Cycle almost everywhere
• No obligation for the projects to use the test centres
SCT AF-KLM created in 2016:
• Including the 2 previous test centres
• With a single manager
AF-KLM goals are:
• Standardise testing practices between Air France and KLM to get a real European test centre
• Get an entity with strong testing expertise to secure the transition to agile (SAFe compliant)
• Control cost for testing by providing fix price services to the projects
• Optimise the efficiency of testing activities by 15% within 2 years
© 2019 Sogeti. All rights reserved. 5
Partnership AF-KLM / Sogeti
AF-KLM selected Sogeti France and Sogeti Netherlands in 2016 as exclusive partners
to help it in its transformation on testing and creation of the SCT
Why Sogeti?
• Sogeti demonstrated capabilities to handle test projects in Toulouse during more than 4 years:
An industrial approach of testing including the use of Model Based Testing and a Test Data Management process supported by tools
A cost reduction of testing on some projects with fix price activities
• Sogeti was the major provider of testing resources in Valbonne and Toulousealready organised in test centre since 2013
• Sogeti testing offer was available in France and in the Netherlands
• Sogeti had available several assets to speed up the transformation:
A complete testing offer
An industrial testing delivery center located in Bordeaux (ESTC)
A proven service catalogue that can be customised to stick to the context
A reputed knowledge in implementing testing in agile projects
© 2019 Sogeti. All rights reserved. 6
An innovative way of doing a partnership
Partnership cornerstones:
• A contract built together during workshops
• A relationship where both parties are considered as equal
• The ambition to bring together fix price and agility
Translated into:
• A limited set of KPIs to measure the efficiency improvementand the projects satisfaction linked to a financial Bonus/Malus
• A common selling approach of the test service catalogue to the projects
• 7 months forecasted to transform the SCT activities from Time & Material to Service
• A SCT service catalogue created from the proven Sogeti service catalogue
• ESTC (Sogeti Test Delivery Centre in Bordeaux) usage for test on demand, flexibility and cost optimisation
© 2019 Sogeti. All rights reserved. 7
From T&M to Service
T0 – V-cycle & Agile test service catalogue set up
• Services stem from the Sogeti standard service catalogue
• Services are adjusted to fit AF-KLM context
• Pricing and financial model tuned regarding AF-KLM context
• Co-selling of services as soon as they are made available
T1 – AF-KLM service catalogue implemented for existing
activities
• T0 + 7 months
• Abacus trial run
T2 – AF-KLM service catalogue and pricing approved
• T1 + 3 months
• New services added to the AF-KLM service catalogue
Top AFKL Service Lines
LS-1.1.1 – Functional Skill Development
LS-2.2.3 – Agile – Sprint Test Strategy
LS-3.1.1 – Customize Test Tool
LS-6.1.2 – Design/Execute Physical Test Data
LS-3.2.4 – Design Customer Acceptance Tests Cases
LS-3.2.5 – Design Automated Test Cases
LS-3.2.6 – Design Regression Test Cases
LS-3.1.5 – Design Web Services Test Cases
LS-4.2.4 – Execute Customer Acceptance Test Cases
LS-4.2.5 – Execute Automated Test Cases
LS-4.2.5 – Execute Regression Test Cases
LS-4.2.6 – Execute Web Services Test Cases
LS-3.1.6 – Test cases design rework
© 2019 Sogeti. All rights reserved. 8
SCT Offer to the Projects
© 2019 Sogeti. All rights reserved. 9
SCT support to Agile Projects
© 2019 Sogeti. All rights reserved. 11
Contracting Services for Projects
Signature of a “Service Agreement” between SCT and
the projects:
• Commitment of SCT
• Duration / Number of sprints
• List of services to be delivered / price for these services
• Deliverables
For new projects, we start by providing one or two testers
that are part of the team and located with the team
or a test manager to study the needs
When a project is mature enough in agility (“Aware” or “Mature”) and the trust is there with
our testers, a test mentor is assigned to the project and part of the testing activities is
outsourced to Bordeaux:
• Test automation
• GUI testing
• Mobile compatibility testing
• Performance testing
© 2019 Sogeti. All rights reserved. 12
Outsourcing Activity to ESTC (Bordeaux)
A “Core Team” is created in Bordeaux to be ready to handle new projects
• A stock of testers equal to 20% of the SCT workforce that can be made quickly available
• Trained to SCT context, processes and tools
• AF-KLM accreditation process done (one month delay)
• AF-KLM credentials and emails created
Outsourcing process: A tester from ESTC is incorporated to the agile team on site during one
or two sprints to bring the confidence and get the knowledge:
• Perimeter
• Services to deliver
• Repositories
A Checklist is signed by the tester and the Project Manager at the end of the acquisition period
© 2019 Sogeti. All rights reserved. 13
Project Sample – Distributed Agile with Bordeaux
Valbonne Bordeaux
Agile Dev Team
TestersDevelopers
Service
Manager
SOGETI
Scrum
Master
Test Manager AFKL
© 2019 Sogeti. All rights reserved. 14
Communication
A common set of tools on every location
• Chat and screen sharing: Skype Enterprise with a comfortable headset
• Written communication: Outlook
• Team communication: Microsoft Teams with channels per community (Cucumber, RF, …)
• Collaborative tool: Confluence
• Repositories: Xray, ALM, Jira, Git-Stash
SAFe ceremonies done with Skype entreprise (Retro, Refinement…) but PIs which take place on-site
© 2019 Sogeti. All rights reserved. 15
Team Building
Team Building activities
• Share & Care – Team building and experience sharing
• Steering committee taking place alternatively on each location
• Testing Day twice a year with technical demos and a roadmap review
• Service Demo to share innovative subjects (BDD, Mobile Testing, Continuous Testing)
© 2019 Sogeti. All rights reserved. 16
2018 Achievements
80% increase of SCT usage by projects
100% of activity delivered in service mode
20% of perimeter outsourced to Bordeaux
9% of test cost reduction
3 years renewal for the partnership
1 team of 70 Sogeti testers in France and in The Netherlands to go along with AF-KLM
© 2019 Sogeti. All rights reserved.
Life of a SCT Agile Tester
© 2019 Sogeti. All rights reserved. 18
Life of a SCT Agile Tester
Steven - 25 years old
Graduated from Engineer National School
this year
6 month of experience
He is « connected » all the day
He is a frequent traveller
Extrovert personality
© 2019 Sogeti. All rights reserved. 19
Life of a SCT Agile Tester
Steven starts its day by a
connection via Webex to
the Daily meeting
He’s involved and an active
actor in all Agile
ceremonies of the teamActively acquire information
from stakeholders
© 2019 Sogeti. All rights reserved. 20
Life of a SCT Agile Tester
During the last
Retrospective, it has been
decided to follow up one
time by week the unit test
coverage. He’s the owner
of the action
He gets from Carole(dev) during the
daily that this afternoon a new US will
be ready for test
No matter for him, design and
implementation are ready (Gherkins),
only last review by the BA is missing.
He planned to phone him in 5 min to
close it definitely
Plan and organize his
own work
Respond to change quickly,
including changing, adding, or
improving test cases
© 2019 Sogeti. All rights reserved. 21
Life of a SCT Agile TesterTomorrow is the day of the
Sprint Review and Retro in
AMS
He’s preparing the Test
report, the Scrum Master
has planned a slot of
20min to let Steven
presenting it
It is each time a
good moment to see
the whole team and
share directly their
feelings with all other
colleagues
Communication / Interaction
© 2019 Sogeti. All rights reserved. 22
Life of a SCT Agile Tester
Steven démarre sa
journée par une connexion
via Skype pour
le Daily meeting
Il est intégré et un acteur
actif dans toutes les
cérémonies agiles
Agile Tester role at SCT:
Understanding and implementing the Agile Test Strategy
Participating actively to all Agile ceremonies
Measuring and reporting test coverage
Configuring, using, and managing test environments, test data and testing tools
Designing, Writing and executing automated/manual tests
Reporting defects and working with the team to resolve them
© 2019 Sogeti. All rights reserved. 23
Life of a SCT Agile Tester
In 2 month, the project of
Steven is joining the Safe
Train OPS
The Test Strategy of this
Train is BDD oriented using
Cucumber
What should
happened now:
Adaptation?
Reorganisation ?
© 2019 Sogeti. All rights reserved.
About Sogeti
Learn more about us at
www.sogeti.com
This message contains information that may be privileged or confidential and is the property of the Capgemini Group.
Copyright© 2018 Sogeti. All rights reserved.
Sogeti is a leading provider of technology and engineering services. Sogeti deliverssolutions that enable digital transformation and offers cutting-edge expertise in Cloud,Cybersecurity, Digital Manufacturing, Digital Assurance & Testing, and emergingtechnologies. Sogeti combines agility and speed of implementation with strong technologysupplier partnerships, world class methodologies and its global delivery model,Rightshore®. Sogeti brings together more than 25,000 professionals in 15 countries,based in over 100 locations in Europe, USA and India. Sogeti is a wholly-owned subsidiaryof Capgemini SE, listed on the Paris Stock Exchange.