agile and devops teams: test value first!!! - testing value...agile and devops teams: test value...
TRANSCRIPT
![Page 1: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/1.jpg)
1
Agile and DevOps teams: test value first!!!
LAURENT PY
@[email protected]://hiptest.net
VINCENT PRETRE
[email protected]://hiptest.net
![Page 2: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/2.jpg)
HIPTEST COMMUNITY
2
37%15% 22%
5%
13%
4%
4%
CountriesOrganizations
+1000 +130
users
20000
![Page 3: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/3.jpg)
PLAN
3
Testing inDevOps
Step 1 :Testing theidea
Step 2 :Testing thecode
Step 3 :Testing inproduction
Step 4 :GOTOstep 1
Conclusion :Benefits
![Page 4: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/4.jpg)
TESTING IN DEVOPS
4
![Page 5: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/5.jpg)
5
DEVOPS : BIGGEST OPPORTUNITY?
SPEEEEEED
![Page 6: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/6.jpg)
6
DEVOPS : BIGGEST OPPORTUNITY
![Page 7: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/7.jpg)
TESTING IN DEVOPS
7
1) Which value do we want to deliver?
2) Is the feature’s implementation aligned with that?
3) Does the feature have a real impact on the end user?
4) Is the UX great and what’s the feature usage in time ?
![Page 8: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/8.jpg)
STEP 1: TESTING THE IDEA
8
![Page 9: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/9.jpg)
WHY?
Challenge business assumptions
![Page 10: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/10.jpg)
10
• Use personae to create intimacy between users and the team
• Define business assumptions
• Behavior Driven Development (BDD) to capture the behavior
WHICH VALUE DO WE WANT TO DELIVER?
![Page 11: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/11.jpg)
11
• Create a shared understanding based on examples• Using a common business terminology• Define the stop• Once automated the examples become a living
documentation
BDD IN A NUTSHELL
![Page 12: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/12.jpg)
12
User interview +
BDD – CAPTURE THE BEHAVIOR
![Page 13: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/13.jpg)
13
• Using Gherkin syntax with declarative style• Using a consistent business terminology
• Refactoring continuously your tests
GOOD PRACTICES
![Page 14: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/14.jpg)
CONTINUOUS TESTING
14
Test
Testcontinuouslyyoursoftwarefromideatoproduction
Idea Dev Production
Test Test
![Page 15: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/15.jpg)
STEP 2: TESTING THE
CODE
15
![Page 16: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/16.jpg)
16
1. In step 1 we have created a shared understanding of the feature
2. The dev team can develop a first increment of the feature
3. Integration to CI/CD pipeline
DEVELOPMENT
![Page 17: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/17.jpg)
2 - Refine with examples1 – Manage Backlog 3 - Implement the stories
4 – Create builds and run tests5 – Deploy in production
Results
TESTING PROCESS AT HIPTEST
17
![Page 18: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/18.jpg)
18
100% of our checks (scenarios) are automated
AUTOMATION
AND
It is expensive
![Page 19: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/19.jpg)
19
Credit to Martin Fowler
• 550 tests BDD
• 1600 tests Ember
• 3700 tests Rspec
OUR AUTOMATED TESTS
![Page 20: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/20.jpg)
CONTINUOUS TESTING
20
Test
Testcontinuouslyyoursoftwarefromideatoproduction
Idea Dev Production
Test Test
![Page 21: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/21.jpg)
STEP 3: TESTING IN
PRODUCTION
21
![Page 22: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/22.jpg)
22
1. In Step 2 we have validated the implementation
2. The feature is rolled out using a switch (GA or progressive)
MAKING THE FEATURE AVAILABLE
![Page 23: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/23.jpg)
23
Appsignal,Pingdom,Scalingo etLogmatic/datadog
APPLICATION PERFORMANCE MANAGEMENT
![Page 24: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/24.jpg)
24
THE MATCH
Correctness Availability
![Page 25: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/25.jpg)
25
MEASURE USAGE CONTINUOUSLY
• Measure usage- NB users- NB requests…
• Measure impact- Sign-up- Revenue- Retention…
![Page 26: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/26.jpg)
26
Notification feature• Usage- NB clicks NB of notifications- NB users
• Business: none
Refactoring feature• Usage- NB refactoring actions- NB of impacts
• Business: retention
EXAMPLES
![Page 27: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/27.jpg)
27
LIVE CHAT FOR REAL TIME FEEDBACK
![Page 28: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/28.jpg)
28
LIVING DOCUMENTATION
![Page 29: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/29.jpg)
CONTINUOUS TESTING
29
Test
Testcontinuouslyyoursoftwarefromideatoproduction
Idea Dev Production
Test Test
![Page 30: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/30.jpg)
ETAPE 4: LET’S ITERATE
30
![Page 31: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/31.jpg)
31
1. In step 3 we have measured the impact
2. The feature can be removed (with the tests), enhanced or validated
3. GoTo step 1
LET’S ITERATE
![Page 32: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/32.jpg)
CONCLUSION
32
![Page 33: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/33.jpg)
33
•Test value first
• Incremental investment in quality
•Context suitable to experiments
BENEFITS OF TESTING IN DEVOPS
![Page 34: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/34.jpg)
Making something nobody want
THE BIGGEST RISK
![Page 35: Agile and DevOps teams: test value first!!! - Testing value...Agile and DevOps teams: test value first!!! LAURENTPY @py_laurent laurent.py@hiptest.net ... 15% 22% 5% 13% 4% 4% Organizations](https://reader035.vdocuments.site/reader035/viewer/2022062602/5edd1d72ad6a402d666815d4/html5/thumbnails/35.jpg)
A HUGE THANK YOU!
LAURENT PY
@[email protected]://hiptest.net
VINCENT PRETRE
[email protected]://hiptest.net