通往測試最高殿堂的旅程 - gtac 2016
TRANSCRIPT
![Page 1: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/1.jpg)
通往軟體測試最高殿堂的旅程
Chloe Chen (KKBOX)
![Page 2: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/2.jpg)
ABOUT ME #ChloeChenSET in
KKBOX
Dog Lover Love Puppet Show
FB: chloe.chen.727GMail: chloechen727
![Page 3: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/3.jpg)
ABOUT GTAC 2016● 10th GTAC ● 1400 attendee applications
250 attendance
● 208 speaker proposals, 21 Talks in 10 hrs
○ 1hr Keynote: 2○ 30 min. Presentation: 9○ 15 sec. Lightning Talk: 10
![Page 4: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/4.jpg)
23 SPEAKERS
![Page 5: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/5.jpg)
Subject #1 - Experience Sharing
● Evolution of Business and Engineering Productivity
![Page 6: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/6.jpg)
![Page 7: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/7.jpg)
![Page 8: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/8.jpg)
![Page 9: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/9.jpg)
![Page 10: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/10.jpg)
![Page 11: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/11.jpg)
![Page 12: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/12.jpg)
![Page 13: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/13.jpg)
![Page 14: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/14.jpg)
![Page 15: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/15.jpg)
![Page 16: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/16.jpg)
![Page 17: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/17.jpg)
Some granular metrics we track ● Changlist to production Latency● Code coverage● Presubmit greenness● Dashboard development● Test clusters● Intelligent selection of release candidate
change list● Release process...
![Page 18: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/18.jpg)
![Page 19: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/19.jpg)
![Page 20: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/20.jpg)
![Page 21: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/21.jpg)
Q &A Test Self-Driving?
Automated test : Manual test =
Machine learing software is better test in Production?
How much time was presubmit phase take?
How do we test the test themselves?
Not yet.
95% : 5%
It will make sense to kind of test before it hits production.
It take about 10 days, but I want to say a good 2 or 3 days in the pre-submit phase
We are getting assurance from different ways that your software is behaving correctly.
![Page 22: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/22.jpg)
Subject #2 - Tools
● Developer Experience, FTW!○ Test Lab - Firebase○ Espresso
![Page 23: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/23.jpg)
![Page 24: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/24.jpg)
![Page 25: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/25.jpg)
![Page 26: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/26.jpg)
![Page 27: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/27.jpg)
![Page 28: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/28.jpg)
![Page 30: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/30.jpg)
![Page 31: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/31.jpg)
Test Lab - Robo● Choose Device/
Simulator
● Let you can do Login
![Page 32: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/32.jpg)
Test Lab - Robo● Provide crawl report
○ Log○ Screenshot○ Flowchart○ Record
![Page 33: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/33.jpg)
Test Lab - Run Script on Devices● Upload apk
& test apk
● Choose Device/ Simulator
![Page 34: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/34.jpg)
● Provide devices report○ Cases○ Log○ Record
Test Lab - Run Script on Devices
![Page 35: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/35.jpg)
Test Lab● Crawler is not very
smart, suggest to use your own test script to test
![Page 36: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/36.jpg)
![Page 37: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/37.jpg)
![Page 38: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/38.jpg)
![Page 39: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/39.jpg)
![Page 40: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/40.jpg)
![Page 41: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/41.jpg)
![Page 42: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/42.jpg)
![Page 44: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/44.jpg)
![Page 45: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/45.jpg)
![Page 46: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/46.jpg)
![Page 47: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/47.jpg)
![Page 48: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/48.jpg)
![Page 50: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/50.jpg)
![Page 51: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/51.jpg)
![Page 52: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/52.jpg)
ABOUT MEQ &A
What should small startup needs to start instroducing automation?
Firebase support geo/real purchases/ memory leak tests ?
Firebase support Stress/ Performance/ Security tests?
How to deal with privacy data ?
Keep pre-lauch report for every version submitted?
if you can unit test, unit test it.
No, stay tuned/ in our roadmap.
Yes, but you need to write those test.
It will look for patterns for privacy data and scrumb them out.All tests are fresh install.
No. Because law...
![Page 53: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/53.jpg)
ABOUT MEQ &A
Firebase v.s. Crashlytics, Crittercism
Firebase test with Game app?
再更智能一點嗎?像是撒 seeding
Support Penetration testing?
Support Wi-Fi/ Bluetooth connected device test?
We have a lot of people who also continue to use Crashlytics side by side.
Games has been a very challenging thing for us.
Under working.
We did a whole bunch of basic security crawls.
Not yet. We don't have good hardware solutions.
![Page 54: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/54.jpg)
GTAC 2017 in London (Spring)
![Page 55: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/55.jpg)
Questions?
![Page 56: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/56.jpg)
Thank You
![Page 57: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/57.jpg)
btw, We Need You!
資深自動化軟體測試工程師
軟體測試工程師 (SET)
下午茶免費販賣機
國外旅遊 免費參加演唱會近距離接觸偶像
每年重金送你去 GTAC ! A_Ay
R.G.B95. 96. 98
![Page 58: 通往測試最高殿堂的旅程 - GTAC 2016](https://reader033.vdocuments.site/reader033/viewer/2022051304/58cf31c01a28ab00168b5a89/html5/thumbnails/58.jpg)
Reference● GTAC 2016● GTAC 2016 Day 1 Slide● GTAC 2016 Day 2 Slide● FireBase (Android) Getting Started● Firebase in a Weekend: Android