通往測試最高殿堂的旅程 - gtac 2016

通往軟體測試最高殿堂的旅程

Chloe Chen (KKBOX)

ABOUT ME #ChloeChenSET in

KKBOX

Dog Lover Love Puppet Show

FB: chloe.chen.727GMail: chloechen727

ABOUT GTAC 2016● 10th GTAC ● 1400 attendee applications

250 attendance

● 208 speaker proposals, 21 Talks in 10 hrs

○ 1hr Keynote: 2○ 30 min. Presentation: 9○ 15 sec. Lightning Talk: 10

23 SPEAKERS

Subject #1 - Experience Sharing

● Evolution of Business and Engineering Productivity

Some granular metrics we track ● Changlist to production Latency● Code coverage● Presubmit greenness● Dashboard development● Test clusters● Intelligent selection of release candidate

change list● Release process...

Q &A Test Self-Driving?

Automated test : Manual test =

Machine learing software is better test in Production?

How much time was presubmit phase take?

How do we test the test themselves?

Not yet.

95% : 5%

It will make sense to kind of test before it hits production.

It take about 10 days, but I want to say a good 2 or 3 days in the pre-submit phase

We are getting assurance from different ways that your software is behaving correctly.

Subject #2 - Tools

● Developer Experience, FTW!○ Test Lab - Firebase○ Espresso

Test Lab - Robo● Choose Device/

Simulator

● Let you can do Login

Test Lab - Robo● Provide crawl report

○ Log○ Screenshot○ Flowchart○ Record

Test Lab - Run Script on Devices● Upload apk

& test apk

● Choose Device/ Simulator

● Provide devices report○ Cases○ Log○ Record

Test Lab - Run Script on Devices

Test Lab● Crawler is not very

smart, suggest to use your own test script to test

ABOUT MEQ &A

What should small startup needs to start instroducing automation?

Firebase support geo/real purchases/ memory leak tests ?

Firebase support Stress/ Performance/ Security tests?

How to deal with privacy data ?

Keep pre-lauch report for every version submitted?

if you can unit test, unit test it.

No, stay tuned/ in our roadmap.

Yes, but you need to write those test.

It will look for patterns for privacy data and scrumb them out.All tests are fresh install.

No. Because law...

ABOUT MEQ &A

Firebase v.s. Crashlytics, Crittercism

Firebase test with Game app?

再更智能一點嗎？像是撒 seeding

Support Penetration testing?

Support Wi-Fi/ Bluetooth connected device test?

We have a lot of people who also continue to use Crashlytics side by side.

Games has been a very challenging thing for us.

Under working.

We did a whole bunch of basic security crawls.

Not yet. We don't have good hardware solutions.

GTAC 2017 in London (Spring)

Questions?

Thank You

btw, We Need You!

資深自動化軟體測試工程師

軟體測試工程師 (SET)

下午茶免費販賣機

國外旅遊 免費參加演唱會近距離接觸偶像

每年重金送你去 GTAC ! A_Ay

R.G.B95. 96. 98

Reference● GTAC 2016● GTAC 2016 Day 1 Slide● GTAC 2016 Day 2 Slide● FireBase (Android) Getting Started● Firebase in a Weekend: Android