ReCaptureA Pattern-aware Benchmark Tool for

Smartphones

Motivation

• How can we know the performance of Android OS, 3G/4G network, energy on the phone?• Experiment (Benchmark)

• Data trace of metrics

• Analysis

Benchmark

• PC• Unlimited energy

• Interested in performance under heavy tasks: super pi, matrix, primary test, etc.

• SPEC

• Smartphone• No heavy tasks, except

graphics.

• People use it daily, not for HPC.

• Usage patterns matter.

• SPEC does not reflect the true scenario.

Benchmark

• Solution #1: Write an app, run it on volunteers’ phone• Hire a volunteer: IRB approval, ethnic, legal issues.

• Guarantee exact activity under different patterns.

• How long?

• What if people forget to run it?

• How many phones do we need?

• …

Recapture

• We already have some data set of how people use smartphones.• Rice University: Livelab data set.

• App trace, web trace, phone status trace, etc.

• Use existing data set as benchmark input.

• Emulate smartphone usage on the physical phone.

• Collect the data automatically.• WiFi, 3G/4G, CPU, memory, I/O.

ReCapture

facebook

phone youtube smsApp trace:

CPU:

Memory:

Network:

Benefits

• For researchers• Experiment on mobile system performance.

• Discover the relationship between mobile networks and phone usage.

• For consumers• Choose the right phone for you by yourself.

• No privacy issues.

Timeline

• 2 – 3 weeks: software architecture.

• 4 – 5 weeks: development.

• 1 – 2 weeks: testing and data analysis.

• April 23 – 25: Demo.