inferring touch from motion in real world data · inferring touch from motion in real world data...
TRANSCRIPT
![Page 1: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/1.jpg)
Inferring Touch From Motion in Real World Data
Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer
ETH Zurich - Distributed Computing Group - www.disco.ethz.ch
![Page 2: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/2.jpg)
Your Phone Stores Many Secrets...
![Page 3: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/3.jpg)
...Protected with a Pin Code, Luckily!
![Page 4: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/4.jpg)
Imitation Game: Code Breaker
![Page 5: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/5.jpg)
Accelerometer Data When Tapping '1'
![Page 6: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/6.jpg)
Algorithm: Dynamic Time Warping
![Page 7: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/7.jpg)
Algorithm: Dynamic Time Warping
![Page 8: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/8.jpg)
User Base of Game
1 493 users, 87 962 levels >1 000 000 taps
![Page 9: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/9.jpg)
Results
![Page 10: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/10.jpg)
Results
training size 10
![Page 11: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/11.jpg)
Results
training size max
![Page 12: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/12.jpg)
Results
![Page 13: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/13.jpg)
Beyond 3x3 Tapping
![Page 14: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/14.jpg)
Countermeasures
![Page 15: Inferring Touch From Motion in Real World Data · Inferring Touch From Motion in Real World Data Pascal Bissig, Philipp Brandes, Jonas Passerini, Roger Wattenhofer ETH Zurich -Distributed](https://reader033.vdocuments.site/reader033/viewer/2022051808/6008bf11d6739924c9201a1a/html5/thumbnails/15.jpg)