rufus von woofles, d.d. david fouhey, daniel maturana,...

19
Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus von Woofles, D.D. C.H.O.C.O.L.A.T.E Lab, Neurotic Computing Institute Carnegie Mellon University

Upload: others

Post on 28-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Visually Identifying RankDavid Fouhey, Daniel Maturana,

Rufus von Woofles, D.D.

C.H.O.C.O.L.A.T.E Lab, Neurotic Computing InstituteCarnegie Mellon University

Page 2: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus
Page 3: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus
Page 4: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Approach

1.3 … 5.6

-2.5 … 6.0

... … ... 10

A .png Computer Vision + Machine Learning

A Matrix

Page 5: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Why this shouldn’t work

1.3 … 5.6

-2.5 … 6.0

... … ... 10

Quantization Machine Learning Doesn’t Work

Page 6: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Did you really do this?

Yes. Every number is a real experiment.

Please don’t tell our advisors. Please?

Page 7: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Setup

1. 10x10 Matrices2. 10 Ranks3. 1000 (.png) Images / Rank

...

Page 8: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Does it work?

Page 9: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Does it generalize?Train (10x10) Test (30x30)

Page 10: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Does it generalize?

Page 11: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Why bother?

1. Better than traditional linear algebra2. Lets us answer questions about matrices,

linear algebra

Page 12: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Comparison with Linear AlgebraLin. Algebra: SVD, Determinant,...

Pros:- 100% Accuracy

Cons:- Boring- > O(n^2)- Requires numbers

Computer Vision: SIFT+RF, CNN

Pros:- Requires images- O(n^2)- Exciting and dangerous

Cons:- 78.6% Accuracy

Page 13: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

What colormap is best?

Page 14: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

What colormap is best?

Jet is #1! MATLAB is vindicated! Bye Bye Haters!

Page 15: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

What matrices smell what rank?

Page 16: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Structured outputs: Deep Multiplication

Page 17: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Structured outputs: Deep Inverse

Page 18: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Legacy Matrices

Rank 1

Rank 10

Cellphone Picture

Page 19: Rufus von Woofles, D.D. David Fouhey, Daniel Maturana, …oneweirdkerneltrick.com/rank_slides.pdf · 2017-10-09 · Visually Identifying Rank David Fouhey, Daniel Maturana, Rufus

Thank You!

We gratefully acknowledge NVIDIA for GPUs used in this very serious research.