where are we? feedback so far? -...

62
Where Are We? Feedback So far? 1 Collection Cleaning Integration Visualization Analysis Presentation Dissemination Dimensionality reduction: PCA, MDS, LDA, Isomap, t-SNE RottenTomatoes API, SQL refresher OpenRefine Vis 101, D3, Tableau [HW2] HW2 will add “Expected Time to Spend”

Upload: others

Post on 13-Oct-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Where Are We? Feedback So far?

1

Collection

Cleaning

Integration

Visualization

Analysis

Presentation

Dissemination

Dimensionality reduction: PCA, MDS, LDA, Isomap, t-SNE

RottenTomatoes API, SQL refresherOpenRefine

Vis 101, D3, Tableau [HW2]

HW2 will add “Expected Time to Spend”

Page 2: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

1. How to Fix Vis Issues?2. Class Project

CSE 6242 / CX 4242

Duen Horng (Polo) ChauGeorgia Tech

Partly based on materials by Professors Guy Lebanon, Jeffrey Heer, John Stasko, Christos Faloutsos

Page 3: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

3

Student of Edward Tufte

Page 4: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

4

Edward TufteAn American statistician and professor emeritus of political science, statistics, and computer science at Yale University.

He is noted for his writings on information design and as a pioneer in the field of data visualization.

-Wikipedia

Page 5: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Also Highly Recommended:

Page 6: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Good charts? How would you improve them?

Page 7: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

7How about this one?

Page 8: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

8Which is better?

Page 9: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

9Can you improve this table’s design?

TablesWhat are they good for?

Page 10: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

“When everyone is special, no one is special”

10

http://www.youtube.com/watch?v=A8I9pYCl9AQ

Page 11: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

11

A lot of “chart junk”. Low “data to ink” ratio (Edward Tufte)

Page 12: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

12Better? High “data to ink” ratio

Page 13: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

13

Aligning Numbers

Look good?

Page 14: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

14

Page 15: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

15

This reminds you of what?

Bar Charts

Page 16: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

16

Better than Christmas.

Page 17: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

17

Showing profits in red!!

Page 18: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

18

Page 19: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

19

Line Charts

Does this look alright to you?

Page 20: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

20Use “ticks” at regular intervals (e.g., 2, 5, 10, etc.)

Page 21: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

21

Note y-axis doesn’t start at 0. Why not as bad as in the case of bar chart?

Fever Line

Page 22: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

22

Fever Line

Page 23: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

23

Multiple Lines in one chart

We see this often in academic papers. Better ways?

Page 24: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

24

Which one is more effective? Why? What if you have many lines you want to show?

Page 25: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

25

“Small Multiple” - Edward Tufte Better than overlapping (sometimes)

“a series or grid of small similar graphics or charts, allowing them to be easily compared”

Page 26: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

26

Misleading Bar Charts

Page 27: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

27

Vertical axis of bar charts start at “0” if possible

Page 28: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

28

Disorienting color bars

Page 29: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

29

Better?

Page 30: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

30

Exercise For Your Necks

Page 31: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

31

Bars Can be Horizontal

Page 32: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

32

The Dreaded Pie Charts

Why people like to use pie charts?

Page 33: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

33http://www.guardian.co.uk/technology/blog/2008/jan/21/liesdamnliesandstevejobs

Page 34: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

34

Page 35: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Log scale instead of linear scale Include numbers from different orders of magnitude

35

Page 36: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

36

Example

log-log

Page 37: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

37

Example“log” also works well for time

Page 38: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

38

OK for outliers that are *really* different

Page 39: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Destroying your great results with poor powerpoint

Bad color schemesBad fontsToo much animationToo much data

39

100 times faster!

http://www.youtube.com/watch?v=lpvgfmEU2Ck&feature=player_embeddedDon McMillan: Life After Death by PowerPoint

can you read this?

Page 40: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Destroying your great results with poor powerpoint

How to fix?• Color schemes: start with black & white, add colors if needed• Fonts: sans-serif font looks nicer

• On Mac: Helvetica is always good• On Windows: Arial?

• Too much animation: start with no animation, then add if appropriate

• Too much data: don’t just copy figures from paper and past them on the slides!

40http://www.youtube.com/watch?v=lpvgfmEU2Ck&feature=player_embeddedDon McMillan: Life After Death by PowerPoint

Page 41: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Suggestions: use pictures whenever appropriate

“Pictures” include most non-text elements: tables, diagrams, charts, etc.Why?

• “A picture is worth a thousand words”• People like pictures and love movies.• Picture is often more succinct, memorable

41

Page 42: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Figures should be self-containedWhy?

• Don’t make people go back and forth between text and figure

• People skim; look at “interesting” things first• Especially academia, many busy reviewers look at figures

first• Bad figures -> bad first impression

(lower chance of paper acceptance)How to fix?

• Succinctly describe your main messages (what you want the readers to learn)

42

Page 43: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

43http://www.cs.cmu.edu/~dchau/polonium_sdm2011.pdf

Example

Page 44: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

44

Example

Page 45: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Crown-jewel figure on first page (nice to have)

Why?• Give an overview of what readers is going to

get -- cut to the chase• Again, people like to see interesting things

How to do it?• Use your most impressive figure• Can be similar to another shown later

45

Page 46: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

46

Example

Page 47: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Suggestion: Design in grayscale first

Then add colorIf it doesn’t look good in black and white, it’s not gonna look good with color(Why iPhone comes in black or white first?)

47

Page 48: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Suggestion: Use legible fonts

If people can’t see it, they won’t appreciate itFor printed materials, print them out and check!For slides, rule of thumb is about 7 lines of text per slide.

48

Page 49: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Suggestion: you probably need to redo your figure for slides

Designing for print is different from designing for the screen

• Resolution (which is higher?)• Levels of details (people mostly want a few

“take-away” messages from your talk)

49

Page 50: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

50

Example

Page 51: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Higher is better.Apolo wins.

* Statistically significant, by two-tailed t test, p <0.05

Judges’ Scores

0

8

16

Model-based

*Prototyping *Average

Apolo Scholar

Score

Example

Page 52: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Good tools for creating data visualization

(beyond Excel)

Page 53: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

RFree!Powerful. Can create any kinds of visualization available.But results may not be pretty (need editing). Need to program.

53

http://www.r-project.orghttp://www.cc.gatech.edu/~lebanon/notes/quickIntroToR.pdf

Page 54: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

D3Also free!Create web-based visualization. Robust. Can create many kinds of visualization.Need to learn javascript, CSS (+SVG)“Future-proof” (likely to stay for many years)

54

http://d3js.org

Great interactive tutorialhttp://vogievetsky.github.com/IntroD3/#1

Page 55: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Processing“Java for designers”. Simplified Java.Can create interactive visualization, images, and more. Can be used as a library in normal Java app.Many tutorials, examples.

55

http://processing.org

Page 56: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Illustrator / Inkscape / XaraThe ultimate way to create visualization.Or to edit / perfect visualization.Inkscape is free!Illustrator is powerful but expensiveXara is the best alternative for Illustrator, on windows (less expensive, faster, easy to use)

56

http://inkscape.org

Page 57: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Design PrinciplesBar chart’s vertical axis should start at “0”! (Don’t lie)Follow conventions (e.g., red for negative values)Data is the king

• minimize distraction (bold appropriately)• Visual encodings should be meaningful

Design for legibility• font choices, don’t rotate vertical axis label

57

Page 58: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Design PrinciplesDesign for ease of comparison

• Use “small multiple” / panel chart • E.g., use line thickness instead of patterns

(dot, dash, etc.)• E.g., align numbers by decimal points

Maximize data-ink ratio

58

Page 59: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Design Principles (what not to do)

3D pie chart (or 3D anything)Bar chart not starting at 0

• Why not OK? People compare using bars’ heights

Wrong aspect ratio• Flatten or steepen trends

59

Page 60: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

ProjectDescription is outHigh-level schedule

• Proposal (writeup + short presentation)• Progress report• Final report (writeup + poster presentation)

60

Page 61: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

George HeilmeierFormer Director of DARPA

Page 62: Where Are We? Feedback So far? - Visualizationpoloclub.gatech.edu/cse6242/2015spring/slides/CSE6242-3... · 2020. 8. 22. · Where Are We? Feedback So far? 1 Collection Cleaning Integration

Heilmeier Questions1.What are you trying to do?

Articulate your objectives using absolutely no jargon.2.How is it done today, and what are the limits of current practice?3.What's new in your approach and why do you think it will be successful?4.Who cares?5.If you're successful, what difference will it make?6.What are the risks and payoffs?7.How much will it cost?8.How long will it take?9.What are the midterm and final "exams" to check for success?

62

Preflight checklist for successful projects

http://en.wikipedia.org/wiki/George_H._Heilmeierhttp://smlv.cc.gatech.edu/2010/10/17/heilmeiers-questions/