storytelling with data - see | show | tell | engage

145
Amit Kapoor narrativeVIZ Storytelling with Data Data Visual Story *

Upload: amit-kapoor

Post on 21-Apr-2017

4.675 views

Category:

Data & Analytics


5 download

TRANSCRIPT

Page 1: Storytelling with Data - See | Show | Tell | Engage

Amit KapoornarrativeVIZ

Storytelling with Data

Data

Visual

Story

*

Page 2: Storytelling with Data - See | Show | Tell | Engage

Approach

FundamentalsLearn from first principles

Know the scienceUnderstand the art

ExperientialI hear and I forget

I see and I rememberI do and I understand

I experience and I learn (for life)

Page 3: Storytelling with Data - See | Show | Tell | Engage

Learning the Djembe

Source: The Visitor - Learning the Djembe

Page 4: Storytelling with Data - See | Show | Tell | Engage

da - da - da - da

tak - tak - tak

1 - 2 - 3 - 4

1 - 2 - 3

Page 5: Storytelling with Data - See | Show | Tell | Engage

Linguistic (Verbal)

Symbolic(Math-Logic)

Interactive(Kinesthetic)

Geometric(Visual-Spatial)

Page 6: Storytelling with Data - See | Show | Tell | Engage

Linguistic (Verbal)

The Pythagoras' theorem is a relation in Euclidean geometry among the three

sides of a right triangle. It states:

“The square of the hypotenuse (the side opposite the right angle) is equal to the

sum of the squares of the other two sides.”

Page 7: Storytelling with Data - See | Show | Tell | Engage

Symbolic (Math-Logic)

Page 8: Storytelling with Data - See | Show | Tell | Engage

Geometric (Visual)

Book: The First Six Books of The Element of Euclid by Oliver Byrne

Page 9: Storytelling with Data - See | Show | Tell | Engage

Interactive (Kinesthetic)

Source: Setosa.io - Pythagorean

Page 10: Storytelling with Data - See | Show | Tell | Engage

Source: Explorable Explanation - Bret Victor

Page 11: Storytelling with Data - See | Show | Tell | Engage

“ To develop a complete mind, study the science of

art, the art of science. Learn how to see. Realize that everything connects to

everything else. “

- Leonardo da Vinci

Page 12: Storytelling with Data - See | Show | Tell | Engage

Visual Thinking Spectrum

Hand me

the Pen

I can draw

but...

I’m not

visual

Page 13: Storytelling with Data - See | Show | Tell | Engage

Pointing, Waving, Grabbing, Holding, Reaching out, Dancing

Smiling, Frowning, Disinterest, Concern, Full Attention, Surprise

“Put this there”

Gesture with Pen

Page 14: Storytelling with Data - See | Show | Tell | Engage

Visual Wired Brain

70%of the sensory receptors are

in the eyes

50%of the brain

used for visual processing

100msto get a

sense of the visual scene

Page 15: Storytelling with Data - See | Show | Tell | Engage

Visual Language

While you are travelling down this road there is a chance that one or more rocks of varying size may fall from the slopes.

You should be aware of this before you travel this way so that you are cautious of this particular type of hazard.

Page 16: Storytelling with Data - See | Show | Tell | Engage

ˌvɪʒʊəlaɪˈzeɪʃən (noun)

Derived from the Latin verb videre, "to look, to see"

The act or instance to

form a mental image or

picture (without an

object)

Visualization

The act or instance to

make visible or visual

(with an object)

Page 17: Storytelling with Data - See | Show | Tell | Engage

“Why should we be interested in visualization? Because the human visual system is a pattern seeker of enormous power and subtlety.

The eye and the visual cortex of the brain form a massively parallel processor that provides the highest-bandwidth channel into human cognitive centers.

At higher levels of processing, perception and cognition are closely interrelated, which is the reason why the words ’understanding’ and ‘seeing’ are synonymous. ”

—  Colin Ware

Pattern Seekers

Page 18: Storytelling with Data - See | Show | Tell | Engage

Pattern Recognition

Driving a Car

Page 19: Storytelling with Data - See | Show | Tell | Engage

Pattern Recognition

Facial & Emotion Recognition

Page 20: Storytelling with Data - See | Show | Tell | Engage

Pattern Recognition

CAPTCHA Completely Automated Public Turing test to

tell Computers and Humans Apart

Page 21: Storytelling with Data - See | Show | Tell | Engage

Pattern Recognition

Chess Go

Page 22: Storytelling with Data - See | Show | Tell | Engage

Pattern Recognition

Weather Forecasts

Page 23: Storytelling with Data - See | Show | Tell | Engage

Patterns in Random Noise

Choropleth maps of cancer deaths in Texas, where darker colors = more deaths.

Can you spot which of the nine plots is made from a real dataset and not from under the null hypothesis of spatial independence?

Source: Graphical Inference for Infovis

Page 24: Storytelling with Data - See | Show | Tell | Engage

“Transformation of the symbolic into the geometric”

- McCormick et al. 1987

“The use of computer-generated, interactive, visual representations of abstract data to amplify cognition.”

- Card, Mackinlay, & Shneiderman 1999

Visualization

Page 25: Storytelling with Data - See | Show | Tell | Engage

Value of Visualization

Expand memoryAnswer questions

Find patternsSee data in context

Make decisions

Persuade | Tell a story

Share | Collaborate

Inspire

Page 26: Storytelling with Data - See | Show | Tell | Engage

Exploration

Explanation

Expression

Value of Visualization

Page 27: Storytelling with Data - See | Show | Tell | Engage

Data Tool for engagement, exploration and discovery

Exploration | Interactive

Page 28: Storytelling with Data - See | Show | Tell | Engage

Source: Gramener

Cricket Stats

Page 29: Storytelling with Data - See | Show | Tell | Engage

Source: Strategy&

Working Capital Profiler

Page 30: Storytelling with Data - See | Show | Tell | Engage

Source: Pindecode

Pincode decoder

Page 31: Storytelling with Data - See | Show | Tell | Engage

Data Stories for telling a specific and (linear) visual narrative

Explanatory | Narrative

Page 32: Storytelling with Data - See | Show | Tell | Engage

Source: Hans Rosling

The Joy of Stats

Page 33: Storytelling with Data - See | Show | Tell | Engage

Source: Politizane

Wealth Inequality

Page 34: Storytelling with Data - See | Show | Tell | Engage

Source: Pitch Interactive

Drone Attacks

Page 35: Storytelling with Data - See | Show | Tell | Engage

Data Art for visual expression, delight (and impact, insight)

Exhibition | Expression

Page 36: Storytelling with Data - See | Show | Tell | Engage

Source: hint.fm/wind

Wind Map

Page 38: Storytelling with Data - See | Show | Tell | Engage

Source: Internet Census

Internet Census

Page 39: Storytelling with Data - See | Show | Tell | Engage

“The ability to take data—to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it—

that’s going to be a hugely important skill in the next decades, ... because now we really

do have essentially free and ubiquitous data. So the complimentary scarce factor is the ability to understand that data and extract

value from it.”

—  Hal Varian, Google’s Chief Economist

Making Sense of Data

Page 40: Storytelling with Data - See | Show | Tell | Engage

Approach for Creating Data-Visual-Stories

Design Framework

Page 41: Storytelling with Data - See | Show | Tell | Engage

Word Writer

Note

Frame

Musician

Film Maker

|

|

|

Data Artist|Datum

Page 42: Storytelling with Data - See | Show | Tell | Engage

???

???

???

???

Datum

Data-Visual-Story

Page 43: Storytelling with Data - See | Show | Tell | Engage

See the Data

Show the Visual

Tell the Story

Engage the Audience

Datum

Data-Stories

Page 44: Storytelling with Data - See | Show | Tell | Engage

See the DataPattern

Deviation Outlier

Trend

Data Abstraction

Page 45: Storytelling with Data - See | Show | Tell | Engage

Anscombe’s Quartetx1 y1 x2 y2 x3 y3 x4 y4

10.0 8.04 10.0 9.14 10.0 7.46 8.0 6.58

8.0 6.95 8.0 8.14 8.0 6.77 8.0 5.76

13.0 7.58 13.0 8.74 13.0 12.74 8.0 7.71

9.0 8.81 9.0 8.77 9.0 7.11 8.0 8.84

11.0 8.33 11.0 9.26 11.0 7.81 8.0 8.47

14.0 9.96 14.0 8.10 14.0 8.84 8.0 7.04

6.0 7.24 6.0 6.13 6.0 6.08 8.0 5.25

4.0 4.26 4.0 3.10 4.0 5.39 19.0 12.50

12.0 10.84 12.0 9.13 12.0 8.15 8.0 5.56

7.0 4.82 7.0 7.26 7.0 6.42 8.0 7.91

5.0 5.68 5.0 4.74 5.0 5.73 8.0 6.89

Page 46: Storytelling with Data - See | Show | Tell | Engage

Anscombe’s Quartet

x(mean) = 9

y(mean) = 7.5

x(var) = 11

y(var) = 4.12

y = 3.00 + 0.500 x

Page 47: Storytelling with Data - See | Show | Tell | Engage

Anscombe’s Quartet

Page 48: Storytelling with Data - See | Show | Tell | Engage

This is hard work

"80% perspiration, 10% great idea,

10% output."

- Simon Rogers

Page 49: Storytelling with Data - See | Show | Tell | Engage

See the Data

Acquire

Prepare

Refine

Explore

1

3

2

4

Page 50: Storytelling with Data - See | Show | Tell | Engage

See the Data

Acquire

Prepare

Refine

Explore

Data Wrangling

Exploratory Data Analysis

1

3

2

4

Page 51: Storytelling with Data - See | Show | Tell | Engage

Explore

"Visualization gives you answers to questions you

didn't know you had."

- Ben Schneiderman

Page 52: Storytelling with Data - See | Show | Tell | Engage

Directed Approach

?ExploreQuestion Insight

Page 53: Storytelling with Data - See | Show | Tell | Engage

Exploratory Approach

?ExploreQuestion InsightExplore

Page 54: Storytelling with Data - See | Show | Tell | Engage

Visually Exploring

Active Seeing

Skill Building over Time

Page 55: Storytelling with Data - See | Show | Tell | Engage

Comparison, Deviations

● Range, Distribution: high, low, shape

● Ranking: big, medium, small

● Categorical Comparison: proportion

● Measurement: absolutes

● Context: target, average, forecast

● Hierarchical: category, subcategories

Page 56: Storytelling with Data - See | Show | Tell | Engage

Trends

● Direction: up, down or flat

● Optima: highs. lows● Rate of Change:

linear, exponential● Fluctuation:

seasonal, rhythm● Significance: signal

vs. noise● Intersection:

overlap, crossover

Page 57: Storytelling with Data - See | Show | Tell | Engage

Patterns, Relationships

● Exceptions: outliers● Boundaries: highs.

lows● Correlation: weak,

strong● Association:

variables, values● Clusters: bunching,

gaps● Intersection: overlap,

crossover

Page 58: Storytelling with Data - See | Show | Tell | Engage

Show the VisualFraming

Transition

Visual Representation

Page 59: Storytelling with Data - See | Show | Tell | Engage

HowMany?

When?

Why?

Who & What?

Where?

How?

Page 60: Storytelling with Data - See | Show | Tell | Engage

PortraitDistribution

Representation

HowMany?

When?

Why?Who & What?

Where?

How?

Page 61: Storytelling with Data - See | Show | Tell | Engage

Strip Plot Frequency Polygon

Histogram Dot Plot

Page 62: Storytelling with Data - See | Show | Tell | Engage

Column (Bar) Chart Pie Chart

CoxComb Wind Rose

Page 63: Storytelling with Data - See | Show | Tell | Engage

ComparisonComparative

Representation

PortraitDistribution

Representation

HowMany?

When?

Why?Who & What?

Where?

How?

Page 64: Storytelling with Data - See | Show | Tell | Engage

Small Multiple Frequency Polygon

Histogram Box Plot

Page 65: Storytelling with Data - See | Show | Tell | Engage

Column (Bar) Chart Stacked Chart

CoxComb MariMekko / Mosaic

Page 66: Storytelling with Data - See | Show | Tell | Engage

ComparisonComparative

Representation

PortraitDistribution

Representation

MapPosition in Space

?

HowMany?

When?

Why?Who & What?

Where?

How?

Page 67: Storytelling with Data - See | Show | Tell | Engage

Chloropleth Cartogram

Dorling Cartogram Graduated Symbol

Page 68: Storytelling with Data - See | Show | Tell | Engage

Map Connection Flow Map

Page 69: Storytelling with Data - See | Show | Tell | Engage

ComparisonComparative

Representation

TimelinePosition in

Time

PortraitDistribution

Representation

MapPosition in Space

?

HowMany?

When?

Why?Who & What?

Where?

How?

Page 70: Storytelling with Data - See | Show | Tell | Engage

Strip PlotLine Chart Bar Chart

Area Chart Index Chart

Page 71: Storytelling with Data - See | Show | Tell | Engage

Stacked Column Stacked Area

% Stacked Column % Stacked Area

Page 72: Storytelling with Data - See | Show | Tell | Engage

Horizon Chart Stream Graph

Sparklines Slopegraph

Page 73: Storytelling with Data - See | Show | Tell | Engage

ComparisonComparative

Representation

TimelinePosition in

Time

PortraitDistribution

Representation

MapPosition in Space

?

HowMany?

When?

Why?Who & What?

Where?

How?

FlowchartRelationship,

Hierarchy

Page 74: Storytelling with Data - See | Show | Tell | Engage

Tree - Node Linkage Tree Radial

Force Directed Matrix View

Page 75: Storytelling with Data - See | Show | Tell | Engage

Enclosure Radial Enclosure

Arc Diagram Sankey Diagram

Page 76: Storytelling with Data - See | Show | Tell | Engage

ComparisonComparative

Representation

TimelinePosition in

Time

Multi-Variable PlotDeduction & Prediction

y

x

PortraitDistribution

Representation

MapPosition in Space

?

HowMany?

When?

Why?Who & What?

Where?

How?

FlowchartRelationship,

Hierarchy

Page 77: Storytelling with Data - See | Show | Tell | Engage

Scatter Plot Scatter Plot - Color

Scatter Plot - Multiple Scatter Plot Matrix

Page 78: Storytelling with Data - See | Show | Tell | Engage

Parallel Coordinates

Data : n x quantitative, n x categorical Encoding : position, connection, color

Page 79: Storytelling with Data - See | Show | Tell | Engage

Bubble Chart

Data : 4 x quantitative, 1 x categorical Encoding : position, size, color, motion

Page 80: Storytelling with Data - See | Show | Tell | Engage

ComparisonComparative

Representation

TimelinePosition in

Time

Multi-Variable PlotDeduction & Prediction

y

x

PortraitDistribution

Representation

MapPosition in Space

?

HowMany?

When?

Why?Who & What?

Where?

How?

FlowchartRelationship,

Hierarchy

Page 81: Storytelling with Data - See | Show | Tell | Engage

Tell the StoryOrdering & Structure

Messaging(Verbal & Text)

Point of ViewRelatability

TRF JQL

VWX DFR

RGT DEF

ZEF LXR

Page 82: Storytelling with Data - See | Show | Tell | Engage

Tone of Visualization

Analytical & Pragmatic

Emotive & Abstract

Page 83: Storytelling with Data - See | Show | Tell | Engage

I think people have begun to forget how powerful human stories are,

exchanging their sense of empathy for a fetishistic fascination with data,

networks, patterns, and total information... Really, the data is just part of the story. The human stuff is the main stuff, and the data should

enrich it.

- Jonathan Harris

Page 84: Storytelling with Data - See | Show | Tell | Engage

People tell stories

Words

Pictures

tell stories

tell stories

|

|

|

Comics tell stories|

Movies tell stories|

Page 85: Storytelling with Data - See | Show | Tell | Engage

Rhetoric

Page 86: Storytelling with Data - See | Show | Tell | Engage

logos reason

ethos

pathos

credible

emotional

|

|

|

Persuasion

Page 87: Storytelling with Data - See | Show | Tell | Engage

Body Mass Index (BMI)

BMI = mass (kg)

[ height (m) ]2h

m

Page 88: Storytelling with Data - See | Show | Tell | Engage

Living on the edge

5’ 1

6’ 5

5’ 7

5’ 5

5’ 3

6’ 3

6’ 1

5’ 11

5’ 9

6’ 7

ObeseOver

NormalUnder

18 25 30

mass (in kg)

height(in ft)

Page 89: Storytelling with Data - See | Show | Tell | Engage

Data Story

Visual

Graph Art

Tale

*

Page 90: Storytelling with Data - See | Show | Tell | Engage

analysis SYNTHESIS

numbers

argument

VISUALISE

STORY

|

|

|

Page 91: Storytelling with Data - See | Show | Tell | Engage

logic | EMPATHY

Page 92: Storytelling with Data - See | Show | Tell | Engage

Data & Stories

The focus of stories is on individual people rather than averages,

on motives rather than movements, on point of view rather than the view

from nowhere, context rather than raw data.

Moreover, stories are open-ended and metaphorical rather than determinate

and literal.

Page 93: Storytelling with Data - See | Show | Tell | Engage

The Story Mindset

In listening to stories we tend to suspend disbelief in order to be

entertained, whereas in evaluating statistics we generally have an

opposite inclination to suspend belief in order not to be beguiled.

- John Allen Paulos

Page 94: Storytelling with Data - See | Show | Tell | Engage

Stories are emotional

Stories are

Stories are

memorable

impactful

|

|

|

Why Stories?

Page 95: Storytelling with Data - See | Show | Tell | Engage

Dual Coding

Aural Visual

Page 96: Storytelling with Data - See | Show | Tell | Engage

/ˈnærətiv / (noun)

A narrative (or story) is any account of

connected events, presented to a reader or

listener in a sequence of written or spoken

words, or in a sequence of (moving) pictures.

Derived from the Latin verb narrare, "to tell"

Narrative

Page 97: Storytelling with Data - See | Show | Tell | Engage

Narrative Structure

Page 98: Storytelling with Data - See | Show | Tell | Engage

Cognitive Flow

Start

Frame it as a Journey

Finish

Page 99: Storytelling with Data - See | Show | Tell | Engage

Making Comics

Page 101: Storytelling with Data - See | Show | Tell | Engage

...or complex visualization

Source: Joshua Gallagher

Page 102: Storytelling with Data - See | Show | Tell | Engage

Think Stories, not Charts

Page 103: Storytelling with Data - See | Show | Tell | Engage

Telling Compelling Stories

Source: Gapminder

Page 104: Storytelling with Data - See | Show | Tell | Engage

Strong Order

Heavy Messaging

Limited Interactivity

Author Driven

Explanatory (Narrative)

Exploration (Interactive)

Weak Order

Light Messaging

Free Interactivity

Reader Driven

Page 105: Storytelling with Data - See | Show | Tell | Engage

Genres of Story

Source: Narrative Visualization

Page 106: Storytelling with Data - See | Show | Tell | Engage

Think about the structure

Source: Narrative Visualization

Explanatory (Narrative)

Exploration (Interactive)

Page 107: Storytelling with Data - See | Show | Tell | Engage

Choose the Visualization

Source: Bloomberg

Page 110: Storytelling with Data - See | Show | Tell | Engage
Page 111: Storytelling with Data - See | Show | Tell | Engage

More Linear, More Story Like

Source: Inconvenient Truth

Page 112: Storytelling with Data - See | Show | Tell | Engage

Linear Narrative

Source: Pitch Interactive

Page 113: Storytelling with Data - See | Show | Tell | Engage

Story Structure

Page 114: Storytelling with Data - See | Show | Tell | Engage

Story Structure

Page 115: Storytelling with Data - See | Show | Tell | Engage

Focus Attention

Choose a Canvas Put Visuals Focus Attention

--------------------- --------------------- ---------------------

Rocks Hieroglyph Carving (Hand) Pointing

Paper Pen Drawing Pen Movement

Transparency Marker Pens Stick

Whiteboard Marker Drawings Pen Movement

Presentation Slides Next Slide Please??

Page 116: Storytelling with Data - See | Show | Tell | Engage

Focus Attention

Page 117: Storytelling with Data - See | Show | Tell | Engage

Focus Attention

Choose a Canvas Put Visuals Focus Attention

--------------------- --------------------- ---------------------

Rocks Hieroglyph Carving (Hand) Pointing

Paper Pen Drawing Pen Movement

Transparency Marker Pens Stick

Whiteboard Marker Drawings Pen Movement

Presentation Slides Next Slide Please??

Genre Data Viz Highlight, CloseUp, Zoom, FramingFeature DistinctMotion, Audio

Page 118: Storytelling with Data - See | Show | Tell | Engage

Explain and Guide Reader

Source: Guns - Periscopic

Page 119: Storytelling with Data - See | Show | Tell | Engage

Single Frame Dominates

Source: Walmart & Target Store Expansion

Page 120: Storytelling with Data - See | Show | Tell | Engage

Establish & Focus

Source: OECD Better Life

Consistent Visual

Framework

Page 121: Storytelling with Data - See | Show | Tell | Engage

Establish & Focus

Source: OECD Better Life

Page 123: Storytelling with Data - See | Show | Tell | Engage

Say it with Text

Page 124: Storytelling with Data - See | Show | Tell | Engage

Weave Text into Graphics

Source: Napolean’s Campaign

Page 125: Storytelling with Data - See | Show | Tell | Engage

Provide Meaningful Annotation

Source: New York Times

Page 126: Storytelling with Data - See | Show | Tell | Engage

Source: Hans Rosling | Joy of Stats

Power of Verbal Messaging

Page 127: Storytelling with Data - See | Show | Tell | Engage

Answer the why?

We are good at who, what, where, when. Not why?

Page 128: Storytelling with Data - See | Show | Tell | Engage

Provide Relatability

Page 129: Storytelling with Data - See | Show | Tell | Engage

Engage the Audience

TRF JQL

VWX DFR

RGT DEF

ZEF LXR

Emotion

Takeaway

Interactivity

Page 130: Storytelling with Data - See | Show | Tell | Engage

Attention & Engagment

Source: Cost of Sick

Page 131: Storytelling with Data - See | Show | Tell | Engage

Animation Helps

Source: Multibar Transition

Page 132: Storytelling with Data - See | Show | Tell | Engage

Be Explicit about Actions

Source: Gapminder

Page 134: Storytelling with Data - See | Show | Tell | Engage

Make it look live

Source: 512 Paths to White House

Page 136: Storytelling with Data - See | Show | Tell | Engage

Make Interaction Easy

Source: Health and Wealth of Nation

Page 138: Storytelling with Data - See | Show | Tell | Engage

Science or Art?

SciencePerceptual Psychology

Cognitive Science

Graphic Design

Data Analysis

ArtEmotional

Aesthetic sense

Craft and Skill

Creativity

Page 139: Storytelling with Data - See | Show | Tell | Engage

Six Thinking Hats

Facts Creativity

Feelings

Benefits

Caution Process

Page 140: Storytelling with Data - See | Show | Tell | Engage

Visualization Skill Hats

Data Scientist

Visual Designer

Storyteller

Explorer

Programmer Manager

Page 141: Storytelling with Data - See | Show | Tell | Engage

Visualization Tools

Page 142: Storytelling with Data - See | Show | Tell | Engage

Tools Landscape

Abstract

Flexible

Difficult

Slow

Code

Expressive

Blackbox

Limited

Simple

Quick

GUI

Efficient

Page 143: Storytelling with Data - See | Show | Tell | Engage

Tools LandscapeAbstract, Flexible, DifficultSlow, Code, Expressive

Blackbox, Limited, Simple Quick, GUI, Efficient

Page 144: Storytelling with Data - See | Show | Tell | Engage

Tools LandscapeAbstract, Flexible, DifficultSlow, Code, Expressive

Blackbox, Limited, Simple Quick, GUI, Efficient

Canvas Grammar Charting

Collection of fixed charts that require data to be shaped in a particular way

ExcelMondrian

Many Eyes

Google ChartsHighChartsFusion Charts

Collection of graphical primitives for creating data driven graphics

R-ggplot2SPSS

raw

d3.jsVegaBokeh

Paint directly on a pixel grid. Design & manage every element of chart

ProcessingNodebox

sketchpad

Raphael.jsPaper.jsProcessing.js

Visual

Visual analysis languages allowing flexibility to design many variants

TableauGephi

plot.ly

...

Page 145: Storytelling with Data - See | Show | Tell | Engage

Amit Kapoor@amitkapsPartner, narrativeVIZ [email protected]

Find this presentation and more athttp://narrativeviz.com/playbook