From Hierarchies to Polyarchies:

Visualizing Multiple Relationships

George G. RobertsonGeorge G. RobertsonMicrosoft ResearchMicrosoft Research

George G. RobertsonGeorge G. RobertsonMicrosoft ResearchMicrosoft Research

GVU 11/2000 2

What is the problem?

Hierarchies are very commonHierarchies are very common

20 years of hierarchy visualization R&D20 years of hierarchy visualization R&D

Significant problems remainSignificant problems remain

New problems appearing (Multiple Hierarchies)New problems appearing (Multiple Hierarchies)

Hierarchies are very commonHierarchies are very common

20 years of hierarchy visualization R&D20 years of hierarchy visualization R&D

Significant problems remainSignificant problems remain

New problems appearing (Multiple Hierarchies)New problems appearing (Multiple Hierarchies)

GVU 11/2000 3

Current Approaches

Many 2D and 3D hierarchy visualizationsMany 2D and 3D hierarchy visualizations

Each works for some tasks and some scalesEach works for some tasks and some scales

Very few have had user testingVery few have had user testing

Windows Tree ControlWindows Tree Control

Many observed problemsMany observed problems

Many 2D and 3D hierarchy visualizationsMany 2D and 3D hierarchy visualizations

Each works for some tasks and some scalesEach works for some tasks and some scales

Very few have had user testingVery few have had user testing

Windows Tree ControlWindows Tree Control

Many observed problemsMany observed problems

GVU 11/2000 4

What’s wrong with this picture?

GVU 11/2000 5

Problems: Fitting Data

Extreme aspect ratio (broad and shallow)Extreme aspect ratio (broad and shallow)

May be multiple hierarchiesMay be multiple hierarchies

Scaling issuesScaling issues

Extreme aspect ratio (broad and shallow)Extreme aspect ratio (broad and shallow)

May be multiple hierarchiesMay be multiple hierarchies

Scaling issuesScaling issues

GVU 11/2000 6

Problems: Cognitive Overhead

Loss of contextLoss of context

Or loss of detailOr loss of detail

Separate detail/overview Separate detail/overview extra overhead extra overhead

Multiple focus is difficult Multiple focus is difficult

Which item is open?Which item is open?

Loss of contextLoss of context

Or loss of detailOr loss of detail

Separate detail/overview Separate detail/overview extra overhead extra overhead

Multiple focus is difficult Multiple focus is difficult

Which item is open?Which item is open?

GVU 11/2000 7

Basic View Strategies

Two view (separate detail/overview views)Two view (separate detail/overview views)

Distorted viewDistorted view

Distorted data: fisheyeDistorted data: fisheye

Distorted space: 3D, hyperbolicDistorted space: 3D, hyperbolic

Focus in Context (integrated view)Focus in Context (integrated view)

Two view (separate detail/overview views)Two view (separate detail/overview views)

Distorted viewDistorted view

Distorted data: fisheyeDistorted data: fisheye

Distorted space: 3D, hyperbolicDistorted space: 3D, hyperbolic

Focus in Context (integrated view)Focus in Context (integrated view)

GVU 11/2000 8

Basic Visualization ApproachesIndentationIndentation

Tree controlTree control

FisheyeFisheye

ContainmentContainment

TreemapsTreemaps

Pad++Pad++

IndentationIndentation

Tree controlTree control

FisheyeFisheye

ContainmentContainment

TreemapsTreemaps

Pad++Pad++

ClusteringClustering

Galaxy of NewsGalaxy of News

ThemeScapeThemeScape

Hot SauceHot Sauce

GeographicGeographic

Floor plansFloor plans

Street mapsStreet maps

ClusteringClustering

Galaxy of NewsGalaxy of News

ThemeScapeThemeScape

Hot SauceHot Sauce

GeographicGeographic

Floor plansFloor plans

Street mapsStreet maps

Node-link diagramsNode-link diagrams2D diagrams 2D diagrams

SemNetSemNet

Cone TreeCone Tree

Fisheye Cone TreeFisheye Cone Tree

Hyperbolic viewerHyperbolic viewer

FSNFSN

XML3DXML3D

Node-link diagramsNode-link diagrams2D diagrams 2D diagrams

SemNetSemNet

Cone TreeCone Tree

Fisheye Cone TreeFisheye Cone Tree

Hyperbolic viewerHyperbolic viewer

FSNFSN

XML3DXML3D

GVU 11/2000 9

Smalltalk File Browser - 1979Xerox PARC 1979Xerox PARC 1979Xerox PARC 1979Xerox PARC 1979

GVU 11/2000 10

Fisheye Views – 1986Furnas, Bell Labs report 1981, CHI’86Furnas, Bell Labs report 1981, CHI’86Furnas, Bell Labs report 1981, CHI’86Furnas, Bell Labs report 1981, CHI’86

GVU 11/2000 11

SemNet - 1986Fairchild, Poltrock, Fairchild, Poltrock,

& Furnas, MCC& Furnas, MCC

Semantic network Semantic network 3D visualization3D visualization

Fairchild, Poltrock, Fairchild, Poltrock, & Furnas, MCC& Furnas, MCC

Semantic network Semantic network 3D visualization3D visualization

GVU 11/2000 12

Cone Tree - 1991Robertson, Robertson,

Mackinlay & Mackinlay & Card, Xerox Card, Xerox PARC, CHI’91PARC, CHI’91

Limits:Limits:

10 levels10 levels

1000 nodes1000 nodes

Up to 10,000Up to 10,000

Robertson, Robertson, Mackinlay & Mackinlay & Card, Xerox Card, Xerox PARC, CHI’91PARC, CHI’91

Limits:Limits:

10 levels10 levels

1000 nodes1000 nodes

Up to 10,000Up to 10,000

GVU 11/2000 13

Cone Tree – 10,000 nodesPerformance problems and Visual clutterPerformance problems and Visual clutterPerformance problems and Visual clutterPerformance problems and Visual clutter

GVU 11/2000 14

Fisheye Cone TreeAdding Fisheye solves problemsAdding Fisheye solves problemsAdding Fisheye solves problemsAdding Fisheye solves problems

GVU 11/2000 15

TreeMap - 1991 Johnson & Johnson &

Shneiderman, U. Shneiderman, U. Maryland, Vis’91Maryland, Vis’91

Space fillingSpace filling

~3000 objects~3000 objects

MicroLogic’s MicroLogic’s DiskMapperDiskMapper

Johnson & Johnson & Shneiderman, U. Shneiderman, U. Maryland, Vis’91Maryland, Vis’91

Space fillingSpace filling

~3000 objects~3000 objects

MicroLogic’s MicroLogic’s DiskMapperDiskMapper

GVU 11/2000 16

FSN - 1992 Tesler, SGI, 1992Tesler, SGI, 1992

2D layout on 3D 2D layout on 3D

surfacesurface

Loss of context when Loss of context when

examining detailexamining detail

Hyper-G (Graz; Hyper-G (Graz;

Andrews; InfoVis’95)Andrews; InfoVis’95)

Tesler, SGI, 1992Tesler, SGI, 1992

2D layout on 3D 2D layout on 3D

surfacesurface

Loss of context when Loss of context when

examining detailexamining detail

Hyper-G (Graz; Hyper-G (Graz;

Andrews; InfoVis’95)Andrews; InfoVis’95)

GVU 11/2000 17

Graphical Fisheye - 1992Sarkar & Brown, DEC SRC, CHI’92Sarkar & Brown, DEC SRC, CHI’92

GVU 11/2000 18

Rubber Sheet - 1993Sarkar & Snibbe, Brown, UIST’93Sarkar & Snibbe, Brown, UIST’93

GVU 11/2000 19

Spiral Visualization - 1994Mackinlay, Mackinlay,

Robertson, & Robertson, & DeLine, Xerox DeLine, Xerox PARC, UIST’94PARC, UIST’94

Large DAGsLarge DAGs

Only shows Only shows current pathcurrent path

Mackinlay, Mackinlay, Robertson, & Robertson, & DeLine, Xerox DeLine, Xerox PARC, UIST’94PARC, UIST’94

Large DAGsLarge DAGs

Only shows Only shows current pathcurrent path

GVU 11/2000 20

Hyperbolic Browser - 1994Lamping & Rao, Lamping & Rao,

Xerox PARC, Xerox PARC, UIST’94UIST’94

Projected onto circleProjected onto circle

1000’s of nodes1000’s of nodes

Lamping & Rao, Lamping & Rao, Xerox PARC, Xerox PARC, UIST’94UIST’94

Projected onto circleProjected onto circle

1000’s of nodes1000’s of nodes

GVU 11/2000 21

Continuous Zoom - 1995Bartram et al, Simon Fraser, UIST’95)Bartram et al, Simon Fraser, UIST’95)

GVU 11/2000 22

Fsviz - 1995Carriere and Carriere and

Kazman, Kazman, Waterloo, Waterloo, InfoVis’95InfoVis’95

Up to 5000 Up to 5000 nodes with no nodes with no occlusionocclusion

Carriere and Carriere and Kazman, Kazman, Waterloo, Waterloo, InfoVis’95InfoVis’95

Up to 5000 Up to 5000 nodes with no nodes with no occlusionocclusion

GVU 11/2000 23

Butterfly - 1995Mackinlay, Xerox PARC, CHI’95Mackinlay, Xerox PARC, CHI’95

GVU 11/2000 24

Aaaamon.dll

Edb500.dll

Label.exe

Oakley.dll

Tapi.dll

Wavemsp.dll

Index View - 1995T. Masui, Sharp, UIST95T. Masui, Sharp, UIST95

Vertical picks focusVertical picks focus

Horizontal controls zoomHorizontal controls zoom

T. Masui, Sharp, UIST95T. Masui, Sharp, UIST95

Vertical picks focusVertical picks focus

Horizontal controls zoomHorizontal controls zoom

Aaaamon.dll

Edb500.dll

Label.exe

Oakley.dll

Tapi.dll

Wavemsp.dll

Ksproxy.axLabel.exeLmrt.dll

Aaaamon.dll

Edb500.dll

Label.exe

Oakley.dll

Tapi.dll

Wavemsp.dll

Ksproxy.axKsuser.dllLabel.exeLegacy.infLmrt.dll

Aaaamon.dll

Edb500.dll

Label.exe

Oakley.dll

Tapi.dll

Wavemsp.dll

Ksproxy.axKsqmf.axKsuser.dllKsvpintf.axLabel.exeLanman.drvLegacy.infLinkinfo.dillLmrt.dll

GVU 11/2000 25

H3 - 1997Munzner, Stanford Munzner, Stanford

Univ., InfoVis’97Univ., InfoVis’97

Projected onto sphereProjected onto sphere

20,000 nodes20,000 nodes

Munzner, Stanford Munzner, Stanford Univ., InfoVis’97Univ., InfoVis’97

Projected onto sphereProjected onto sphere

20,000 nodes20,000 nodes

GVU 11/2000 26

Reconfigurable Disk Tree - 1998Jeong and Pang, Jeong and Pang,

UC Santa Cruz, UC Santa Cruz, InfoVis’98InfoVis’98

Number of Number of identifiable identifiable nodes:nodes:3000 – 40003000 – 4000

Jeong and Pang, Jeong and Pang, UC Santa Cruz, UC Santa Cruz, InfoVis’98InfoVis’98

Number of Number of identifiable identifiable nodes:nodes:3000 – 40003000 – 4000

GVU 11/2000 27

Disk Tree - 1998Chi et al, Xerox Chi et al, Xerox

PARC, CHI’98PARC, CHI’98

Compact 2D Compact 2D representationrepresentation

Chi et al, Xerox Chi et al, Xerox PARC, CHI’98PARC, CHI’98

Compact 2D Compact 2D representationrepresentation

GVU 11/2000 28

Sunburst - 2000Stasko & Zhang, Stasko & Zhang,

Georgia Tech, Georgia Tech, InfoVis 2000InfoVis 2000

Radial space-fillingRadial space-filling

Techniques for Techniques for viewing more detailviewing more detail

Stasko & Zhang, Stasko & Zhang, Georgia Tech, Georgia Tech, InfoVis 2000InfoVis 2000

Radial space-fillingRadial space-filling

Techniques for Techniques for viewing more detailviewing more detail

GVU 11/2000 29

Visualization Taxonomy - 1994Noik (Graphics Interface’94)Noik (Graphics Interface’94)

Implicit (use of perspective)Implicit (use of perspective)

Continuous focus and contextContinuous focus and context

Filtered (removing items of low interest)Filtered (removing items of low interest)

Discrete focus and contextDiscrete focus and context

Distorted (size, shape, position of elements)Distorted (size, shape, position of elements)

Adorned (color, texture)Adorned (color, texture)

GVU 11/2000 30

Unresolved Problems

Multiple focusMultiple focusMultiple focusMultiple focus

GVU 11/2000 31

Folding Paper - proposal

GVU 11/2000 32

Multiple Focus in 3D - proposal

GVU 11/2000 33

InfoBowl - proposal

GVU 11/2000 34

Unresolved Problems

Multiple focusMultiple focus

Multiple hierarchiesMultiple hierarchies

Multiple focusMultiple focus

Multiple hierarchiesMultiple hierarchies

GVU 11/2000 35

Multiple HierarchiesOne hierarchy changing over timeOne hierarchy changing over time

Time TubeTime Tube

Taxonomy visualizationTaxonomy visualization

MultiTrees (shared subtrees)MultiTrees (shared subtrees)

XML3D XML3D

Polyarchy (multiple intersecting hierarchies)Polyarchy (multiple intersecting hierarchies)

One hierarchy changing over timeOne hierarchy changing over time

Time TubeTime Tube

Taxonomy visualizationTaxonomy visualization

MultiTrees (shared subtrees)MultiTrees (shared subtrees)

XML3D XML3D

Polyarchy (multiple intersecting hierarchies)Polyarchy (multiple intersecting hierarchies)

GVU 11/2000 36

Time Tube - 1998Chi et al., Xerox PARC, CHI’98Chi et al., Xerox PARC, CHI’98Chi et al., Xerox PARC, CHI’98Chi et al., Xerox PARC, CHI’98

GVU 11/2000 37

Taxonomy Visualization - 2000Graham et al., Napier Univ. IJHCS 2000Graham et al., Napier Univ. IJHCS 2000Graham et al., Napier Univ. IJHCS 2000Graham et al., Napier Univ. IJHCS 2000

GVU 11/2000 38

MultiTrees - 1994Furnas & Zacks, Bell Core, CHI’94Furnas & Zacks, Bell Core, CHI’94

DAG’s with shared subtreesDAG’s with shared subtrees

Furnas & Zacks, Bell Core, CHI’94Furnas & Zacks, Bell Core, CHI’94

DAG’s with shared subtreesDAG’s with shared subtrees

GVU 11/2000 39

XML3D - 2000Munzner, Stanford, IJHCS 2000Munzner, Stanford, IJHCS 2000Munzner, Stanford, IJHCS 2000Munzner, Stanford, IJHCS 2000

GVU 11/2000 40

Polyarchy Visualization Problem: People and Resources Example

Multiple Hierarchies ExistMultiple Hierarchies Exist

Direct reportingDirect reporting

Cost or Profit CenterCost or Profit Center

LocationLocation

Implicit relationshipsImplicit relationships

Multiple Hierarchies ExistMultiple Hierarchies Exist

Direct reportingDirect reporting

Cost or Profit CenterCost or Profit Center

LocationLocation

Implicit relationshipsImplicit relationships

But only one But only one

hierarchy is shownhierarchy is shown

But only one But only one

hierarchy is shownhierarchy is shown

GVU 11/2000 41

Show Other HierarchiesFind:

Daniel RobbinsNaming hierarchy is

default

Allow maintainer to Allow maintainer to

define hierarchiesdefine hierarchies

Show search results Show search results

in current viewin current view

Morph between viewsMorph between views

Naming hierarchy is

default

Allow maintainer to Allow maintainer to

define hierarchiesdefine hierarchies

Show search results Show search results

in current viewin current view

Morph between viewsMorph between views

GVU 11/2000 42

Visualization Opportunities Perceptual cues to provide pattern informationPerceptual cues to provide pattern information

User can search or browseUser can search or browse

Show hierarchies an object participates inShow hierarchies an object participates in

Show relationships between hierarchiesShow relationships between hierarchies

ShowShow relationships between objectsrelationships between objects

Perceptual cues to provide pattern informationPerceptual cues to provide pattern information

User can search or browseUser can search or browse

Show hierarchies an object participates inShow hierarchies an object participates in

Show relationships between hierarchiesShow relationships between hierarchies

ShowShow relationships between objectsrelationships between objects

GVU 11/2000 43

One Selection, One Hierarchy

GVU 11/2000 44

Visual Pivot – Other Hierarchies

GVU 11/2000 45

Relationships Between People

GVU 11/2000 46

Relationships Between Multiple People

GVU 11/2000 47

Unresolved Problems

Multiple focusMultiple focus

Multiple hierarchiesMultiple hierarchies

Evaluate hierarchy visualizationsEvaluate hierarchy visualizations

Multiple focusMultiple focus

Multiple hierarchiesMultiple hierarchies

Evaluate hierarchy visualizationsEvaluate hierarchy visualizations

GVU 11/2000 48

Polyarchy VisualizationUser StudiesStudy 1: Mockup of visual pivotStudy 1: Mockup of visual pivot

Issues list guided development of prototypeIssues list guided development of prototype

Study 2: Prototype: 2D vs 3DStudy 2: Prototype: 2D vs 3D

Visual Pivot animation was misleadingVisual Pivot animation was misleading

Animation Speeds were too slowAnimation Speeds were too slow

Study 1: Mockup of visual pivotStudy 1: Mockup of visual pivot

Issues list guided development of prototypeIssues list guided development of prototype

Study 2: Prototype: 2D vs 3DStudy 2: Prototype: 2D vs 3D

Visual Pivot animation was misleadingVisual Pivot animation was misleading

Animation Speeds were too slowAnimation Speeds were too slow

GVU 11/2000 49

Polyarchy VisualizationUser StudiesStudy 3: Animation Styles and SpeedsStudy 3: Animation Styles and Speeds

Six animation styles: Picked two bestSix animation styles: Picked two best

Twice as fast as study 2: Still too slowTwice as fast as study 2: Still too slow

Study 4: Prototype: 2D vs 3DStudy 4: Prototype: 2D vs 3D

Identified most effective animation styleIdentified most effective animation style

Identified best speed rangeIdentified best speed range

Study 3: Animation Styles and SpeedsStudy 3: Animation Styles and Speeds

Six animation styles: Picked two bestSix animation styles: Picked two best

Twice as fast as study 2: Still too slowTwice as fast as study 2: Still too slow

Study 4: Prototype: 2D vs 3DStudy 4: Prototype: 2D vs 3D

Identified most effective animation styleIdentified most effective animation style

Identified best speed rangeIdentified best speed range

GVU 11/2000 50

Two Styles of Visual Pivot

SlidingSliding

RotatingRotating

SlidingSliding

RotatingRotating

GVU 11/2000 51

Visual Pivot StylesSliding versus Rotating

0

2

4

6

8

10

12

14

16

18

Mea

n S

ub

task

Co

mp

leti

on

Tim

e (s

)

Sliding

Rotating

GVU 11/2000 52

Visual Pivot Styles Learning Effects

2.2

2.3

2.4

2.5

2.6

2.7

2.8

2.9

1 2 3

Repetition Number

Lo

g M

ean

Su

bta

sk C

om

pet

ion

Tim

e (s

) Sliding

Horizontal Visual Picot

GVU 11/2000 53

Visual Pivot Speed

0

2

4

6

8

10

12

14

16

18

Mea

n S

ub

task

Co

mp

leti

on

Tim

e (s

)

Instant

Fast

Medium

Slow

GVU 11/2000 54

Unresolved Problems

Multiple focusMultiple focus

Multiple hierarchiesMultiple hierarchies

Evaluate hierarchy visualizationsEvaluate hierarchy visualizations

Get the solutions out to real users!Get the solutions out to real users!

Multiple focusMultiple focus

Multiple hierarchiesMultiple hierarchies

Evaluate hierarchy visualizationsEvaluate hierarchy visualizations

Get the solutions out to real users!Get the solutions out to real users!

GVU 11/2000 55

SummaryUse perception to reduce cognitive overheadUse perception to reduce cognitive overhead

Need continued research to solve problems Need continued research to solve problems

Help user focus on multiple items of interest without losing Help user focus on multiple items of interest without losing contextcontext

Multiple hierarchies and other relationshipsMultiple hierarchies and other relationships

Handle larger scaleHandle larger scale

Evaluate Evaluate Iterate Iterate get results out get results out

Use perception to reduce cognitive overheadUse perception to reduce cognitive overhead

Need continued research to solve problems Need continued research to solve problems

Help user focus on multiple items of interest without losing Help user focus on multiple items of interest without losing contextcontext

Multiple hierarchies and other relationshipsMultiple hierarchies and other relationships

Handle larger scaleHandle larger scale

Evaluate Evaluate Iterate Iterate get results out get results out