High Impact Research: Blending Science, Engineering & Design

Ben Shneiderman ben@cs.umd.edu @benbendc

Founding Director (1983-2000), Human-Computer Interaction LabProfessor, Department of Computer ScienceMember, Institute for Advanced Computer Studies

University of MarylandCollege Park, MD 20742

Interdisciplinary research community - Computer Science & Info Studies - Psych, Socio, Educ, Jour & MITH www.cs.umd.edu/hcil vimeo.com/72440805

Design IssuesInput devices & strategiesKeyboards, pointing devices, voiceDirect manipulationMenus, forms, commands Output devices & formatsScreens, windows, color, soundText, tables, graphicsInstructions, messages, helpCollaboration & Social MediaHelp, tutorials, trainingSearchwww.awl.com/DTUIFifth Edition: 2010 Visualization

HCI Pride: Serving 5B UsersMobile, desktop, web, cloud

Diverse users: novice/expert, young/old, literate/illiterate, abled/disabled, cultural, ethnic & linguistic diversity, gender, personality, skills, motivation, ...

Diverse applications: E-commerce, law, health/wellness, education, creative arts, community relationships, politics, IT4ID, policy negotiation, mediation, peace studies, ... Diverse interfaces: Ubiquitous, pervasive, embedded, tangible, invisible, multimodal, immersive/augmented/virtual, ambient, social, affective, empathic, persuasive, ...

Spotfire: Retinols role in embryos & vision

Spotfire: DC natality data

www.spotfire.comSpotfire Treemap: Bond Portfolio Analysis

Spotfire Networks: Supply Chain Analysis

www.spotfire.com

10M - 100M pixels: Large displays

16M pixels: My New Workstation

100M-pixels & more

1M-pixels & lessSmall mobile devices

Information Visualization: MantraOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demandOverview, zoom & filter, details-on-demand

(The Eyes Have It, IEEE VL, 1996)

Information Visualization: Data Types1-D LinearDocument Lens, SeeSoft, Info Mural2-D Map GIS, ArcView, PageMaker, Medical imagery3-D World CAD, Medical, Molecules, Architecture

Multi-Var Spotfire, Tableau, Qliktech, DataWatchTemporal EventFlow, TimeSearcher, Palantir, DataMontageTree Cone/Cam/Hyperbolic, SpaceTree, TreemapNetworkPajek, UCINet, NodeXL, Gephi, Tom SawyerTextTagClouds, Wordle, ManyEyes, Ngram Viewer

InfoViz SciViz . infosthetics.com visualcomplexity.com eagereyes.orgflowingdata.com perceptualedge.com datakind.orgvisual.ly Visualizing.org infovis.org

High Impact Research: Blending Science, Engineering & Design

Ben Shneiderman ben@cs.umd.edu @benbendc

Founding Director (1983-2000), Human-Computer Interaction LabProfessor, Department of Computer ScienceMember, Institute for Advanced Computer Studies

University of MarylandCollege Park, MD 20742

High Impact Research: A Vision for UMIACS

Ben Shneiderman (Chair, CS/HCI), Marshini Chetty (iSchool/HCI), Mihai Pop (CS/Computational Biology), Rance Cleaveland (CS/Software Engineering), Tudor Dumitras (ECE/Cybersecurity)

Metaphor

Metaphor

High Impact Research: A Vision for UMIACS

Ben Shneiderman (Chair, CS/HCI), Marshini Chetty (iSchool/HCI), Mihai Pop (CS/Computational Biology), Rance Cleaveland (CS/Software Engineering), Tudor Dumitras (ECE/Cybersecurity)

Metaphor

High Impact Research: A Vision for UMIACS

Ben Shneiderman (Chair, CS/HCI), Marshini Chetty (iSchool/HCI), Mihai Pop (CS/Computational Biology), Rance Cleaveland (CS/Software Engineering), Tudor Dumitras (ECE/Cybersecurity)

Metaphor

Jeffersons Mission Statement (1804)object of your mission is to explorethe most direct & practicable water communication across the continent, for the purpose of commerce. + geography, geology, astronomy, biology, meteorology + Indian languages, laws, customs, religion, agriculture, hunting & fishingInspiration

Kennedy Moon Shot Speech (1961)The growth of our science & education will be enriched by new knowledge of our universe & environment, by new techniques of learning & mapping, by new tools & computers for industry, medicine, home & school.Inspiration

UN Millennium Development Goals Eradicate extreme poverty and hunger Achieve universal primary education Promote gender equality and empower women Reduce child mortality Improve maternal health Combat HIV/AIDS, malaria and other diseases Ensure environmental sustainability Develop a global partnership for development

To be achieved by 2015Inspiration

Make solar energy economicalProvide energy from fusionDevelop carbon sequestration methodsManage the nitrogen cycleProvide access to clean waterRestore and improve urban infrastructureAdvance health informaticsEngineer better medicinesReverse-engineer the brainPrevent nuclear terrorSecure cyberspaceEnhance virtual realityAdvance personalized learningEngineer the tools of scientific discovery Grand Challenges: NAE (2008)www.engineeringchallenges.org/Inspiration

Ensure everyone can have access to safe & clean water?Restore movement to those with paralysis?Fly without damaging the environment?Help people with dementia live independently for longerPrevent the rise of resistance to antibiotics?Ensure everyone has nutritious, sustainable food?Longitude Prize 2014: CrowdsourcedInspiration

Ensure everyone can have access to safe & clean water?Restore movement to those with paralysis?Fly without damaging the environment?Help people with dementia live independently for longerPrevent the rise of resistance to antibiotics?Ensure everyone has nutritious, sustainable food?Longitude Prize 2014: CrowdsourcedInspiration

Science: The Endless Frontier (1945) Separates basic (or pure) from applied research Urges strong govt support for academic basic research: statistically it is certain that important and highly useful discoveries will result from some fraction of the work undertaken; but the results of any one particular investigation cannot be predicted with accuracy.- Warns: applied research invariably drives out pure

Vannevar Bush: FDRs Science AdvisorThe Problem

Science: The Endless Frontier (1945) Separates basic (or pure) from applied research Urges strong govt support for academic basic research: statistically it is certain that important and highly useful discoveries will result from some fraction of the work undertaken; but the results of any one particular investigation cannot be predicted with accuracy.- Warns: applied research invariably drives out pure

But he was wrong. These beliefs are just not true.Vannevar Bush: FDRs Science AdvisorThe Problem

Linear ModelBasic ResearchDevelopmentProduction& operationsAppliedResearchThe Problem

Linear ModelBasic ResearchDevelopmentProduction& operationsAppliedResearchRarely works: Basic Researchers choose wrong problems Technology Transfer is a struggleThe Problem

Reverse Linear ModelBasic ResearchDevelopmentProduction& operationsAppliedResearchSuccessful pattern:Listen to industry problems & solve them Technology Transfer is easier

Production & operations

DevelopmentAppliedResearchBasic ResearchHigh Impact Model: Raised Expectationshttp://www.theatlantic.com/technology/archive/2013/04/toward-an- ecological-model-of-research-and-development/275187/

Production & operations

DevelopmentAppliedResearchBasic ResearchHigh Impact Model: Raised Expectations

use-inspired basic researchtheory-inspired applied research

Production & operations

DevelopmentAppliedResearchBasic ResearchHigh Impact Model: Raised Expectations

Theory without practice cannot survive and dies as quickly as it lives. He who loves practice without theory is like the sailor who boards ship without a rudder and compass and never knows where he may cast. -- Leonardo Da Vinci

Research Project: 2 parents, 3 childrenSolve ProblemRefineTheoryProvide Guidance to Future ResearchersApplied ProblemBasicTheory

Research Methods Universal Principles - Understandable Descriptions - Causal Explanations - Generalizable Predictions - Reliable Prescriptions ObservationInterventionControlledExperiment

Research Methods Universal Principles - Understandable Descriptions - Causal Explanations - Generalizable Predictions - Reliable Prescriptions ObservationControlledExperiment

Research MethodsQuantitative & Qualitative DataHypothesis formationTheory Universal Principles - Understandable Descriptions - Causal Explanations - Generalizable Predictions - Reliable Prescriptions ObservationInterventionControlledExperimentReplicabilityFalsifiabilityHypothesis testingReductionist ModelContext

Choose actionable problems: civic, business & global priorities High Impact Research Strategies

Blend science, engineering & designresearch methodsChoose actionable problems: civic, business & global priorities High Impact Research Strategies

Science, Engineering, Design

Blend science, engineering & designresearch methodsForm teams with diverse individuals & organizationsChoose actionable problems: civic, business & global priorities High Impact Research Strategies

Teams: Winning StrategyMagic of Two (End of the Lone Genius)

Teams: hugely effective, but difficult to runMay take practice to gain skillsClear goals, clear rolesTrust, communication, recognition

Large teams need administrative support

scienceofteamscience.org www.teamsciencetoolkit.cancer.gov

Blend science, engineering & designresearch methodsForm teams with diverse individuals & organizationsStrive for universaltheories, principles & guidelines Choose actionable problems: civic, business & global priorities High Impact Research Strategies

What kinds of theories are there?DescriptiveExplanatoryPredictivePrescriptiveGenerative

What kinds of theories are there?DescriptiveExplanatoryPredictivePrescriptiveGenerative

CognitivePerceptualMotor skillsSmall Group TeamworkOrganizational/LeadershipSocial/Cultural

Blend science, engineering & designresearch methodsForm teams with diverse individuals & organizationsStrive for universaltheories, principles & guidelines Test prototypes with realistic interventionsUse big data &case study methodsChoose actionable problems: civic, business & global priorities High Impact Research Strategies

Prototype & testSomething Small SoonBe agile, Gather data, Fail soonerScale-up, scale-outFind partners with living laboratoriesRepeated case studies support theoriesWriting clarifies thinkingPublishing gains feedback

Blend science, engineering & designresearch methodsForm teams with diverse individuals & organizationsStrive for universaltheories, principles & guidelines Test prototypes with realistic interventionsUse big data &case study methodsChoose actionable problems: civic, business & global priorities Promote adoption & assess impactHigh Impact Research Strategies

Ideas travel through networks and relationshipsCultivate champions. Present, Present, Present! Become a trustworthy source in your fieldAddress areas of policy interestJoin relevant committees & insert your findings into decision makingConsider Action Research designsDont wait for publication. Disseminate earlyHow to Promote Adoptionhttps://becker.wustl.edu/impact-assessment/strategies

Promote Adoption & Assess Impact Promote AdoptionSend Five & ThriveDistribute copies of papers, create websites, make videosTravel to speak at conferences & to colleaguesWrite follow up papers, seek citations Assess ImpactMeasure downloads, tweets, blogposts, media mentionsWin Best Paper Awards, collect testimonials Count citations Repeat for Research, Researchers & Organizations

Research on Science & Technology 1975: Society for Social Studies of Science (4S) 1993: Intl Society for Scientometrics & Informetrics 2007: Intl Society for the Psychology of Science & Technology 2008: NSF Science of Science & Innovation Policy (SciSIP) 2010: Science of Team Science Conference (SciTS) (www.scienceofteamscience.org)

Research on Science & Technology 1975: Society for Social Studies of Science (4S) 1993: Intl Society for Scientometrics & Informetrics 2007: Intl Society for the Psychology of Science & Technology 2008: NSF Science of Science & Innovation Policy (SciSIP) 2010: Science of Team Science Conference (SciTS) (www.scienceofteamscience.org) 2011: Altmetrics Conference (www.altmetrics.org) 2011: Beyond Impact Workshop (www.beyond-impact.org) 2011: Becker Assessment Model (becker.wustl.edu/impact-assessment/) 2012: SF-Declaration on Research Assessment (am.ascb.org/dora/)

www.cs.umd.edu/hcil @benbendc

Quadrant Model of ResearchBasic Research (Bohr)Use-inspiredBasic Research (Pasteur)Applied Research(Edison)Considerations of use? No YesQuest for Yesfundamentalunderstanding?

NoStokes, Pasteurs Quadrant, 1997

Desktop/Laptop softwareWorld Wide Web & servicesMobile devices & servicesHuman-Computer Interaction Information Visualization & Big DataCreativity Support ToolsTechnology-Mediated Social ParticipationMedical informatics: Learning Health SystemEnvironmental ProtectionEnergy SustainabilityCommunity SafetyEducation Potential High-Impact Research TopicsInspiration

***"The INCell Analyzer automated microscope was usedto identifyproteins influencing the division of human cells. After the images were analyzed, quantitative results were transferred to Spotfire DecisionSite. Thisscreen revealed the previously unknown involvement of theretinol binding protein RBP1 in cell cycle control.(Stubbs S, & Thomas N. 2006 Methods in Enzymology; 414:1-21.) Retinol a form of Vitamin A plays a crucial role in vision and during embryonic development"******On February 28, 1803, President Thomas Jefferson won approval from Congress for a visionary project, an endeavor that would become one of Americas greatest stories of adventure. Lewis and Clark's Outbound Route Shown in Red, Inbound in Blue Twenty-five hundred dollars were appropriated to fund a small expeditionary group, whose mission was to explore the uncharted West. Jefferson called the group the Corps of Discovery. It would be led by Jeffersons secretary, Meriwether Lewis, and Lewis friend,William Clark.Thomas Jeffersons masterful mission statement to Merriwether Lewis was a lucid synthesis of national needs and bold scientific research. The object of your mission is to explore and find the most direct & practicable water communication across the continent, for the purpose of commerce. At the same time, Jefferson required geographic, geological, astronomical, biological, meteorological, and other observations to add to basic natural science knolege. Jefferson also detailed the social science research agenda for encounters with Indian nations, requiring Lewis to record their languages, traditions, laws, customs, and religion. Jeffersons eagerness to learn about the tribes extended to their agricultural practices, plus hunting and fishing implements. He believed that there was much to learn from how the Indian nations made their clothing, built their housing, and treated their diseases.

*More than a century and a half later, John Kennedy put forth another bold project to advance knowledge with a courageous plan for human exploration. He pledged to go to the moon in this decade by engaging in the greatest and most complex exploration in mans history. Kennedy was motivated by the challenges of Cold War competition, but he focused on how The growth of our science and education will be enriched by new knowledge of our universe and environment, by new techniques of learning and mapping and observation, by new tools and computers for industry, medicine, the home as well as the school.

***