SOME THINGS WE NEED TO KNOW ISRAEL LEDERHENDLER, PH.DNATIONAL INSTITUTES OF HEALTH

EVALUATION 2009NOVEMBER 12, 2009

Managing information overload

Outputs and Outcomes Exploiting knowledge; Finding disruptive ideas

Scientist are entrepreneursMaking ideas count

Measuring Innovation

It’s Almost Always About Innovation

Lederhendler, Nov 2009

Factors Driving NIH DecisionsPublic Interest and Societal Demands

Public Health Requirements

Scientific Opportunities

NIH Funding Priorities

Funding Priorities of

Institutes and Centers

Lederhendler, Nov 2009

APPLICATION PEER REVIEW PROGRAM & COUNCIL

GRANTS MANAGEMENT

PROGRAM: PRE & POST AWARD

Title Summary Statement RFAs, RFPs, PA’s Special Actions

Notice of Grant Award

Progress reports, checklist

Abstract Merit Evaluation Funding Recommendation

Terms & conditions Workshops, conferences

Specific Aims Evaluate Specific Aims

Administrative Actions

Checklist Scientific Initiatives

Research Methods Significance Impact Initiatives, mission relevance

Training Data

Personnel Expert Roster Roster Administrative Assistance

Technical Scientific Assistance

Budget Request Budget considerations

Final budget approval Budgetary Adjustments & Oversight

Scientific Oversight

Institution Bars, regulations Institute Policy Regulatory compliance oversight

Opportunities, trends, gaps

Doc

umen

ts a

nd D

ecis

ions

NIH Data is Mostly Generated from the Grants Business Process

Stru

ctur

edD

ata

Uns

truc

ture

dD

ata

Lederhendler, Nov 2009

Office of the NIH Director

Publications & Biomedical Progress

Databases(examples)

Think Tanks (examples)

Reports to Congress Conference Abstracts Thomson ISI NAS/Institute of Medicine

Reporting Data Calls

Medline Scopus RAND

Scientific CodingPortfolio Analysis

PubMed Central Ovid Families USA

Trans-NIH Initiatives Research Advances Gene Ontology ResearchAmerica!

Workforce &Infrastructure

Clinical Trials Swiss-Prot IDA/STPI

Budget Preparation Drugs, Diagnoses & Treatments

ClinicalTrials.Gov NIH Consensus Conference

PolicyPolicy Analysis

Treatment Guidelines

Additional Data from Analysis and Other sources

Out

puts

and

Out

com

es

Data External to Grants Database

Lederhendler, Nov 2009

Publications & Citations Data

Adoption and diffusion of academic ideas

History and structure of scientific communities

Identification of disruptive ideas

DIMENSIONS OF INNOVATION

Lederhendler, Nov 2009

Validity

Data quality

New communication media

PUBLICATION AND CITATION DATACan’t live without it

Lederhendler, Nov 2009

Adoption and Diffusion Science of Networks

Describe the evolution and structure of scientific communities

History and Structure of a FieldLederhendler, Nov 2009

This visualization tracing citations shows that two seminal papers in 2002 and 2003 are widely cited in the community.Visual Overviews for Discovering Key Papers and Influences Across Research Fronts. Aleks Aris1, Ben Shneiderman1, Vahed Qazvinian2, and Dragomir Radev2 – thanks to Ping Want

EVALUATING IMPACT

IDENTIFYING DISRUPTIVE IDEAS

Lederhendler, Nov 2009