Upload File

four types of institutional research · four types of institutional research gregg thomson,...

  • Home
  • Documents
  • FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,
25
FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California, Berkeley CAIR 35 th Annual Meeting November 17-19, 2010 San Diego

Upload: vuongminh

Post on 07-Sep-2018

216 views

Category:

Documents


1 download

Report

TRANSCRIPT

Page 1: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

FOUR TYPES OF INSTITUTIONAL RESEARCH

Gregg Thomson, Executive Director Office of Student Research and Campus Surveys

University of California, Berkeley

CAIR 35th Annual Meeting November 17-19, 2010

San Diego

Page 2: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

ALookBack

•  Beginnings….•  SidSuslow:ADeclara8ononIns8tu8onalResearch,AIR,1972“Thequalityoftheins8tu8onalresearcherliesinhisabilitytodiscernwhichmethodologiesareappropriatetotheproblemwithwhichheisconcerned:adroitapplica8onofadvancedtoolsofmanagementsciencemaybegrosslyinappropriatewhenappliedtocertainproblemsofstudentbehavior,andsubtlepsychologicalanalysismaylackmeritwhenappliedtocertainproblemsofins8tu8onalgovernance.”

Page 3: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

DefiningCharacteris8csoftheIRRole

•  TheDuali8esofIR(Volkwein,1999)–  TheInternalVersustheExternal–  AcademicVersusAdministra8veCultures–  Ins8tu8onalVersusProfessionalRoles

•  TheIrresolvableTensionofAuthen8cIR

Page 4: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

The Four Faces of IR and Level of Education Required (Volkwein, 1999, 2008)

Forma8veandInternal–

forImprovement

Summa8veandExternal—

forAccountability

Administra8veandIns8tu8onal

INFORMATIONAUTHORITY

[low]

SPINDOCTOR

[moderate]

AcademicandProfessional

POLICYANALYST[high]

SCHOLARANDRESEARCHER[veryhigh]

Page 5: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

AssessingVolkwein’sTypology

•  Forma8ve/Internal/ImprovementVersusSumma8ve/External/Accountabilitytoorestric8ve

•  Rethinkingthe2X2model,especiallyinlightofrecentdevelopmentsintheprac8ceofIR

Page 6: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

TheTransforma8onsofIR

•  Technologicaltransforma8onandresultantprolifera8onofins8tu8onalandsurveydata– KnowledgeManagerasFi\hFaceofIR

•  Accountability,repor8ngrequirements,andthewidespreaddisplayofins8tu8onaldata

•  EmergenceofStudentAffairsandstudent‐focusedIRac8vity

•  Growthofmethodologicallysophis8catedacademicresearch,especiallyonstudents

Page 7: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

TheOppositePolesofIR

ACADEMICRESEARCHER

ACCOUNTABILITYTECHNICIAN

ADMINISTRATIVEANDINSTITUTIONALROLE

ACADEMICANDPROFESSIONALROLE

Page 8: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

FourTypesofIns8tu8onalResearcher

ACADEMICRESEARCHER

PROGRAMEVALUATOR

ACCOUNTABILITYTECHNICIAN

CAMPUSAUTHORITY

Page 9: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

AUTHORITYAuthorita8veresource,interpreta8onofdataanditsinterconnec8ons,discovery,debunking,reac8vespinindefenseofins8tu8on

TECHNICIANVisualdisplayofdata,precision,“error‐free”,consistency,nosta8s8calcontrols;proac8vespininpublicrepresenta8on

RESEARCHERTes8ngofhypothesis,academicresearchdesign,rigoroussta8s8calcontrols,nospin,i.e.,researchethics

EVALUATORUnbiasedevalua8onofoutcomes,effects,rigoroussta8s8calcontrols,nospininpresenta8onofresults

ApproachesoftheFourTypes

Page 10: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

MARKET‐CENTEREDConcernedwithbroad,conceptualgoalsandpurposes(markets,posi8on,brand)oftheins8tu8on

ADMINISTRATIVEConcernedwithprac8calefficienciesandeffec8venessofprocesses

ACADEMICConcernedwithenhancementoflearningandadvancementofknowledge

STUDENT‐FOCUSEDConcernedfortheexperiencesofindividualstudentsorgroupsofstudents

Orienta8onstoEnrollmentManagement(Kalsbeek,2006,2007)

Page 11: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

CONCEPTUALTHEORIST[INTUITIVE/THINKING]Mul8plepossibili8esandparadigms;rela8onshipsofmanyvariables;challengesassump8ons;uncertainty;valuesinteresJngness

ANALYTICSCIENTIST[SENSING/THINKING]Driventowardcertainty;equatesknowledgewithprecision,accuracy,andreliability;single,self‐consistentparadigms

CONCEPTUALHUMANIST[INTUITIVE/FEELING]Inquirytobenefithumanityaswhole;problemsdefinedbyresearcher’sownvalues;aestheJcsoftheory

PARTICULARHUMANIST[SENSING/FEELING]Personalizesknowledge;inquirytobenefitindividuals;notinterestedintheories;casestudies;acJon‐oriented

Alterna8veModesofInquiry(Mitroff&Kilmann,1978)

Page 12: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

Educa8onandTraining

ACADEMIC

RESEARCHERCAMPUS

AUTHORITYACCOUNTABILITY

TECHNICIANPROGRAM

EVALUATOR

EDUCATIONALREQUIREMENT HIGH HIGH MODERATE HIGH

ISSUESINTELLIGENCE LOW HIGH HIGH LOW

CONTEXTUALINTELLIGENCE LOW HIGH MODERATE LOW

USEOFFORMALSTATISTICS

YES NOTUSUALLY NO YES

Page 13: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

RoleandApproachtoData

ACADEMIC

RESEARCHERCAMPUS

AUTHORITYACCOUNTABILITY

TECHNICIANPROGRAM

EVALUATOR

WHOYOUARE AUTHOR AUTHORITY ANONYMOUS EXPERT

REFERENCEGROUP

ACADEMICDISCIPLINE

INSTITUTIONADMIN‐

ISTRATIONAPPLIED

ACADEMIC

APROACHTODATA

MULTIVARIATECONTROLS

NEWCONNECTIONS

DISPLAYS,METRICS

MEASURINGEFFECTS

PURPOSENEW

KNOWLEDGEINSTITUTIONALAWARENESS

ACCOUNT‐ABILITY

EVIDENCE

Page 14: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

USESOFCAMPUSAUTHORITY

INTERNAL EXTERNAL

SUMMATIVE‐Genera8nginnova8vereportsandanalysis,o\eninsupportofaccountability

FORMATIVE–Exploringnewrela8onships;newunderstandinginsupportofintersubjec8vity

SUMMATIVE‐Fiercedefenseofins8tu8oninfaceofmisrepresenta8onorapack;“goto”resourceforsta8s8calandotherinforma8on

Page 15: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

USEOFPROGRAMEVALUATION

INTERNAL EXTERNAL

SUMMATIVE‐Evalua8onofexis8ngcampusprogramsandprac8ces

FORMATIVE–Founda8onforcampusassessmentac8vi8es(Bers,2008)

SUMMATIVE‐Evalua8onforexternalagencies

FORMATIVE–Consulta8onforgrantsandproposals

Page 16: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

Rela8onshipsAmongtheFourTypes

•  Pluralis8c,mul8plesroles,ac8vi8es•  Nega8veinfluence•  Posi8veinfluence,strengthens

Page 17: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

GoodAcademicResearch:WhatisitGoodFor?

•  Thebepertheresearch,thelessuseful?•  Thetyrannyofmul8variateanalysis

•  Bringingtheins8tu8onbackin

Page 18: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

AccountabilityandItsDiscontents

•  Accountabilitycenterstage:GoodandbadnewsforIR

•  Dilemmaofnocontrolsversusover‐control

•  Highlyvisibleaccountabilitydatadoesnotnecessarilymeangreaterins8tu8onalself‐understanding(orevenaccountability)

•  Makingaccountabilitymore(ac)countable

Page 19: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

CampusAuthorityasAuthen8cIR

•  Nowthat’sinteres8ng!•  Ins8tu8onalintelligenceandmemory

•  Autonomyandtrust

•  Fromauthoritytoauthor:Crea8ngnewknowledge

•  Theenormouspoten8alofqualita8veins8tu8onalresearch

Page 20: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

TheNeglectofProgramEvalua8on

•  Thechallengingoflookinginward•  Beingtough‐mindedinanSFenvironment

•  Getngseriousaboutprogramevalua8on

Page 21: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

SUPPORTFORPROGRAMEVALUATION

ACADEMICRESEARCH

PROGRAMEVALUATION

ACCOUNTABILITY

CAMPUSAUTHORITY

Page 22: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

UNBALANCEDINSTITUTIONALRESEARCH

ACADEMICRESEARCH

PROGRAMEVALUATION

ACCOUNTABILITY

CAMPUSAUTHORITY

Page 23: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

HEALTHYINSTITUTIONALRESEARCH

ACADEMICRESEARCH

PROGRAMEVALUATION

ACCOUNTABILITY

CAMPUSAUTHORITY

Page 24: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

SidSuslowoncemore:

•  “Theremustbewithintheins8tu8onalresearchroleasufficientdegreeofindependencewhichpermutesittofullyexamineandcri8cizetheins8tu8on,includingitspurposesandvalues.…Itsuniquenessrestsinthecombina8onofitsroleasaposiJvecriJcconcernedwiththeenhancementandadvancementofhighereduca8onanditsroleasaresearcher,quan8fier,andassessorofquan8ta8veandqualita8veinforma8onabouttheins8tu8on….Anac8veins8tu8onalresearchrolealsorequiresthesustenanceofanefficacioussymmetrybetweenac8vi8esprescribedbyitsservicetotheins8tu8onandopportuni8esforexplora8oninareasresponsivetoitsowninsightsandinterests.Crea8vityisanac8veprocesswhichrequiresadegreeofautonomythatmustberealandsufficient….Withoutthisfundamentalingredient,thecomposi8onoftheins8tu8onalresearchrolelackspotency.”

Page 25: FOUR TYPES OF INSTITUTIONAL RESEARCH · FOUR TYPES OF INSTITUTIONAL RESEARCH Gregg Thomson, Executive Director Office of Student Research and Campus Surveys University of California,

CONCLUDINGTHOUGHTS

•  Bestof8mes,worstof8mes?•  Authen8cins8tu8onalresearchandthelearningcommunity

•  Comments,Ques8ons,Sugges8ons(please!)

[email protected]


Institutional research -Ashleigh

Institutional research

Institutional Research Institute€¦ · Foundations of Institutional Research 2015 4 Types of audiences Various committees Executives, e.g. Vice-Chancellors and other senior administrators/managers

Institutional Research · Institutional Research . Sources: SARS Anywhere, Survey Monkey, SDCCD Institutional Research Database. • Eighty-six percent of respondents reported that

THE STATUS OF INSTITUTIONAL RESEARCH - AAIRaair.org.au/.../TheStatusofInstitutionalResearch.pdf · Keywords: Institutional research, characteristics of institutional research, history

Institutional Review Board...Purpose of the Institutional Review Board (IRB) 3 Definitions 3 IRB Membership 4 IRB Administrator 5 Types of Research Requiring IRB Review 5 Types of

วิจัยสถาบัน Institutional Research

Institutional Types

Institutional research, Media

Institutional research (pixar)

Types and Dynamics of Institutional Change: Transportation

Institutional Research

Institutional Research - tuas.fi · Institutional Research The Institutional Research group focuses on multidisciplinary research of higher education institutions. At Turku University

Institutional research sbtv

Institutional Ontology as an Ontology of Types

Magazine Institutional Research

Institutional logo research

Institutional Research - Frontpage · Institutional Research The Institutional Research group focuses on multidisciplinary research of higher education institutions. At Turku University

INSTITUTIONAL EQUITY RESEARCH Parag Milk Foodsbackoffice.phillipcapital.in/Backoffice/Researchfiles/Research... · INSTITUTIONAL EQUITY RESEARCH ... PHILLIPCAPITAL INDIA RESEARCH

Institutional Research and Analytical Studies · Institutional Research and Analytical Studies 2 Mission-- Institutional self-understanding through research and analysis. -- Data