from question to action: creating in-house surveys as a part of data-driven decision making...

28
  F   R   O   M    Q   U   E   S    T   I   O   N     T   O    A   C    T   I   O   N   :    C   R   E   A    T   I   N   G    I   N  -   H   O   U   S   E    S   U   R   V   E    Y   S    A   S    A    P   A   R    T    O   F    D   A    T   A    D   R   I   V   E   N    I   N   F   O   R   M   E   D    D   E   C   I   S   I   O   N    M   A   K   I   N   G    D   A   V   I   D    C   O   N   S   I   G   L   I   O EDUCAUSE CONNECT APRIL 22, 2015

Upload: educause

Post on 01-Jun-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 1/28

F R O M Q

U E S T

I O N T O

A C T I O

N :

C R E A T

I N G I N

- H O U

S E S U R

V E Y S

A S A

P A R T

O F D A

T A D R I V

E N I N F O

R M E D

D E C I S

I O N M

A K I N G

D A V I

D C

O N

S I G

L I O

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 2: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 2/28

SURVEY DESIGN PROCESS

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

IVITY #1

K: You have been told to u!ve" "ou! o$$un%t" ab &ual%t" o' la !oo$ u((o!t e!v% e ) Outl%ne the *( to+a!d a h%ev%n, th% ,oal)

E: . $%nute

PECTATIONS: You a!e NOT e0(e ted to have a o$(lve" at the end o' the . $%nute )

Page 3: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 3/28

SURVEY DESIGN PROCESS

• Sta,e 1: -% %on tate$ent• Sta,e : Plann%n,•

Sta,e 2: In t!u$ent develo($ent3Re !u%t%n, (lan• Sta,e 4: Data olle t%on• Sta,e .: Data anal" % and !e(o!t%n,

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

S T A G E S

Page 4: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 4/28

SURVEY DESIGN PROCESS: STAGE 1

M I S S I O N S T A T E M E N T

• 5h" do the !e ea! h6• 5hat a!e the ,oal 6• 5hat a t%on $a" !e ult '!o$ %t6• 5!%te a $% %on tate$ent and !e'e!

to %t th!ou,hout the (!o e

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 5: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 5/28

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 6: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 6/28

SURVEY DESIGN PROCESS: STAGE

P L A N N I N G : M E A S U R E M E N T

• De*ne the (!%$a!" on t!u t• On e (!%$a!" on t!u t a!e de*ned3

dete!$%ne the ele$ent that

o$(o e the on t!u t• Con %de! !elated ele$ent o' %nte!e t

7e),)3 de$o,!a(h% 8• Develo( a data anal" % (lan

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 7: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 7/28

SURVEY DESIGN PROCESS: STAGE

P L A N N I N G : R E P R E S E N T A T I O N

• De*ne the %ntended (o(ulat%on 9 be(e %*

• Develo( a a$(le '!a$e a (lan 'o!dete!$%n%n, ho+ to !ea h the (o(ulat%on

• Develo( a a$(l%n, (lan• Dete!$%ne the $ode 'o! data olle t%on

7%)e)3 5eb3 (a(e!3 %n (e! on %nte!v%e+ 3tele(hone8

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 8: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 8/28

Page 9: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 9/28

SURVEY DESIGN PROCESS: STAGE 2

I N S T R U M E N T D E V E L O P M E N T : C O N S U LT W I T H E P E R T S

• E0(e!t o' u!ve" de %,n anda$(l%n,

• To(% e0(e!t : e!v% e (!ov%de!• To(% e0(e!t : e!v% e on u$e!• <oo= to e0% t%n, and +ell te ted

u!ve" %n t!u$ent

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 10: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 10/28

SURVEY DESIGN PROCESS: STAGE 2

I N S T R U M E N T D E V E L O P M E N T: D R A F T Q U E S T I O N S

• Rev%e+ to dete t o$$on >a+

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 11: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 11/28

SURVEY DESIGN PROCESS: STAGE 2

I N S T R U M E N T D E V E L O P M E N T: D R A F T Q U E S T I O N S

• Rev%e+ to dete t o$$on >a+

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 12: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 12/28

SURVEY DESIGN PROCESS

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

TIVITY #

SK: Ident%'" the o$$on >a+ %n the u!ve" &ue t%o the handout)

E: . $%nute

T: The!e a!e a $%n%$u$ o' t+o >a+ (e! &ue t%on)

Page 13: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 13/28

SURVEY DESIGN PROCESS: STAGE 2

I N S T R U M E N T D E V E L O P M E N T : F O C U S G R O U P T E S T I N G

• @%ve to t+elve %nd%v%dual 'o! ea h $a o!(o(ulat%on to be u!ve"ed

• T+o taB $e$be! : one to 'a %l%tate'o u ,!ou(3 one to ta=e note

• Pa!t% %(ant hould o$(lete the u!ve"• A = ho+ the" %nte!(!eted ea h &ue t%on

and ea h %te$ %nd%v%duall"• A = %' the" +e!e able to an +e! ea h

&ue t%on

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 14: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 14/28

SURVEY DESIGN PROCESS: STAGE 2

I N S T R U M E N T D E V E L O P M E N T : R E W R I T E Q U E S T I O N N A I R E

• Ta=e %nto a ount 'eedba = '!o$'o u ,!ou( te t%n,

Re te t %' ne e a!"• ;u%ld %n all u!ve" $e han% 7e),)

=%( lo,% 8• De*ne all value and va!%able na$e

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 15: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 15/28

SURVEY DESIGN PROCESS: STAGE 2

R E C R U I T I N G P L A N : M E S S A G I N G

• ?o+ $an" $e a,e +%ll be ent•

5ho +%ll be the ende! o' the$e a,e

• 5hen +%ll $e a,e be ent• D!a't $e a,e ontent

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 16: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 16/28

T I P S @ O R

- A /

I - I C I

N G

R E S P

O N S E R

A T E S

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 17: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 17/28

Page 18: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 18/28

-A/I-I ING RESPONSE RATES: SURVEYCONSTRUCTION

• -a=e u!ve" a ho!t a (o %ble +h%le t%llolle t%n, the data "ou need)

• I' the u!ve" % lon,3 b!ea= %t u( a !o $an"(a,e )

• -a=e u!ve" ea " to ta=e)U!" #$%&'( )*"!%'+ ! -." !"/"&$ )*"!%'+ ! .$/" %." !$#" ! $ "

K""3 )*"!%'+ -+&4' !'#3 "B" ' !*&/"6 -'%. %." #+!% " "&$ $ 4 "$!6 )*"!%'+ ! %+ $ !-"&S$/" 4"#+ &$3.' )*"!%'+ ! 7+& %." " 4 +7 %." !*&/"6M$8" %." 9!%+&6 +7 %." !*&/"6 "$!6 %+ 7+ +-

• Kee( the o(en u!ve" (e!%od !elat%vel" ho!t3 %n

$o t a e t+o +ee= % $o!e than enou,ht%$e)

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 19: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 19/28

SURVEY DESIGN PROCESS

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

TIVITY #2

K: Ident%'" the a (e t o' the %nv%tat%on $e a,e th=e %t %neBe t%ve)

E: . $%nute

A/ G S O S A S

Page 20: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 20/28

-A/I-I ING RESPONSE RATES:-ESSAGINGP R E L I M I N A R Y N O T I F I C AT I O N

• Send (!el%$%na!" not%* at%on'!o$ a t!u ted autho!%t")

• Do not %n lude l%n= to the u!ve")• Announ e the u!ve" % o$%n,

and tate +h" %t % %$(o!tant tothe %n t%tut%on)

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

A/I I ING RESPONSE RATES

Page 21: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 21/28

-A/I-I ING RESPONSE RATES:-ESSAGING

I N I T I A L I N V I T AT I O N

• 5!%te the $e a,e a %' %t % a (e! onal o$$un% at%on'!o$ one (e! on to one (e! on)

• Send the $e a,e '!o$ one %nd%v%dual u %n, the e$a%ladd!e o' an %nd%v%dual)

Pe! onal% e the %nv%tat%on : e),)3 Dea! Fohn3 o! ?% Fohn3• U e %n,ula! (e! onal (!onoun : 5!%te I %n tead o'

5e +heneve! (o %ble)• Tell the$ +h" u!ve" % %$(o!tant to the$3 not +h" %t %

%$(o!tant to "ou o! the %n t%tut%on)

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

A/I I ING RESPONSE RATES

Page 22: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 22/28

-A/I-I ING RESPONSE RATES:-ESSAGING

I N I T I A L I N V I T AT I O N

• Tell the$ +h" the%! (a!t% %(at%on % %$(o!tant)• U e a$(le '!o$ (o(ulat%on %' (o(ulat%on a!e

la!,e enou,h3 then %n'o!$ the ele ted %nd%v%dualthat the" a!e a$on, a ele ted ,!ou( o' %nd%v%dual )

-a=e %nv%tat%on ho!t)• Save IR; lan,ua,e 'o! the u!ve" %t el'3 %'

(e!$% %ble b" "ou! IR;)• U e lan,ua,e that % a %n'o!$al a (e!$%tted 'o!

the (o(ulat%on)

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

A/I I ING RESPONSE RATES

Page 23: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 23/28

-A/I-I ING RESPONSE RATES:-ESSAGING

I N I T I A L I N V I T AT I O N

• Neve! %n lude the +o!d u!ve" %n the ub e tl%ne o' the $e a,e )

• Do not !eveal the lo e date o' the u!ve" unt%lthe *nal !e$%nde! not% e)

• Choo e ub e t l%ne that a!e ,ene!% ound%n,but %nte!e t%n, to (otent%al !e (ondent )

• -e a,e hould onta%n no othe! l%n= then theone that ta=e the$ to the u!ve")

• Do not be ove!l" on e!ned +%th ,!a$$a!)

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

A/I I ING RESPONSE RATES

Page 24: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 24/28

-A/I-I ING RESPONSE RATES:MESSAGING

R E M I N D E R N O T I C E S

• @ollo+ all the !ule o' the In%t%al Inv%tat%on)• U e eve!al !e$%nde! not%* at%on heduled

evenl" th!ou,hout the o(en u!ve" (e!%od)• Re$%nde! not% e an be le 'o!$al and

hould !e'e! to the (!ev%ou $e a,e )• U e the ub e t head%n, 'o! the In%t%al

Inv%tat%on +%th the add%t%on o' Re: %n '!onto' %t)

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

A/I I ING RESPONSE RATES

Page 25: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 25/28

-A/I-I ING RESPONSE RATES:INCENTIVES

-%n%$all" eBe t%ve:C.$ " %+ -' '7% "&%'; $%" +& +##+ '%"# <" ,'P+4=

EBe t%ve:C.$ " %+ -' !+#"%.' .' . 6 4"!'&$> " $ 44'? * % %+ +>%$' <" , !%*4" % "%! ;&!% .+' " 7+&!" " %' .+*!' =

Ve!" eBe t%ve:P$6#" %, "/" $% !#$ $#+* %!, %+ $ 3$&%' '3$ %!

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 26: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 26/28

SURVEY DESIGN PROCESS: STAGE 4

D A T A C O L L E C T I O N : D R E S S R E H E A R S A L

• Che = that all $e a,e lea! (a$*lte!

• -e a,e 'o!$att%n, % o!!e t• <%n= +o!= (!o(e!l"• @%nal !ev%e+ o' the u!ve"

%n t!u$ent

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 27: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 27/28

SURVEY DESIGN PROCESS: STAGE 4

D A T A C O L L E C T I O N : S U R V E Y L A U N C H

• Che = that data % be%n, olle ted(!o(e!l"

• Re (ond &u% =l" to an" !e(o!t o'(!oble$ +%th the u!ve"

• Send !e$%nde! not% e a heduled• Clo e u!ve" a heduled

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5

Page 28: From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

8/9/2019 From Question to Action: Creating In-House Surveys as a Part of Data-Driven Decision Making (262776190)

http://slidepdf.com/reader/full/from-question-to-action-creating-in-house-surveys-as-a-part-of-data-driven 28/28

SURVEY DESIGN PROCESS: STAGE

D A T A A N A LY S I S A N D R E P O R T I N G

• Clean data• Anal" e data a ,u%ded b" anal" %

(lan• Re(o!t !e ult

E D U C A U S E C O N N E C T A P R I L 2 2 , 2 0 1 5