Download - WikiSym 2011 Closing Keynote

WikiSym 2011 | Closing Keynote!

Model-Driven Research in Social Computing!!

Ed H. Chi!!

Google Research!!Work done while at Palo Alto Research Center (PARC)!

!

!

2011-10-05 WikiSym 2011 Closing Keynote 1

*"/$)'78%"2%!"&'()%!'87()-%'7%9%:&+-%

!  J4-&OOOZ&M3"&J90-('4-"?&[  \3'("?&]5#6%"?A"&\$'4"&

!  J4-&OOZ&M3"&^.0.9%"&[  \3'("?&J55#-'-.#50&

!  J4-&OZ&M3"&O5H.0.9%"&[  \3'(.5A&'4(#00&N'5A8'A"0&

2011-10-05 WikiSym 2011 Closing Keynote

UP(#/&4#/$%"*&-#&0./$%"W&

4

:&+%;;;0%%:6-+,(&+$/%<7"=)$/8$0%%*"/$)'78%"2%>'?'@$/'(%

]8?#0&-#&D#5A6#5&\83C&_.1.&].--8(&

&

U].--8(&"-&'%:C&`aO)<<bW&

U\83&"-&'%:C&I.1.\2/&)<<cW&

U\83C&"-&'%:C&^J\M)<<bW&

&

&


A"8'-+'&%B,"=+C%*"/$)%!  G4#%#A.4'%&$#$8%'-.#5&A(#6-3&/#?"%&

[  J%0#&?"$"5?&#5&"5H.(#5/"5-'%&4#5?.-.#50&

[  ]C&4'((2.5A&4'$'4.-2&S?8"&-#&("0#8(4"&%./.-'-.#5T&

!

dNdt

= rN(1" NK)


D!C"=$,'78E%FG@"+C$-'-%I3'-&?(.H"0&4#5-(.98-.#50&-#&I.1.$"?.'d&

`##$"('-.#5&.0&5#-&-3"&/'.5&?(.H"(d&

!  a2$#-3"0.0Z&`#5e.4-0&?(.H"0&/#0-&#7&-3"&4#5-(.98-.#50:&[  a#6&?#&6"&/"'08("&4#5e.4-0d&

!  `#5e.4-0&4'80"&4##(?.5'-.#5&4#0-0&-#&A#&8$:&[  a#6&-#&/"'08("&4##(?.5'-.#5&4#0-0d&

!  f5"A#-.'-.#5&.0&4(.-.4'%&-#&3"%$.5A&/8%-.$%"&$"(0$"4-.H"0&-#&4#5H"(A"&#5&03'("?&15#6%"?A":g&&[  \-'3%C&@(#8$&`#A5.-.#5C&`3LC&)<<Y&


2011-10-05

H"7I'&+JH"",/'7(+'"7%KL$&+-%'7%>'?'@$/'(%

60%

65%

70%

75%

80%

85%

90%

95%

100%

2001 2002 2003 2004 2005 2006

Perc

enta

ge o

f to

tal edits

Article

User

Article Talk

User Talk

Other

Maintenance

(Kittur, Suh, Pendleton, Chi, CHI2007)

WikiSym 2011 Closing Keynote 8

2011-10-05 WikiSym 2011 Closing Keynote

M-'78%*(&C'7$%A$(,7'78%+"%N$+$&+%H"7I'&+-%!  `#85-.5A&h`#5-(#H"(0.'%E&%'9"%0&

!  B*&4(#00+H'%.?'-.#5C&i)&j&<:Lcb&

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000

Predicted controversial revisions

Actu

al c

ontr

over

sial r

evisi

ons

9

O(+'"%"2%O$P$,+$/%H"7+,'61+'"7-%%

Monthly Ratio of Reverted Edits


Q'-1()%:7()G+'&-%"P$,%>'?'@$/'(%/(+(%*$/'(+",%R(++$,7%S%5$,,'%!&C'(P" % %.!1CT%$+%()UT%Q:!5VWWX3%

Mediators

Sympathetic to parents

Sympathetic to husband

Anonymous (vandals/spammers)


>'?'N(-C6"(,/U&"#%


:&+%;;0%Q'-'6)$%!"&'()%!'87()-%2,"#%%!C(,$/%F'8C)'8C+'78%

&

&

]8?#0&-#&N.43'5&a#5AC&N"0&_"%0#5&&

Ua#5A&"-&'%C&J^O)<<LW&

U_"%0#5&"-&'%:C&a`OO&)<<cW&


Y'7/'78%(%O$-+(1,(7+%

!  J$$(#$(.'-"&7#(&-3"&#44'0.#5&


Poor heuristic

Good heuristic

F$1,'-+'&-%


DF'7+-E%

Solo

Cooperative (“good hints”)


!@(,5(8U1-0%!"&'()%F'8C)'8C+'78%


!@(,5(8U1-0%!"&'()%F'8C)'8C+'78%

!  !"#$%&'&-'AA.5A&63.%"&("'?.5A&

!  a.A3%.A3-.5A&

!  \3'("?&5#-"9##1.5A&&

!  \3'(.5Ak&


F'8C)'8C+'78%(-%;#@",+(7&$%%;7/'&(+",%

recall first-visit


!  \"50"/'1.5A&-'01&[  P.5?&'5?&("'?&/'-"(.'%&'9#8-&“G5-"($(.0"&):<&/'038$0”&.5&#(?"(&-#&

6(.-"&-6#&"00'20&

!  \""?0Z&“"*$"(-”&4#5-"5-&7#(&04'l#%?.5A&[  M'A0&7(#/&?"%:.4.#:80&

[  miN0&7(#/&@##A%"X!'A"i'51&

[  `#50-(84-"?&'5?&-3"5&03'("?&-3(#8A3&0#4.'%&/"43'5.0/0&S.:":C&'&\$'(M'A:80&“7(."5?”T&

!  !"(7#(/'54"&Q"'08("0&[  N"'(5.5A&A'.5Z&!("X!#0-&]5#6%"?A"&M"0-&

&

GH'%8'-.#5&M'01&n&Q"-(.4&U_"%0#5&"-&'%:C&a`OO)<<cW&

scorePretest - scoreMax scorePretest -scorePosttest

=Gain


R,"&$/1,$%

o"/#A('$3.40&n&!("-"0-&

SF \$'(M'A:80&6.-3&‘P(."5?’&

SO \$'(M'A:80&p5%2&

WS I.-3#8-&\$'(M'A:80&

!#0--"0-&


O$-1)+-0%A$(,7'78%B('7%_j;L&&!@(,5(8U1-%Z%Y,'$7/%-1@$,'",%+"%6"+C%'7/'P'/1()%&"7/'+'"7-%_#&?.l"("54"&9"-6""5&-3"&-6#&4#5-(#%&4#5?.-.#50&


URL Kind Code Blog B Conference C Employment E MySpartagus M News N OpenSource O Search S Vendor V Wikipedia W Consultant X

[6-$,P(+'"7%miN&].5?& `#?"&

D%#A& D&

`#57"("54"& `&

G/$%#2/"5-& G&

Q2:\$'(-'A:80& Q&

_"60& _&

p$"5\#8(4"& p&

\"'(43& \&

^"5?#(& ^&

I.1.$"?.'& I&

`#508%-'5-& q&


Q"7%O$-+",L%;-")(+'"7%KL$&+%.\]993%!  J0&'$$%."?&-#&3.A3%.A3-0C&-3"&!"#$%&'(")*$+'",-(+"#$&*&.($

08AA"0-0&-3'-&("'?"(0Z&

!  ()*#&+",#&-#.-/'$#-"#'5?&&!  (0*#1+)2"#34)&#%$#5)26+,C&&!  63"-3"(&-3"&.57#(/'-.#5&.0&./$#(-'5-&#(&5#-:&

[  _.0-&'5?&a#A("9"&Lb&


:&+%;0%%;7P'-'6)$%^,"?$,(8$%!'87()-%(&,"--%A(781(8$%^(,,'$,-%

r#.5-&6#(1&6X&N.43'5&a#5AC&@("A#(.#&`#5H"(-.5#&

&

Ua#5A&"-&'%:C&O`I\Q&)<;;W&&


!"&'()%!+,$(#%O$-$(,&C%!  M6""-&("4#//"5?'-.#5&S`3"5&"-&'%C&àOE;<&n&àOE;;T&

!  M#$.4+9'0"?&4%80-"(.5A&n&9(#60.5A&#7&-6""-0&SD"(50-".5&

n&a#5A&"-&'%C&mO\ME;<T&

!  P'4-#(0&./$'4-.5A&("-6""-'9.%.-2&S\83&n&a#5A&"-&'%C&OGGG&

\#4.'%&`#/$8-.5AE;<T&

!  N#4'-.#5&K"%?&#7&80"(&$(#K%"0&Sa"43-&n&a#5A&"-&'%C&

àOE;;T&

!  [,8(7'&%_`:%6$C(P'",-%aR(1)%$+%()T%;H>!*b\\c%

!  A(781(8$-%1-$/%'7%5='++$,%aF"78%$+%()T%;H>!*b\\c%


*"+'P(+'"7%2",%!+1/G'78%A(781(8$-%

!  M6.--"(&.0&'5&.5-"(5'-.#5'%&$3"5#/"5#5&

[  Q#0-&("0"'(43&7#480"?&#5&G5A%.03&80"(0&

[  V8"0-.#5&'9#8-&A"5"('%.s'-.#5&-#&5#5+G5A%.03&

[  m5?"(0-'5?&4(#00+%'5A8'A"&80'A"&?.l"("54"0&[  o"0.A5&./$%.4'-.#50&7#(&.5-"(5'-.#5'%&80"(0&

!  i"0"'(43&V8"0-.#50Z&

[  I3'-&.0&-3"&%'5A8'A"&?.0-(.98-.#5&.5&M6.--"(d&

[  a#6&?#&80"(0&#7&?.l"("5-&%'5A8'A"0&80"&M6.--"(d&

[  a#6&?#&9.%.5A8'%&80"(0&0$("'?&.57#(/'-.#5&'4(#00&%'5A8'A"0d&

&2011-10-05 WikiSym 2011 Closing Keynote 27

N(+(%H"))$&+'"7%`%R,"&$--'78%

&M6.--"(&0-("'/&

&;<Y&%'5A8'A"0&&

<YX;LX;<+<BX;FX;<&SY&6""10T&&

&F)Q&-6""-0&

@##A%"&N'5A8'A"&J!O&n&N.5A!.$"&

M#$&;<&%'5A8'A"0&


5"@%\W%A(781(8$-%'7%5='++$,%

%%A(781(8$% %%%%%5=$$+-% %%%%d% %%%%%M-$,-%

K78)'-C% ,;CcB)CcFY& e\U\% BC)L)CFBb&

f(@(7$-$% ;;CcbBCY)c& \]U\% ;C,,BC<bY&

R",+181$-$% BCcc,CBLY& ]Ug% cc,C<L,&

;7/"7$-'(7% ,CYL,CLY)& eUg% ,,LC;;F&

!@(7'-C% )Cc,;C<)B& hUX% b<FCB))&

o8-43& LL,CcY)& ;:Y& )YbCB)c&

]#("'5& bBYC;Lc& ;:)& ;;FCB<F&

P("543& F<,Cb<F& ;:<& )F;CYL;&

@"(/'5&& BLLCY<c& ;:<& ;c)CYbb&

Q'%'2& BBcC,L;& <:c& ;L<C;Yb&2011-10-05 WikiSym 2011 Closing Keynote 29

F1#(7SH"/'78%!+1/G%!  )C<<<&('5?#/&-6""-0&7(#/&F)Q&-6""-0&

!  )&38/'5&>8?A"0&7#(&"'43&#7&-#$&;#&%'5A8'A"0&&

[  5'-.H"&0$"'1"(0&#(&$(#K4."5-&[  ?.04800&-#&("0#%H"&?.0'A(""/"5-&

!  a'(?&-#&K5?&O5?#5"0.'5&n&Q'%'2&>8?A"0&

!  !("0"5-"?&)C<<<&-6""-0&-#&"'43&>8?A"&

!  r8?A"&0"%"4-"?&-6""-0&.5&3.0X3"(&%'5A8'A"&


:&&1,(&G%"2%A(781(8$%N$+$&+'"7%

!  M6#&M2$"0&#7&G((#(0&

[  7-&#'2#,%2/&#5$89%:5#1'6"8#;32,#<#&3&#3%&#'#&--9$-=3)&#,-%"8#4)>S?"-"4-"?&'0&J7(.1''50T&

[  a.A3&"((#(&('-"&7#(&-6""-0&#7&;t)&6#(?0&


*(&C'7$%P-U%F1#(7%%%A(781(8$% %%%%%5SR% %%%5Si% %%%YSi% %%YSR% %%%%%%H"C$7b-%<(@@(%

K78)'-C% ]Xh% ]X\% VW% 9e% WU]e%f(@(7$-$% ,b<& ;CBcB& <& ,B& WU]h%R",+181$-$% ;b<& ;CL<,& ;c& L& WU]V%;7/"7$-'(7% ;<F& ;CLbB& ;B& Y& WU]\%!@(7'-C% cF& ;CLLc& ;;& Y& WU]V%N1+&C% ;L& ;CcbL& )& )& WU]W%<",$(7% )Y& ;CcbF& <& <& \UWW%P("543& ;,& ;CcL<& <& b& <:bc&

@"(/'5&& ;)& ;Ccbc& )& b& <:b)&

Q'%'2& L& ;Ccbc& Y& c& <:BB&

5SR0%+,1$%@"-'+'P$T%5Si0%+,1$%7$8(+'P$T%YSi0%2()-$S7$8(+'P$T%YSR0%2()-$%@"-'+'P$%2011-10-05 WikiSym 2011 Closing Keynote 32

*(&C'7$%P-U%F1#(7%

%%A(781(8$% %%%%%5SR% %%%5Si% %%%YSi% %%YSR% %%%%%%H"C$7b-%<(@@(%

P("543& ;,& ;CcL<& W% X% <:bc&

@"(/'5&& ;)& ;Ccbc& V% X% <:b)&

Q'%'2& L& ;Ccbc& h% ]% <:BB&

•  P("543Z&BXb&P+!&3'H"&)&6#(?0&

•  @"(/'5Z&;X)&P+_&3'0&;&6#(?u&FXb&P+!0&'("&.5&G5A%.03&

•  Q'%'2Z&,XY&P+_0&n&bXc&P+!0&'("&.5&O5?#5"0.'5&


H"##"7%5='++$,%H"7P$7+'"7-%C(-C+(8%

MOA%#$7+'"7%

,$@)G%S$"(+-6""-&/"-'?'-'T&

,$+=$$+%2011-10-05 WikiSym 2011 Closing Keynote 34

M-$%"2%MOA-%'7%gV*%5=$$+-%

%%A(781(8$% %MOA-%

/,,$ V\d%

G5A%.03& )Bv&

r'$'5"0"& \9d%

!#(-8A8"0"& \9d%

O5?#5"0.'5& \9d%

\$'5.03& ;Bv&

o8-43& ;bv&

]#("'5& ;bv&

P("543& 9Xd%

@"(/'5&& 9]d%

Q'%'2& ;bv&

!  J%%&S);vT&

!  v&43'5A"0&'4(#00&%'5A8'A"0&

!  @"(/'5&'5?&P("543&3'H"&3.A3&v&

!  r'$'5"0"C&!#(-8A8"0"C&'5?&

O5?#5"0.'5&3'H"&%#6&v&

!  G5A%.03&S)BvT&?.l"("5-&7(#/&

#-3"(0&

HC'%!j1(,$%+$-+-%&"7k,#$/%+C(+%/'L$,$7&$-%6G%)(781(8$%(,$%-'87'k&(7+%2011-10-05 WikiSym 2011 Closing Keynote 35

!'87'k&(7+%H,"--SA(781(8$%N'L$,$7&$-%

%%A(781(8$% %F(-C+(8-% %*$7+'"7-% %O$@)'$-% %O$+=$$+-%

/,,$ \\d% h]d% 9\d% \9d%

G5A%.03& ;Yv& Ybv& )cv& ;,v&

r'$'5"0"& ed% Y,v& ,,v& Xd%

!#(-8A8"0"& ;)v& B<v& ,)v& ;)v&

O5?#5"0.'5& ed% XVd% VWd% 9]d%

\$'5.03& ;;v& BLv& ,cv& ;Yv&

o8-43& ;,v& B<v& ,Bv& ;;v&

]#("'5& ;;v& X9d% e]d% ;;v&

P("543& ;)v& YLv& ,Fv& cv&

@"(/'5&& \ld% 9gd% )Bv& Lv&

Q'%'2& ed% F)v& ),v& )cv&

HC'%!j1(,$%+$-+-%&"7k,#$/%+C(+%/'L$,$7&$-%6G%)(781(8$%(,$%-'87'k&(7+%2011-10-05 WikiSym 2011 Closing Keynote 36

;#@)'&(+'"7-%%%A(781(8$% %MOA-% %F(-C+(8-% %*$7+'"7-% %O$@)'$-% %O$+=$$+-%

?11# );v& ;;v& Ycv& ,;v& ;,v&

<",$(7% ;bv& ;;v& X9d% e]d% ;;v&

B$,#(7&& 9]d% \ld% 9gd% )Bv& Lv&

!  m0"&#7&M6.--"(&7#(&0#4.'%&5"-6#(1.5A&H0:&.57#(/'-.#5&03'(.5A&?.l"("5-&.5&?.l"("5-&%'5A8'A"0&

!  o"0.A5&#7&("4#//"5?'-.#5&"5A.5"0&[  ]#("'5&80"(0Z&$(#/#-"&4#5H"(0'-.#5'%&-6""-0&

[  @"(/'5&80"(0Z&$(#/#-"&-6""-0&6.-3&miN0&


!+1/G'78%^')'781()%^,"?$,-%!  O/$#(-'54"&#7&9(#1"(0&

[  \-(84-8('%&3#%"0&SD8(-Ec)TC&N.H"r#8(5'%&Sa"((.5A&"-&'%E<bT&

!  o"K5"&9.%.5A8'%&9(#1"(0&'0&m0"(0&63#&-6""-"?&.5&'&

$'.(&#7&%'5A8'A"0&

!  `'H"'-&

[  m5?"(+"0-./'-"?&?8"&-#&Y+6""1&-./"&%./.-&

[  pH"(+"0-./'-"?&?8"&-#&%'5A8'A"&?"-"4-.#5&"((#(0&


i1#6$,%"2%^')'781()%^,"?$,-%

E% J% P% I% S% D% K% F% G%

J% 140,730&

P% 488,545% 13,228&

I% 230,023& 4,825& 29,405&

S% 359,117& 10,139& 112,524& 36,068&

D% 150,041& 6,383& 30,855& 34,906& 30,916&

K% 19,722& 6,384& 906% 2,014& 1,109& 972%

F% 194,931& 10,463& 53,607& 34,586& 49,445& 33,568& 1,244&

G% 110,748& 6,053& 22,106& 21,471& 21,989& 22,162& 786% 24,763&

M% 148,365& 4,208& 31,184& 135,427&

31,967& 29,331& 1,518& 30,257& 18,301&


!C(,'78%MOA-%:&,"--%A(781(8$-%E% J% P% I% S% D% K% F% G% M%

E 3,013& 18,399% 985& 4,986& 1,144& 212& 1,791& 1,647& 540&

J% 3,013& 77& 37& 58& 29& 43& 59& 46& 18&

P 18,399% 77& 74& 1,644& 198& 2& 453& 168& 123&

I% 985& 37& 74& 67& 64& 1& 53& 38& 279&

S 4,986& 58& 1,644& 67& 139& 0% 286& 139& 53&

D 1,144& 29& 198& 64& 139& 2& 112& 126& 48&

K 212& 43& 2& 1& 0% 2& 3& 3& 1&

F% 1,791& 59& 453& 53& 286& 112& 3& 157& 53&

G 1,647& 46& 168& 38& 139& 126& 3& 157& 40&

M 540& 18& 123& 279& 53& 48& 1& 53& 40&


!C(,'78%F(-C+(8-%:&,"--%A(781(8$-%

E% J% P% I% S% D% K% F% G% M%

E% 8,178& 33,197% 14,969&

27,284& 6,685& 798& 9,410& 7,208& 5,517&

J% 8,178& 331& 135& 351& 218& 149& 352& 260& 100&

P% 33,197% 331& 535& 4,682& 604& 13% 1,231& 580& 400&

I% 14,969& 135& 535& 762& 684& 25& 713& 415& 6,046&

S% 27,284& 351& 4,682& 762& 819& 28& 1,468& 708& 463&

D% 6,685& 218& 604& 684& 819& 26& 851& 769& 424&

K% 798& 149& 13% 25& 28& 26& 25& 18& 20&

F% 9,410& 352& 1,231& 713& 1,468& 851& 25& 879& 411&

G% 7,208& 260& 580& 415& 708& 769& 18& 879& 265&

M% 5,517& 100& 400& 6,046& 463& 424& 20& 411& 265&


;#@)'&(+'"7-%!  O5?.4'-#(0&#7&4#55"4-.#5&0-("5A-3&9"-6""5&

%'5A8'A"0&[  _8/9"(&#7&9.%.5A8'%&9(#1"(0&

[  J4-0&#7&9(#1"('A"Z&03'(.5A&miN0&n&3'03-'A0&!  G5A%.03&6"%%&4#55"4-"?&-#&#-3"(0C&'5?&/'2&

7854-.#5&'0&'&389&

!  _""?&-#&./$(#H"&4(#00+%'5A8'A"&4#//85.4'-.#50&

? �2011-10-05 WikiSym 2011 Closing Keynote 42

>C(+%N'/%>$%A$(,7m%!  M3"&`#//#5&M3("'?Z&

[  m-.%.s'-.#5&#7&\#4.'%&\.A5'%0&7#(&N"'(5.5A&'5?&O57#(/'-.#5&J44"00&

[  63"-3"(&.-&.0&.5H.0.9%"C&H.0.9%"C&'5?&'90-('4-"?:&

!  M3"&G0-'9%.03/"5-&#7&`#//#5&@(#85?&[  O/$%.4.-&`##(?.5'-.#5&

[  G*$%.4.-&`##(?.5'-.#5&[  _"A#-.'-.#5&

!  fJ%%&4#%%"4-.H"&'4-.#50&'("&98.%-&#5&4#//#5&A(#85?&'5?&.-0&'448/8%'-.#5:g&[  `%'(1&'5?&D("55'5C&;cc;&


B,(7/%M7'k$/%5C$",G%"2%!"&'()%R(,+'&'@(+'"7%


Scale! Time Unit! Band!

107 s! Months!

106 s! Weeks! Social!

105 s! Days!

104 s! Hours!

103 s! 10 min! Rational!

102 s! Minutes!

101 s! 10 seconds!

100 s! Seconds! Psychological!

10-1 s! 100 msec!

10-2 s! 10 msec! Biological!

5C(7?%G"1n%!  43.w'4/:#(A&

!  3--$ZXX"?43.:5"-&


Download - WikiSym 2011 Closing Keynote

Top Related