digital research conference 2013 - framework to assess the quality of twitter data for research...

15
How do I know? – Assessing the reliability and validity of micro blogging data Ana Isabel Canhoto, Oxford Brookes University Jan Kietzmann, Simon Fraser University Canhoto and Kietzmann, 2013

Upload: ana-canhoto

Post on 20-Aug-2015

125 views

Category:

Business


1 download

TRANSCRIPT

Page 1: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

How  do  I  know?  –  Assessing  the  reliability  and  validity  of  micro  

blogging  data  Ana  Isabel  Canhoto,  Oxford  Brookes  University  Jan  Kietzmann,  Simon  Fraser  University  

Canhoto  and  Kietzmann,  2013  

Page 2: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

Canhoto  and  Kietzmann,  2013  

Focused  on  micro-­‐

blogging,  575  

MenOons  micro-­‐

blogging,  550  

Academic  Papers  2007-­‐2011  Source:  Williams  et  al  2013  

There  is  genuine  informaOon  in  the  twiSersphere,  not  

just  sarcasm.  

As  transformaOve  for  social  sciences  ‘as  

Galileo’s  telescope  was  for  the  physical  

sciences’  (Baker  2009)  

Page 3: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

Canhoto  and  Kietzmann,  2012  

Page 4: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

How  do  I  know?  

Canhoto  and  Kietzmann,  2013  

Page 5: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

'How  do  I  know'  test  

Canhoto  and  Kietzmann,  2013  

 Paul  Raimond:    

'...will  the  evidence  and  my  conclusions  stand  up  to  the  closest  scru8ny?'  (1993:  55)  

Page 6: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

InformaOon  Quality  

Canhoto  and  Clark,  2012  

Page 7: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

InformaOon  Quality  

Dimension  

Intrinsic   The  data  in  its  own  right;  and  the  source  

Contextual   Context  for  which  the  data  is  to  be  used  

RepresentaOonal   The  format  and  the  meaning  of  the  data  

Accessibility   How  the  data  is  stored  and  retrieved  Canhoto  and  Kietzmann,  2013  

Page 8: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

Assessment  criteria  

Canhoto  and  Kietzmann,  2013  

TradiOonal   Emerging  

Generalisability  

Internal  Validity  

Reliability  

Open  access  

Ethical  

Page 9: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

ApplicaOon  Dimension   Microblogging  

Intrinsic   The  data  in  its  own  right  +  the  source  

•  Establishing  ID  •  Fake  accounts  (bots)  •  Plaform  users  vs.  overall  populaOon  •  Strategic  use  of  plaform  to  achieve  

specific  goals  

Contextual   Context  for  which  the  data  is  to  be  used  

•  EOqueSe  •  (Short)  life  span  of  a  tweet  •  What  can  you  say  in  140  characters?  

(limited  iteraOon)  •  Relevance  •  Off-­‐limit  subjects?  Canhoto  and  Kietzmann,  2013  

Page 10: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

ApplicaOon  Dimension   Microblogging  

RepresentaOonal   Format  and  meaning  of  the  data  

•  EmoOcons  •  Sarcasm  •  AbbreviaOons  •  Text...  links...  pictures  

Accessibility   How  the  data  is  retrieved  

•  Open  •  Tools  to  collect  data  (inc.  free)  •  Public  comments  •  Limited  search  capabiliOes  

Canhoto  and  Kietzmann,  2013  

Page 11: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

ApplicaOon  

Canhoto  and  Kietzmann,  2013  

This article was downloaded by: [Oxford Brookes University]On: 05 July 2013, At: 06:02Publisher: RoutledgeInforma Ltd Registered in England and Wales Registered Number: 1072954 Registeredoffice: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK

Journal of Marketing ManagementPublication details, including instructions for authors andsubscription information:http://www.tandfonline.com/loi/rjmm20

Customer service 140 characters at a

time: The users' perspective

Ana Isabel Canhoto a & Moira Clark ba Oxford Brookes University , UKb Henley Business School , UKPublished online: 26 Mar 2013.

To cite this article: Ana Isabel Canhoto & Moira Clark (2013) Customer service 140 charactersat a time: The users' perspective, Journal of Marketing Management, 29:5-6, 522-544, DOI:10.1080/0267257X.2013.777355

To link to this article: http://dx.doi.org/10.1080/0267257X.2013.777355

PLEASE SCROLL DOWN FOR ARTICLE

Taylor & Francis makes every effort to ensure the accuracy of all the information (the“Content”) contained in the publications on our platform. However, Taylor & Francis,our agents, and our licensors make no representations or warranties whatsoever as tothe accuracy, completeness, or suitability for any purpose of the Content. Any opinionsand views expressed in this publication are the opinions and views of the authors,and are not the views of or endorsed by Taylor & Francis. The accuracy of the Contentshould not be relied upon and should be independently verified with primary sourcesof information. Taylor and Francis shall not be liable for any losses, actions, claims,proceedings, demands, costs, expenses, damages, and other liabilities whatsoever orhowsoever caused arising directly or indirectly in connection with, in relation to or arisingout of the use of the Content.

This article may be used for research, teaching, and private study purposes. Anysubstantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &Conditions of access and use can be found at http://www.tandfonline.com/page/terms-and-conditions

Page 12: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

140  characters  paper  Dimension   Microblogging  

Intrinsic   The  data  in  its  own  right  +  the  source  

•  Establishing  ID  •  Fake  accounts  (bots)  •  Plaform  users  vs.  overall  populaOon  •  Strategic  use  of  plaform  to  achieve  

specific  goals  

Contextual   Context  for  which  the  data  is  to  be  used  

•  EOqueSe  •  (Short)  life  span  of  a  tweet  •  What  can  you  say  in  140  characters?  

(limited  iteraOon)  •  Relevance  •  Off-­‐limit  subjects?  Canhoto  and  Kietzmann,  2013  

Page 13: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

140  characters  paper  Dimension   Microblogging  

RepresentaOonal   Format  and  meaning  of  the  data  

•  EmoOcons  •  Sarcasm  •  AbbreviaOons  •  Text...  links...  pictures  

Accessibility   How  the  data  is  retrieved  

•  Open  •  Tools  to  collect  data  (inc.  free)  •  Public  comments  •  Limited  search  capabiliOes  

Canhoto  and  Kietzmann,  2013  

Page 14: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

140  characters  paper  

Canhoto  and  Kietzmann,  2013  

TradiOonal   Emerging  

Generalisability  

Internal  Validity  

Reliability  

Open  access  

Ethical  

Page 15: Digital Research Conference 2013 - Framework to assess the quality of Twitter data for research purposes

Ana  Isabel  Canhoto  www.anacanhoto.com  @canhoto  adomingos-­‐[email protected]    

Jan  Kietzmann  hSp://beedie.sfu.ca/profiles/JanKietzmann  [email protected]  

How  do  I  know?  –  Assessing  the  reliability  and  validity  of  micro  

blogging  data