current state and future trends:a citation network analysis of the learning analytics field
DESCRIPTION
Citation analysis of learning analytics field from conference proceedings and Journal special issuesTRANSCRIPT
![Page 1: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/1.jpg)
S. DawsonD. Gasevic
G. SiemensS. Joksimovic
Current State and Future Trends:A citation network analysis of the
Learning Analytics Field
![Page 2: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/2.jpg)
Goal
• Citation analysis and structural mapping to gain insight into the influence and impact within LA – a snapshot of LA through analysis of articles and
citations (LAK conferences and special issues)
![Page 3: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/3.jpg)
Context
• Although much potential and excitement:– to date LA has served to identify a condition, but
has not advanced to deal with the learning challenges in a more nuanced and integrated manner
![Page 4: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/4.jpg)
Aim
• Identify emergence of influential trends and hierarchies in the field
• Commencement point (Leah):– a foundation for future work– identify promising areas of research– Identify under represented disciplines– Improve integration across disciplines and theory
and practice
![Page 5: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/5.jpg)
Context• Learning analytics:
– has emerged as a field (maturation)– multi-disciplinary– often mis-represented and poorly understood
• (Academic analytics; business intelligence; assessment analytics; social analytics; web analytics; educational data mining)
![Page 6: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/6.jpg)
Approach
• Bibliometrics measure the impact/influence of an author or article using various citation analyses
• Garfield 1955 (Impact)
Ding, Y. (2011). Scientific collaboration and endorsement: Network analysis of coauthorship and citation networks, Journal of Informetrics, 5(1), 187-203
![Page 7: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/7.jpg)
Data
• LAK11, 12, 13• Special issues – ETS, JALN, ABS• Data analysis
– Citation counts– Author/citation network analysis– Contribution type– Research methods– Author disciplinary background
![Page 8: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/8.jpg)
Approach
• Citation and author networks:– Identify the prominent research– Identify linkages between disciplines and authors– Identify diversity of research genres
![Page 9: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/9.jpg)
Citation analysis
• The use of citations long been used to measure impact– Core output of research is publications– As research grows, output (papers) further build
on other associated works (citations)– “quality” as quantity of citations
• Identify areas of prominent research activity
![Page 10: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/10.jpg)
Citation analysis
• Criticisms– Cronyism– Self citations– “Rich get richer”
![Page 11: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/11.jpg)
By the way some great refs
Gašević, D., Zouaq, A., & Janzen, R. (2013). “Choose Your Classmates, Your GPA Is at Stake!” The Association of Cross-Class Social Ties and Academic Performance. American Behavioral Scientist 57 (10), 1460-1479
Siemens, G. (2013). Learning Analytics The Emergence of a Discipline. American Behavioral Scientist 57 (10), 1380-1400
Dawson, S., Tan, J., & McWilliam, E. (2011). Measuring creative potential: Using social network analysis to monitor a learners' creative capacity. Australasian Journal of Educational Technology 27 (6), 924-942
![Page 12: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/12.jpg)
Citation analysis
![Page 13: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/13.jpg)
Citation analysis
• Ok Some faults – broadly accepted that quality is linked to the number of citations
![Page 14: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/14.jpg)
Citation analysis
• Number of citations (Highly cited articles)– Predominately conceptual and opinion papers
(e.g. Educause)– Methods (Wasserman and Faust)– Few empirical studies
• Citation and author networks:– Illustrate linkages and disciplines
![Page 15: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/15.jpg)
Example author networks
Paper 1: Liz, Julie, Sara
Sara
JulieLiz
![Page 16: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/16.jpg)
Example author networks
Paper 1: Liz, Julie, Sara
Sara
JulieLiz
2 Degrees
![Page 17: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/17.jpg)
Example citation network
Paper 1: Liz, Julie, SaraCites: Liam & Luka
Sara
JulieLiz
Liam
Luka
![Page 18: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/18.jpg)
Citation network
LAK conferenceJournals
![Page 19: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/19.jpg)
Citation networks
• Citation network moderate level of clustering– Consistent across LAK proceedings– Few strong connections? – Degrees low – indication of diverse and
inconsistent literature sources– Degrees (increasing) from LAK11 to 13
![Page 20: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/20.jpg)
Author networks (LAK)
![Page 21: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/21.jpg)
Author networks (Journal)
![Page 22: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/22.jpg)
Author networks
• Author networks – small cliques with few highly connected nodes
• For an interdisciplinary field still largely disciplinary clustered
![Page 23: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/23.jpg)
Paper classification
• Schema from Info Systems (6 categories)
1. Evaluation research – (e.g. case study empirical)
2. Validation research – (e.g. testing theory/ method/ solution empirical)
Glass, R.L., et.al, 2002. Research in software engineering: an analysis of the literature. Information and Software Technology 44, 8, 491-506
![Page 24: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/24.jpg)
Paper classification
3. Solution proposal (solution/ technique to address an issue)
4. Conceptual proposal (e.g. frameworks)
5. Opinion(well its my opinion/argument)
6. Experience (Let me tell you a story)
7. Panel/workshop
![Page 25: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/25.jpg)
Author Background
Extensive search – if home dept not listed in author details
![Page 26: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/26.jpg)
Paper classification (LAK)
• Dominated by evaluations of research (journals)
• Proposal of solution dominates conference
![Page 27: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/27.jpg)
Paper classification (Journal)
• Dominated by evaluations of research (journals)
• Proposal of solution dominates conference
![Page 28: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/28.jpg)
Paper classification
• Dominated by computer science (LAK)• Greater number of education researchers in
journals– Reflection of special issues– Reflection of priority sites for publications
• Largely conceptual and opinion publications
![Page 29: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/29.jpg)
Methods classification
• Qualitative• Quantitative• Mixed methods• Other
![Page 30: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/30.jpg)
Methods classification (LAK)
• Other dominates – reflects high number of opinion and conceptual papers
![Page 31: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/31.jpg)
Methods classification (Journals)
![Page 32: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/32.jpg)
Methods classification
• Other dominates – reflects high number of opinion, experience and conceptual papers
![Page 33: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/33.jpg)
Conclusions
• The field is in its infancy– Citations still predominately opinion and
definitional pieces– Clustering and degrees– Few number of empirical studies cited but this is
growing• Mature fields greater examples of validation
research and importantly critiques of studies
![Page 34: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/34.jpg)
Conclusions
• Computer scientists dominate LAK proceedings– Need to look at how other voices are heard
• Education research dominates Journals– Reflection of broader priorities?
![Page 35: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/35.jpg)
Conclusions
• Early work need to extend• Structural mapping and citation analyses more
common and more sophisticated.• Raise awareness
– Inform practice– Build connections– Foster further empirical work
![Page 36: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/36.jpg)
Conclusions
• Understanding our field we can better advance our field.
• Question: To what extent can we use these analyses to architect the development of the field?
![Page 37: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/37.jpg)
Questions
• Next steps:–Broader scope (extend network
analyses)–Keyword clustering–Citation location–Incorporate multiple citations/ paper
![Page 38: Current State and Future Trends:A citation network analysis of the Learning Analytics Field](https://reader035.vdocuments.site/reader035/viewer/2022070322/559289a21a28abc40d8b4610/html5/thumbnails/38.jpg)
Questions
• To what extent can we use these analyses to architect the development of the field?
• [email protected]• [email protected]• [email protected]• [email protected]