from econometrics to bibliometrics
TRANSCRIPT
![Page 1: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/1.jpg)
From econometrics to bibliometrics
Ludo WaltmanCentre for Science and Technology Studies, Leiden University
Econometrics and BeyondRotterdamMay 27, 2016
![Page 2: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/2.jpg)
2
About myself
• 2003: BSc in Informatics & Economics• 2005: MSc in Economics & Informatics• 2005–2009: PhD student at Econometric Institute
• 2009–2016: Researcher at CWTS
![Page 3: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/3.jpg)
3
About CWTS
• Centre for Science and Technology Studies (CWTS)
• Research center at Leiden University focusing on science and technology studies
• Strong emphasis on bibliometric and scientometric research
• About 30 staff members• 25th anniversary in 2015
![Page 4: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/4.jpg)
4
Current activities
• Leading the Advanced Bibliometric Methods research program at CWTS– Indicators– Network analysis– Text mining– Visualization
• Bibliometric consultancy for CWTS BV• Coordinating the CWTS Leiden Ranking• Deputy director CWTS• Editor-in-Chief Journal of Informetrics
![Page 5: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/5.jpg)
5
CWTS Leiden Ranking
![Page 6: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/6.jpg)
6
From econo-metrics to bibliometrics
![Page 7: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/7.jpg)
7
From econometrics to bibliometrics: Two examples• Visualization of network data• Indicator design
![Page 8: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/8.jpg)
8
Visualization of network data
![Page 9: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/9.jpg)
9
2006: 50 Years of Econometrics
![Page 10: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/10.jpg)
10
2006: Multidimensional scaling vs. visualization of similarities (VOS)
![Page 11: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/11.jpg)
11
2007: Concept map viewer
![Page 12: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/12.jpg)
12
2009: VOSviewer 0.9.0
![Page 13: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/13.jpg)
13
2016: VOSviewer 1.6.4
![Page 14: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/14.jpg)
14
Co-authorship network based on EUR economics and business publications
![Page 15: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/15.jpg)
15
Publications using VOSviewer
Visualizations of bibliometric networks nowadays are produced mostly using the VOSviewer software and the VOS technique; MDS is hardly used anymore
![Page 16: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/16.jpg)
16
Indicator design
![Page 17: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/17.jpg)
17
Bibliometric indicators
• Bibliometric indicators:– Scientific activity– Scientific impact– Collaboration– Interdisciplinarity– Etc.
• Bibliometric indicators tend to be justified based on ad hoc arguments rather than rigorous systematic reasoning
![Page 18: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/18.jpg)
18
CWTS ‘crown indicator’
• For each publication i of a research group, we know the actual number of citations ci and the ‘expected’ number of citations ei
• On average, how often have the publications of a research group been cited relative to expectation?
crown indicator
![Page 19: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/19.jpg)
19
Consistency
• Suppose group A and B have the same number of publications
• According to some indicator, group A is performing better than B
• Suppose group A and B jointly produce a new publication
• Then, if our indicator is consistent, group A should still be performing better than B
![Page 20: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/20.jpg)
20
Inconsistency of crown indicator
• Crown indicator group A: 25 / 10 = 2.50• Crown indicator group B: 10 / 5 = 2.00• Group A and B co-author a new publication• Crown indicator group A: 65 / 20 = 3.25• Crown indicator group B: 50 / 15 = 3.33• Ranking of group A and B has reversed
Pub. 1 Group A 25 10Pub. 2 Group B 10 5Pub. 3 Group A and B 40 10
Pub. 1 Group A 25 10Pub. 2 Group B 10 5
![Page 21: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/21.jpg)
21
Solving crown indicator inconsistency by changing order of operations• Inconsistent crown indicator:
• Consistent crown indicator:
𝑐1+⋯+𝑐𝑛𝑒1+⋯+𝑒𝑛
1𝑛 (𝑐1𝑒1+⋯+
𝑐𝑛𝑒𝑛 )
![Page 22: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/22.jpg)
22
Adoption in major analytical tools
![Page 23: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/23.jpg)
23
h-index
A scientist has index h if h of his papers have at least h citations each and the other papers have
at most h citations each
![Page 24: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/24.jpg)
24
Consistency requirement
If two scientists achieve the same performance improvement, their ranking relative to each other
should remain unchanged
![Page 25: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/25.jpg)
25
Inconsistency of the h-index
![Page 26: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/26.jpg)
26
From econo-metrics to bibliometrics
![Page 27: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/27.jpg)
27
From econometrics to bibliometrics: Conclusions• Bibliometrics is a quantitative field of science, but
level of sophistication of quantitative analyses is much lower than in econometrics
• Background from Econometric Institute has been very helpful to increase level of sophistication of bibliometric research
• Illustrates the need to move toward an integrated data science field, combining methods from econometrics, statistics, operations research, computer science, network science, etc.
![Page 28: From econometrics to bibliometrics](https://reader036.vdocuments.site/reader036/viewer/2022062306/587eddf31a28abdb198b7dc9/html5/thumbnails/28.jpg)
28
Congratulations to theEconometric Institute!
Thank you for your attention