metascience: holistic approach for research modeling and analysis
TRANSCRIPT
![Page 1: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/1.jpg)
MetaScience An Holistic Approach for Research Modeling
Valerio Cosentino, Javier Cánovas & Jordi Cabot ICREA – Open University of Catalonia
@softmodeling modeling-languages.com
![Page 2: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/2.jpg)
http://pixgood.com/mr-hyde-sketch.html
ResearcherReviewer
![Page 3: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/3.jpg)
Both need to work together to have a healthy community
![Page 4: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/4.jpg)
How can we use conceptual models to help ?
![Page 5: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/5.jpg)
![Page 6: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/6.jpg)
Nurture
your Com
munity
MetaScience: Modeling Research
Communities
![Page 7: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/7.jpg)
Size doesn’t matter
![Page 8: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/8.jpg)
-Data vs Information-Non-trivial analysis: Integration of different sources-Conceptual Schema as unifying representation-Separation of data collection from data analysis-
![Page 9: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/9.jpg)
![Page 10: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/10.jpg)
Conceptual Schema
![Page 11: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/11.jpg)
DB schema
![Page 12: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/12.jpg)
DB schema
![Page 13: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/13.jpg)
Data Collection
Flick/skepticalview
![Page 14: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/14.jpg)
Conferences and papers: DBLP
Table mapping
![Page 15: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/15.jpg)
PCs and topics: web scrapping
![Page 16: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/16.jpg)
+ a variety of other (overlapping) sources & formats
![Page 17: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/17.jpg)
Community Analysis for everybody
Flickr/leg0fenris
![Page 18: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/18.jpg)
Single metrics, e.g. authors per paper
19791981
19831985
19861987
19881989
19901991
19921993
19941995
19961997
19981999
20012002
20032004
20052006
20072008
20092010
20112012
20132014
20150
0.5
1
1.5
2
2.5
3
3.5
4
ρ = 0.88
![Page 19: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/19.jpg)
Single metrics, e.g. seniority of researchers
![Page 20: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/20.jpg)
Graph-based analysis: Co-authorship graphs
Prolific authorsFrequent
collaborationsClustersBetweenness (bridge
authors)
![Page 21: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/21.jpg)
Historical / temporal view, e.g. PC Analysis
ARE PC MEMBERS ACTIVE IN THE CONFERENCE?60 out of the 99 members from 2015 did not publish in the previous 3 editions
ARE ACTIVE MEMBERS BEING IGNORED?Only 7 researchers published constantly from 2012 to 2014
3 of them were PC members in 2015, while the remaining 4 were not
![Page 22: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/22.jpg)
Newcomers
% of papers with all authors new to the main track
% of papers with all authors new to the conf
![Page 23: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/23.jpg)
NL/ Topic analysis, e.g. Top-30 keywords for last 10 edts
From paper abstracts From topics of interest
![Page 24: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/24.jpg)
http://matt.might.net/articles/phd-school-in-pictures
And there’s much more...
Collaborating with the complex systems group: rich club ordering, small-
world behaviour, inter-conf analysis…
![Page 25: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/25.jpg)
CORE analysis (shameless plug)
![Page 26: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/26.jpg)
Tool Support
Flickr/JDHancock
![Page 27: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/27.jpg)
Gitana: Integrated analysis (ER’15)
Coding platform
Issue trackers Commun. channels
Code review tools
![Page 28: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/28.jpg)
https://github.com/SOM-Research/metaScience
![Page 29: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/29.jpg)
![Page 30: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/30.jpg)
![Page 31: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/31.jpg)
Challenges
Flickr/TimPainter
![Page 32: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/32.jpg)
The CS keeps growing
![Page 33: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/33.jpg)
Data Collection limitations
![Page 34: MetaScience: Holistic Approach for Research Modeling and Analysis](https://reader036.vdocuments.site/reader036/viewer/2022081520/5870ebce1a28abcf288b6e2f/html5/thumbnails/34.jpg)
And even more challenges….
Paper classificationo Not clear distinction of paper types o Changes on the characteristics from one edition to another (e.g. number of
pages for short papers)
Committee / topics datao Conference edition web sites may be not available anymore
Partial solution: WayBack Machineo Committee data similar but there is no common “standard”
Entity resolutiono Researchers can use different names
Partial solution: DBLP provides aliaseso Researcher names may appear misspelled (mostly in committee data)