paper 3: chinese university's evaluation (qiu & wang)
TRANSCRIPT
Qiu Jun-pingResearch Center for Chinese Science Evaluation
E-mail: [email protected] http://www.nseac.com Tel: 86-27-68754477
An Overview on the Methods and Results of Chinese Universities Evaluation
23/4/12 RCCSE 2
RCCSE
• Research Center for Chinese Science Evaluation of Wuhan University (RCCSE) is a comprehensive evaluation agency embracing education evaluation, science and technology evaluation, etc.
• Based on the broad investigation and deep analysis, four kinds of evaluation reports have been released since 2004.
23/4/12 RCCSE 3
• ①An Evaluation Report on Subjective Competitiveness of World-Class Universities and Research Institutions
23/4/12 RCCSE 7
• Now please allow me to give a brief
introduction of the reports.
• I am glad to share the methods and results of
Chinese universities’ evaluation released by
RCCSE, based on the “Chinese Universities
Ranking in 2010”.
23/4/12 RCCSE 8
contents
Purposes and Significance 1
Evaluation Subjects2
Data Sources
4
Results Analysis5
Methods and Index System3
23/4/12 RCCSE 9
1. Purposes and Significance
Providing guide for the students to
choose the suitable university.
Providing opportunity for the public
to gain information of universities.
23/4/12 RCCSE 10
1. Purposes and Significance
Providing reference for the universities
to develop with orderly competition.
Providing support for the government to
make a strategic and scientific decision.
23/4/12 RCCSE 11
2. Evaluation Subject
• Undergraduate-level universities that
licensed by the Education Ministry
• Each year the Education Ministry issues
the latest “Chinese Universities List”.
• The universities in our evaluation are in
accordance with this official list.
23/4/12 RCCSE 12
2. Evaluation Subject
• All universities in our evaluation are
divided into three kinds:
key university
average university
private college
23/4/12 RCCSE 13
Key University
• Key universities consist of three parts:
The original key universities in the
“Statistical Document of 2003” issued by
the Education Ministry;
The ministry-run universities;
Members of the "211 project" and "985
project”.
23/4/12 RCCSE 14
3.1 Methods
QuestionnaireIn 2004 RCCSE and China Youth Daily jointly
conduct a nationwide survey covering 2000
people, including the leaders of educational
authorities, presidents and teachers of
universities, senior high school students and
their parents, experts and scholars in
evaluation field, etc.
23/4/12 RCCSE 15
3.1 Methods
AHP(Analysis Hierarchy Process)
Based on the results of the survey
above, we obtained the evaluation
indicators and weights by the way of
AHP.
23/4/12 RCCSE 16
3.1 Methods
Experts Discussion
Then we invited some leading experts
and scholars to have a full discussion on
these indicators and weights. Finally we
obtained the index systems of Chinese
Universities Evaluation.
23/4/12 RCCSE 17
3.1 Methods
Evaluation Information Management System
We import the original data into “Chinese Universities
Evaluation Information Management System” which
can automatically realize the functions of computing,
statistics and sort.
The system, which was designed and developed by
RCCSE independently, can undertake most of data
processing work and give us the final evaluation
scores and rankings automatically.
23/4/12 RCCSE 18
3.2 Index System
• Comprehensive competitiveness of a key university represents its overall appearance integrated by quantity, quality, level and impact.
• We evaluate them from different aspects: resources, teaching, R&D and reputation.
• This index system has 4 first-grade indicators, 13 second-grade indicators and 50 third-grade indicators.
23/4/12 RCCSE 22
• Academic reputation is derived from the survey covering thousands of experts and scholars in the relevant fields.
• Web influence is measured by web output, links,etc. Original data is from Google Scholar and Yahoo!, etc.
23/4/12 RCCSE 23
4. Data Sources
• We spend a lot of time, funds and
manpower on original data collection.
• After several years’ exploration, we have
established relatively stable and reliable
data access channels.
• Most original data comes from the
following 4 channels:
23/4/12 RCCSE 24
Data Sources
① Official documents, including statistical reports,
yearbooks and government documents;
② Domestic and foreign databases, including
SCI, SSCI, EI, CSSCI, etc;
③ Websites of universities and governments;
④ Relevant publications, including books,
newspapers and journals.
23/4/12 RCCSE 25
5.Results Analysis
• Our evaluation in 2010 contains 980
universities in Chinese mainland
(excluding military universities), including
119 key universities, 599 average
universities and 262 private colleges.
23/4/12 RCCSE 26
5.Results Analysis
• We evaluate these 980 universities from 10 aspects and obtain 201 rankings (specific rankings are listed in the book of “Chinese Universities and Subjects Evaluation Report in 2010”, Science Press, 2010.3).
• Here we only show the “Regions Competitiveness Ranking of Chinese Higher Education” and “ Chinese Top-grade Universities Competitiveness Ranking”.
23/4/12 RCCSE 30
5.2 Chinese Top-grade Universities’ Competitiveness Ranking
• “Chinese Top-grade Universities” are those
who have first-class scholars, first-class
subjects, first-class achievements, first-
class efficiency, first-class management.
• We select the top one percent universities
as the Top-grade universities in China, that
is, a total of about 20 universities.
23/4/12 RCCSE 33
5.3 Conclusions
The distribution of universities is
disequilibrium in different regions.
Most universities, especially those key
universities, centralize in the central
and eastern part of China, such as
Beijing, Shanghai, Nanjing, Wuhan etc.
23/4/12 RCCSE 34
5.3 Conclusions
The education competitiveness is equal
with the economic strength of the region.
For example, some rich regions, such as Beijing,
Shanghai and Jiangsu, are listed at the top of
“Regions Education Competitiveness Ranking”.
Conversely poor regions also have poor
education competitiveness, such as Tibet,
Ningxia, Qinghai and so on.
23/4/12 RCCSE 35
5.3 Conclusions
The ranking of key universities is stable
while the ranking of average universities is
fluctuated dramatically.
For example, Peking University, Tsinghua
University, Zhejiang University and Fudan
University have been retaining its position as
Chinese top 4 for recent six years.
23/4/12 RCCSE 36
5.3 Conclusions
Key universities, average universities
and private colleges lie in three levels
and respectively have different
targets and emphasizes.
23/4/12 RCCSE 37
5.3 Conclusions
The main directions of Chinese universities are high quality, efficiency and internationalized level.
We deduce this enlightenment from the
Chinese universities evaluation results in
2010 and the data accumulated by RCCSE
over the years.
23/4/12 RCCSE 38
• Above all, Chinese universities, especially key universities must adhere to the directions of “high quality, efficiency and internationalized level” to promote their competitiveness and to propel the development of Chinese higher education.
High quality
Efficiency
Internationalized level