ncp academy workshop “quality standards and good …€¦ · ncp academy workshop “quality...
TRANSCRIPT
23 June 2016, Naďa Koníčková, Daniel Frank
NCP Academy workshop “Quality standards and good practice”
Czech NCP system
2
Technology Centre ASCR
• Leading national institution for preparation of strategic information for STI, and for facilitating knowledge transfer and international STI cooperation, national information centre for EU research – NCP services, coordinator of EEN in CR
• Established in 1995, currently 75 staff
Business development - Czech EEN coordinator
National Information Centre for European Research
Strategic Studies
Czech Liaison Office for R&D&I
(CZELO) Brussels
NCP services
• Information, training, consultation services
• Workshops, specialised trainings, information days
• Czech Days for European Research
• Individual consulting and personal assistance in all phases of H2020 project lifecycle
• Publication activities
• Electronic information services, web portals
• Monitoring and analyses of Czech participation in H2020 (FP7), development of monitoring indicators and methodology
• Support to the state administration with regard to ERA
• Work in expert groups (ERAC, EVALNET….)
• Collaboration with European NCPs
NCP activities are funded by the national project CZERA (Ministry of Education, Youth and Sports)
3
NINET - Czech National Information Network for Framework Programmes EU
The NCP services are centralised in the TC CAS. Moreover information Network for Framework Programmes NINET is established in the CR, which associates regional and thematic contact points providing information and consulting services for participation in ERA. Network (each member implements own project) is supported financially by the Ministry of Education (MEYS) through the EUPRO II programme.
How we evaluate NCP services?
1) We measure level of satisfaction with NCP services
a) feedback forms (workshops, trainings): 2016 – 94,5 % of participants considered the event useful for their work b) survey of clients 2) Internal evaluation of individual NCP activity and results (2 x year) - activity report, interview, bonuses for good work 3) External evaluation of NCP activities/system – yearly evaluation of the national NCP project (overall results, goals, indicators) – 2 independent evaluators, report is submitted to the funder - MEYS
Feedback from clients – on line Survey (2014)
Use of services (multiple answers possible)
• 32% - information days
• 69% - specific workshops and trainings (proposal writing, IPR,
financial and administrative management of projects…)
• 67% - individual consultations
• 19% - workshops on request of research organisations
• 11% - statistics/analyses
• 10% - other
6
Feedback from clients – on line Survey
Usefulness of information and services for the client´s work
• 88% - yes
• 2% - no
• 10% - partly
Overall quality of NCP services
• 58% 1 - excellent
• 36% 2 – very good
• 6% 3 - good
• 0% 4 - satisfactory
• 0% 5 - poor
7
ISTEC - Information system of TC CAS
Internal information system ISTEC (Information system of Technology Centre CAS, from 2011)
Information system consists of:
a) Internal operating agenda – Staff Attendance, Internal Booking System – company cars, conference rooms etc., Requests for holiday, business trip, purchase, Reports, e-Library………
b) Contacts – Evidence of contact and cooperating organizations and persons
c) Activities and actions of the Technology Centre CAS
ISTEC - Activities and actions of TC CAS
Types of NCP Activities: a) Consultations
b) Personal meetings (Appointments)
c) Assistance during the preparation or implementation of a
project
d) Cooperation with the state administration
e) Attendance at meetings of the Programme Committees
f) Attendance at NCP meetings
Form of activities: meeting, e-mail, phone call
ISTEC - Activities and actions of TC CAS
Type NCP Actions and Events: a) National Actions – co(organizer) – InfoDays, Workshops….
b) Transnational Actions - co(organizer)
c) Seminars/trainings on demand of stakeholders/clients
d) Passive participations at events (to increase own
competences)
e) Requested presentations, lectures
f) Collaboration with state administration
Role of TC: organizer, (co)organizer, participant
ISTEC - Activities and events Technology Centre CAS
Export to html, xls, csv, basic statistical overview
ISTEC - Activities and events Technology Centre CAS
Export to html, xls, csv, basic statistical overview
ISTEC – search and filter
ISTEC - outputs
Datum od Datum do Název akce Typ akce Role TC Projekt Osoba za TC Město
30.6.2016 10:00 30.6.2016 15:00 Finanční seminář NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Lojková Milena; Horniecká Marie Praha
21.6.2016 0:00 22.6.2016 0:00 Konsorciální smlouvy v projektech H2020 NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Kratěnová Jana; Lojková Milena; Kotouček Jiří Praha
15.6.2016 0:00 16.6.2016 0:00
Nástroje H2020 pro firmy, jak napsat
přesvědčivý podnikatelský plán - Modul 4 NICER - národní akce (spolu)pořadatel Pořadatel Vlková Michaela Praha 6
14.6.2016 0:00 15.6.2016 0:00
Jak uspět při přípravě individuálních projektů
Marie Skłodowska-Curie ? - MODUL 5 NICER - národní akce (spolu)pořadatel Pořadatel Perutková Petra Praha 6
10.6.2016 10:00 10.6.2016 16:00
Jak připravit výzkumný projekt pro H2020 -
Modul 1 NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Koníčková Naďa; Hillerová Eva; Čejková Jana Praha 6
10.6.2016 0:00 11.6.2016 0:00
Projektový návrh: příprava rozpočtu - Modul
2 NICER - národní akce (spolu)pořadatel Pořadatel Lojková Milena Praha 6
10.6.2016 0:00 11.6.2016 0:00
Duševní vlastnictví (IP), Open Access (OA),
smlouvy - Modul 3 NICER - národní akce (spolu)pořadatel Pořadatel
Kratěnová Jana; Kotouček Jiří ; Ondračková
Petra Praha 6
18.5.2016 10:30 7.6.2016 12:34
Seminář pro Věda se společností a pro
společnost NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Pacvoň Michal Brno
12.5.2016 13:00 12.5.2016 16:00
seminář Možnosti financování projektů
ENERGY s doporučeními pro psaní projektů NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2
Kudrnová Eva; Hillerová Eva; Korittová
Veronika Praha
10.5.2016 10:00 10.5.2016 13:00
Informační den Věda se společností a pro
společnost NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Pacvoň Michal; Sebroňová Eva Praha 6
3.5.2016 9:00 3.5.2016 14:00
Joint Undertaking Bio-based Industries Calls
2016 NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Koníčková Naďa; Čejková Jana; Pracna Petr Praha 6
ISTEC – limitations, constantly changing conditions and situations
1) character of monitored indicators, the type and nature of events, actions, workshops and seminars varies and changes over the time (according to the requirements of national funding sources of NCP system), it is not possible to work with data and interpret them only mechanically
2) the type, nature and structure of the registered events and indicators change also with the development of other sources of information and is also closely connected with the publication of the work programmes and calls……… For example the number of consultations may decrease due to the development of a new information websites, electronic information alert services
3) it is often difficult to distinguish exactly what is: info day, information seminar, seminar, workshop, lecture ........ (subjective opinion plays a role)
ISTEC – limitations, constantly changing conditions and situations
4) the evidence of personal consultations with clients (on-site) is obligatory, simple telephone and e-mail answers are not registered in the information system. Therefore the collected data could be read only with discretion.
5) more consultations, information days and requests for information are generally required at the beginning of the FP
6) many activities of NCPs are useful over a longer period of time and have impact in the longer perspective
7) the quality of information sources (web, publications, articles) is very important for the quality of the NCP system
8) establish a quality assessment of NCP system only on quantitative indicators of NCP activity is controversial and problematic for many reasons and may lead to formalism
Monitoring and analysis of CR’s participation in EU Framework Programmes
NICER constantly monitors and evaluates the CR’s participation in the framework programs of the EU, prepares studies analyzing individual aspects of Czech participation in these programs and, in cooperation with the Ministry of Education, Youth and Sports, proposes measures aimed at improving the CR’s participation in the European Research Area.
Providing and dissemination of data and analysis on participation in FPs
Data are provided in accordance with Confidentiality rules for Framework Programme data to: a) Government of the Czech Republic
b) Ministries of the Czech Republic
c) Czech universities and research institutions
d) Technology Agency of the Czech Republic
e) Czech Science Foundation (GA CR)
f) Regions, cities and municipalities
g) Technology parks and technology centres
h) Private companies and the private persons
Software facilities for analysis
ESRI Software - Software Geographic Information Systems (GIS) - spatial analysis, chart maps, cartograms, situational maps IBM SPSS (Statistical Package for the Social Sciences) - statistical analysis
GEPHI
- visualization and exploration software for all kinds of graphs and networks,
network analysis
Publication Activities - Journals
ECHO is a bimonthly journal that provides information about European research and opportunities for European research cooperation. Magazine with a range of 12 to 24 pages is distributed free of charge in an edition of 1 500 pieces to all faculties of universities, institutes of the Czech Academy of Sciences, to other research organizations, to small and medium-sized enterprises, regional assemblies, to all ministries and a number of libraries.
Czech NCP regularly publish in this journal
Publication Activities - Journals
ERGO Analyses and trends in research, technologies and innovations Reviewed journal ERGO is a scientific journal focusing on analyses and trends in research, technologies and innovations. Since 2006 it is issued by the Technology Centre at least twice a year.
Publication Activities - Edition Vademecum of the H2020
Information brochures for professionals and the general public regarding H2020
• HORIZON 2020, briefly about program
• Intellectual property in Horizon 2020 projects • Ethics in Horizon 2020 • Financial Rules in H2020 • The Marie Sklodowska-Curie Actions in Horizon
2020
Others Publications – Books, Studies, Articles
TC CAS organizes every year conference of Czech Days for European Research (CZEDER) and publishes an extensive report on the participation of the Czech Republic in FPs. Final evaluation of FP7 Bibliometric and citation analysis (according WoS) is carried out at present. The main finding of this analysis is that the citation rate of publications that are associated with the FPs is much higher than citation of other publications.
Czech NCP for ERC: Bibliometric analysis of successful applicants for ERC Starting Grants in 2012 - To what extent bibliometric indicators affecting the success of candidates for ERC grants?
NCP systems and participation and success rate – topics for discussion
• the relationship between the quality of the national NCP system and the participation and success rate of the given country in the FPs is very difficult to prove and analyse.
• the correlation between quality of NCP system and participation and success in FPs is not clear and can be very weak
The success rate and participation in the FPs is not only a question of performance of NCP system, but rather a question of the actual approach of the scientific community and politicians to the Framework Programmes.
• other factors affect the success rate in the Framework Programmes more: effective national evaluation and finance system for research, development and innovation, research potential and tradition in a concrete research area, research potential and capacity of research institutes….
FP7 MIRRIS - Mobilising Institutional Reforms in Research and Innovation Systems
source of data: http://www.mirris.eu
The MIRRIS aims at encouraging a better exploitation of European research and innovation programmes and participation in the European Research Area of the 13 target countries by setting up a process of analysis, dialogue, mutual learning among key concerned stakeholders, namely research, innovation and institutional actors
FP7: EU 13 & EU 15
Whatever criteria taken into consideration*, EU12 (and Croatia) Member States are less performing than
EU15 &
huge disparities between EU12 (and Croatia) Member States
* success rate, participants per million inhabitants, FP7 Euro captured
per capita – per researcher, public R&D expenditures as % of GDP etc.
FP7 MIRRIS – Some key findings
source of data: http://www.mirris.eu
Low Economic reward/wages/incentives of researchers;
Lack of attractiveness of FP7 funding in comparison to ERDF funding and/or, when available, to other national or bilateral schemes(less bureaucracy, less selection criteria, no or less international dimension);
No willingness in taking responsibility of administrative management (lack of time, little or no access to a project office support), project leadership.
PERSONAL/MOTIVATIONAL
FP7 Mirris – Some key findings
source of data: http://www.mirris.eu
Weak involvement in European networks which very often play a role in generating ideas for projects and facilitating partnerships; researchers;
Difficulty to join (and remain) existing EU15 excellence consortia;
Lack of “systemic” support to applicants, Weak capacity of drafting proposals;
ORGANIZATIONAL/STRUCTURAL
Brain drain (less excellent researchers in EU13 than in EU15) and weak presence of foreign researchers (key to mobilise partnerships)
How to increase participation and success rate of Czech research teams in FPs?
New effective evolution and financing system for research, development and innovation: a) Czech research institution must be evaluated and supported from public
funds according to their results in international research
b) New system must be based on an evaluation of the scientific work and research by foreign experts
c) It is necessary to increase motivation of researchers to participate in international research
d) It is important to support R&D&I excellence
e) It is necessary to motivate young people to work in R&D&I
f) It is important to raise the prestige of work in science
Our websites
http://www.tc.cz/en/offers/national-information-centre-for-european-research
www.h2020.cz
Thank you for your attention !