ncp academy workshop “quality standards and good …€¦ · ncp academy workshop “quality...

30
23 June 2016, Naďa Koníčková, Daniel Frank NCP Academy workshop “Quality standards and good practice” Czech NCP system

Upload: tranthuan

Post on 20-May-2018

219 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

23 June 2016, Naďa Koníčková, Daniel Frank

NCP Academy workshop “Quality standards and good practice”

Czech NCP system

Page 2: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

2

Technology Centre ASCR

• Leading national institution for preparation of strategic information for STI, and for facilitating knowledge transfer and international STI cooperation, national information centre for EU research – NCP services, coordinator of EEN in CR

• Established in 1995, currently 75 staff

Business development - Czech EEN coordinator

National Information Centre for European Research

Strategic Studies

Czech Liaison Office for R&D&I

(CZELO) Brussels

Page 3: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

NCP services

• Information, training, consultation services

• Workshops, specialised trainings, information days

• Czech Days for European Research

• Individual consulting and personal assistance in all phases of H2020 project lifecycle

• Publication activities

• Electronic information services, web portals

• Monitoring and analyses of Czech participation in H2020 (FP7), development of monitoring indicators and methodology

• Support to the state administration with regard to ERA

• Work in expert groups (ERAC, EVALNET….)

• Collaboration with European NCPs

NCP activities are funded by the national project CZERA (Ministry of Education, Youth and Sports)

3

Page 4: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

NINET - Czech National Information Network for Framework Programmes EU

The NCP services are centralised in the TC CAS. Moreover information Network for Framework Programmes NINET is established in the CR, which associates regional and thematic contact points providing information and consulting services for participation in ERA. Network (each member implements own project) is supported financially by the Ministry of Education (MEYS) through the EUPRO II programme.

Page 5: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

How we evaluate NCP services?

1) We measure level of satisfaction with NCP services

a) feedback forms (workshops, trainings): 2016 – 94,5 % of participants considered the event useful for their work b) survey of clients 2) Internal evaluation of individual NCP activity and results (2 x year) - activity report, interview, bonuses for good work 3) External evaluation of NCP activities/system – yearly evaluation of the national NCP project (overall results, goals, indicators) – 2 independent evaluators, report is submitted to the funder - MEYS

Page 6: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Feedback from clients – on line Survey (2014)

Use of services (multiple answers possible)

• 32% - information days

• 69% - specific workshops and trainings (proposal writing, IPR,

financial and administrative management of projects…)

• 67% - individual consultations

• 19% - workshops on request of research organisations

• 11% - statistics/analyses

• 10% - other

6

Page 7: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Feedback from clients – on line Survey

Usefulness of information and services for the client´s work

• 88% - yes

• 2% - no

• 10% - partly

Overall quality of NCP services

• 58% 1 - excellent

• 36% 2 – very good

• 6% 3 - good

• 0% 4 - satisfactory

• 0% 5 - poor

7

Page 8: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC - Information system of TC CAS

Internal information system ISTEC (Information system of Technology Centre CAS, from 2011)

Information system consists of:

a) Internal operating agenda – Staff Attendance, Internal Booking System – company cars, conference rooms etc., Requests for holiday, business trip, purchase, Reports, e-Library………

b) Contacts – Evidence of contact and cooperating organizations and persons

c) Activities and actions of the Technology Centre CAS

Page 9: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC - Activities and actions of TC CAS

Types of NCP Activities: a) Consultations

b) Personal meetings (Appointments)

c) Assistance during the preparation or implementation of a

project

d) Cooperation with the state administration

e) Attendance at meetings of the Programme Committees

f) Attendance at NCP meetings

Form of activities: meeting, e-mail, phone call

Page 10: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC - Activities and actions of TC CAS

Type NCP Actions and Events: a) National Actions – co(organizer) – InfoDays, Workshops….

b) Transnational Actions - co(organizer)

c) Seminars/trainings on demand of stakeholders/clients

d) Passive participations at events (to increase own

competences)

e) Requested presentations, lectures

f) Collaboration with state administration

Role of TC: organizer, (co)organizer, participant

Page 11: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC - Activities and events Technology Centre CAS

Export to html, xls, csv, basic statistical overview

Page 12: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC - Activities and events Technology Centre CAS

Export to html, xls, csv, basic statistical overview

Page 13: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC – search and filter

Page 14: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC - outputs

Datum od Datum do Název akce Typ akce Role TC Projekt Osoba za TC Město

30.6.2016 10:00 30.6.2016 15:00 Finanční seminář NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Lojková Milena; Horniecká Marie Praha

21.6.2016 0:00 22.6.2016 0:00 Konsorciální smlouvy v projektech H2020 NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Kratěnová Jana; Lojková Milena; Kotouček Jiří Praha

15.6.2016 0:00 16.6.2016 0:00

Nástroje H2020 pro firmy, jak napsat

přesvědčivý podnikatelský plán - Modul 4 NICER - národní akce (spolu)pořadatel Pořadatel Vlková Michaela Praha 6

14.6.2016 0:00 15.6.2016 0:00

Jak uspět při přípravě individuálních projektů

Marie Skłodowska-Curie ? - MODUL 5 NICER - národní akce (spolu)pořadatel Pořadatel Perutková Petra Praha 6

10.6.2016 10:00 10.6.2016 16:00

Jak připravit výzkumný projekt pro H2020 -

Modul 1 NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Koníčková Naďa; Hillerová Eva; Čejková Jana Praha 6

10.6.2016 0:00 11.6.2016 0:00

Projektový návrh: příprava rozpočtu - Modul

2 NICER - národní akce (spolu)pořadatel Pořadatel Lojková Milena Praha 6

10.6.2016 0:00 11.6.2016 0:00

Duševní vlastnictví (IP), Open Access (OA),

smlouvy - Modul 3 NICER - národní akce (spolu)pořadatel Pořadatel

Kratěnová Jana; Kotouček Jiří ; Ondračková

Petra Praha 6

18.5.2016 10:30 7.6.2016 12:34

Seminář pro Věda se společností a pro

společnost NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Pacvoň Michal Brno

12.5.2016 13:00 12.5.2016 16:00

seminář Možnosti financování projektů

ENERGY s doporučeními pro psaní projektů NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2

Kudrnová Eva; Hillerová Eva; Korittová

Veronika Praha

10.5.2016 10:00 10.5.2016 13:00

Informační den Věda se společností a pro

společnost NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Pacvoň Michal; Sebroňová Eva Praha 6

3.5.2016 9:00 3.5.2016 14:00

Joint Undertaking Bio-based Industries Calls

2016 NICER - národní akce (spolu)pořadatel Pořadatel CZERA 2 Koníčková Naďa; Čejková Jana; Pracna Petr Praha 6

Page 15: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC – limitations, constantly changing conditions and situations

1) character of monitored indicators, the type and nature of events, actions, workshops and seminars varies and changes over the time (according to the requirements of national funding sources of NCP system), it is not possible to work with data and interpret them only mechanically

2) the type, nature and structure of the registered events and indicators change also with the development of other sources of information and is also closely connected with the publication of the work programmes and calls……… For example the number of consultations may decrease due to the development of a new information websites, electronic information alert services

3) it is often difficult to distinguish exactly what is: info day, information seminar, seminar, workshop, lecture ........ (subjective opinion plays a role)

Page 16: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

ISTEC – limitations, constantly changing conditions and situations

4) the evidence of personal consultations with clients (on-site) is obligatory, simple telephone and e-mail answers are not registered in the information system. Therefore the collected data could be read only with discretion.

5) more consultations, information days and requests for information are generally required at the beginning of the FP

6) many activities of NCPs are useful over a longer period of time and have impact in the longer perspective

7) the quality of information sources (web, publications, articles) is very important for the quality of the NCP system

8) establish a quality assessment of NCP system only on quantitative indicators of NCP activity is controversial and problematic for many reasons and may lead to formalism

Page 17: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Monitoring and analysis of CR’s participation in EU Framework Programmes

NICER constantly monitors and evaluates the CR’s participation in the framework programs of the EU, prepares studies analyzing individual aspects of Czech participation in these programs and, in cooperation with the Ministry of Education, Youth and Sports, proposes measures aimed at improving the CR’s participation in the European Research Area.

Page 18: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Providing and dissemination of data and analysis on participation in FPs

Data are provided in accordance with Confidentiality rules for Framework Programme data to: a) Government of the Czech Republic

b) Ministries of the Czech Republic

c) Czech universities and research institutions

d) Technology Agency of the Czech Republic

e) Czech Science Foundation (GA CR)

f) Regions, cities and municipalities

g) Technology parks and technology centres

h) Private companies and the private persons

Page 19: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Software facilities for analysis

ESRI Software - Software Geographic Information Systems (GIS) - spatial analysis, chart maps, cartograms, situational maps IBM SPSS (Statistical Package for the Social Sciences) - statistical analysis

GEPHI

- visualization and exploration software for all kinds of graphs and networks,

network analysis

Page 20: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Publication Activities - Journals

ECHO is a bimonthly journal that provides information about European research and opportunities for European research cooperation. Magazine with a range of 12 to 24 pages is distributed free of charge in an edition of 1 500 pieces to all faculties of universities, institutes of the Czech Academy of Sciences, to other research organizations, to small and medium-sized enterprises, regional assemblies, to all ministries and a number of libraries.

Czech NCP regularly publish in this journal

Page 21: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Publication Activities - Journals

ERGO Analyses and trends in research, technologies and innovations Reviewed journal ERGO is a scientific journal focusing on analyses and trends in research, technologies and innovations. Since 2006 it is issued by the Technology Centre at least twice a year.

Page 22: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Publication Activities - Edition Vademecum of the H2020

Information brochures for professionals and the general public regarding H2020

• HORIZON 2020, briefly about program

• Intellectual property in Horizon 2020 projects • Ethics in Horizon 2020 • Financial Rules in H2020 • The Marie Sklodowska-Curie Actions in Horizon

2020

Page 23: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Others Publications – Books, Studies, Articles

TC CAS organizes every year conference of Czech Days for European Research (CZEDER) and publishes an extensive report on the participation of the Czech Republic in FPs. Final evaluation of FP7 Bibliometric and citation analysis (according WoS) is carried out at present. The main finding of this analysis is that the citation rate of publications that are associated with the FPs is much higher than citation of other publications.

Czech NCP for ERC: Bibliometric analysis of successful applicants for ERC Starting Grants in 2012 - To what extent bibliometric indicators affecting the success of candidates for ERC grants?

Page 24: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

NCP systems and participation and success rate – topics for discussion

• the relationship between the quality of the national NCP system and the participation and success rate of the given country in the FPs is very difficult to prove and analyse.

• the correlation between quality of NCP system and participation and success in FPs is not clear and can be very weak

The success rate and participation in the FPs is not only a question of performance of NCP system, but rather a question of the actual approach of the scientific community and politicians to the Framework Programmes.

• other factors affect the success rate in the Framework Programmes more: effective national evaluation and finance system for research, development and innovation, research potential and tradition in a concrete research area, research potential and capacity of research institutes….

Page 25: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

FP7 MIRRIS - Mobilising Institutional Reforms in Research and Innovation Systems

source of data: http://www.mirris.eu

The MIRRIS aims at encouraging a better exploitation of European research and innovation programmes and participation in the European Research Area of the 13 target countries by setting up a process of analysis, dialogue, mutual learning among key concerned stakeholders, namely research, innovation and institutional actors

FP7: EU 13 & EU 15

Whatever criteria taken into consideration*, EU12 (and Croatia) Member States are less performing than

EU15 &

huge disparities between EU12 (and Croatia) Member States

* success rate, participants per million inhabitants, FP7 Euro captured

per capita – per researcher, public R&D expenditures as % of GDP etc.

Page 26: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

FP7 MIRRIS – Some key findings

source of data: http://www.mirris.eu

Low Economic reward/wages/incentives of researchers;

Lack of attractiveness of FP7 funding in comparison to ERDF funding and/or, when available, to other national or bilateral schemes(less bureaucracy, less selection criteria, no or less international dimension);

No willingness in taking responsibility of administrative management (lack of time, little or no access to a project office support), project leadership.

PERSONAL/MOTIVATIONAL

Page 27: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

FP7 Mirris – Some key findings

source of data: http://www.mirris.eu

Weak involvement in European networks which very often play a role in generating ideas for projects and facilitating partnerships; researchers;

Difficulty to join (and remain) existing EU15 excellence consortia;

Lack of “systemic” support to applicants, Weak capacity of drafting proposals;

ORGANIZATIONAL/STRUCTURAL

Brain drain (less excellent researchers in EU13 than in EU15) and weak presence of foreign researchers (key to mobilise partnerships)

Page 28: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

How to increase participation and success rate of Czech research teams in FPs?

New effective evolution and financing system for research, development and innovation: a) Czech research institution must be evaluated and supported from public

funds according to their results in international research

b) New system must be based on an evaluation of the scientific work and research by foreign experts

c) It is necessary to increase motivation of researchers to participate in international research

d) It is important to support R&D&I excellence

e) It is necessary to motivate young people to work in R&D&I

f) It is important to raise the prestige of work in science

Page 29: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Our websites

http://www.tc.cz/en/offers/national-information-centre-for-european-research

www.h2020.cz

Page 30: NCP Academy workshop “Quality standards and good …€¦ · NCP Academy workshop “Quality standards and good practice ... establish a quality assessment of NCP system only on

Thank you for your attention !