Monitoring of the SEE-ERA.NET Pilot Joint CALL (PJC) and the implementation of the Lessons learnt in the SEE-ERA.NET PLUS JOINT CALL Marion Haberfellner.

Download Monitoring of the SEE-ERA.NET Pilot Joint CALL (PJC) and the implementation of the Lessons learnt in the SEE-ERA.NET PLUS JOINT CALL Marion Haberfellner.

Post on 18-Jan-2016

212 views

Category:

Documents

0 download

TRANSCRIPT

  • Monitoring of the SEE-ERA.NET Pilot Joint CALL (PJC) and the implementation of the Lessons learnt in the SEE-ERA.NET PLUS JOINT CALL

    Marion HaberfellnerCentre for Social Innovation (ZSI), Vienna

  • Overview of Monitoring Activities:Monitoring Plan established and external monitoring expert contracted (Jan 07)

    Thematic conferences monitored: Belgrade conference attended, questionnaires analysed and presentation of results at Bucharest Rep-SEE meeting (Feb-Mai 07)

    PJC documents and data studied and preliminary analysis (Jun-Oct 07)

    PJC survey: questionnaire elaborated and finalised in cooperation with SEE-ERA.NET consortium and INTAS (Sep-Oct 07)

    Sofia quality assurance meeting, Thessaloniki Steering Board (Oct 07): discussing PJC and PJC survey

    Interim monitoring report (Nov 07) including PR monitoring, PJC monitoring and PJC survey analysis

    End monitoring report (August 2009)

  • Remarks on PJC results: country participation

    Country No teams in eligible proposals% of SEE eligible teamsSEE inhabitants in Mio% of SEE inhabitantsRatio: teams/Mio inhabitantsAlbania614,30%3,601,55%16,94Austria594,15%8,203,54%7,20Bosnia Herzegovina835,85%4,551,96%18,24Bulgaria1258,80%7,323,16%17,08Croatia14210,00%4,491,94%31,63France443,10%63,7127,49%0,69FYROM1188,31%2,050,88%57,56Germany735,14%82,0435,40%0,89Greece19213,52%10,714,62%17,93Hungary624,37%9,964,30%6,22Montenegro503,52%0,680,29%73,53Romania835,85%22,289,61%3,73Serbia22715,99%10,154,38%22,36Slovenia1017,11%2,010,87%50,25SUM1420100,00%231,75100,00%

  • Remarks on PJC results: country participationIn absolute numbers, most teams have participated from Serbia (227), Greece (192) and Croatia (142)

    Number of teams compared to number of inhabitants per SEE country: Montenegro, Slovenia and FYROM show highest participation to population ratio

    All WBC countries have a high participation rate. Due to: - PJC targeted at these countries - consortium condition: at least one WBC per application - but shows also that ALL WBC took advantage of the PJC and that there is huge interest for developing scientific cooperation in the region and with EU members

    EU member states: - Slovenia, Greece and Bulgaria show highest participation closer to region, established scientific networks - other EU member states relatively lower participation, especially the bigger countries FR, DE low budget, consider awareness raising measures for RJC in these countries

  • PJC Survey - Results: Comments on positive aspectsEstablished cooperation with colleagues in the region

    Perspective of future projects with higher budgets

    Knowledge and results sharing

  • RECOMMENDATIONS/Funding and Call Budget

    Better steering of financial resources of the call: countries should foresee reserves to prop up their share of call funding, if necessary. Such adding of financial resources would allow funding more and the most excellent projects, and prevent exhaustion of funds.

    Another alternative to avoid exhaustion of funds would be a real common pot scheme, where each country transfers its contribution to the call in a common pot. In this scheme the joint funds would be used irrespective of national origin and be distributed to the most excellent top ranking project proposals. The principle of juste retour, where each country receives the funds back that it invests in such a call, could not be guaranteed any more. But administrative procedures and project selection procedures would be much simplified.

    Increase funding per project and the call budget overall (feedback of participants)

  • RECOMMENDATIONS/Procedures

    Consider simplifications of the electronic submission for project applications (too much information requested for size of projects, duplication of requested information on the submission system)

    Consider establishing one single multilateral contract per project, to reduce administrative procedures for scientists.

    Adapt the number of different instruments to the call budget; keep the call simple and avoid offering a too broad range of instruments. Too many instruments add complexity and increase administrative cost and procedures.

  • RECOMMENDATIONS/Procedures

    Make the rules of the game sufficiently clear and avoid changing them during call implementation, project selection and contracting (virtual common pot concept, eligibility and evaluation criteria)All of this needs to be made sufficiently clear and published with the call document. Evaluation criteria should be adapted to the funding instrument. Transparency of evaluation should be increased overall.

  • Remarks on PJC results: Rules of the gameNot all important rules of the game for the PJC call were fully made clear to the applicants.

    Examples: - which entities are eligible for receiving funding - project selection: VCP procedure has not been made clear in call guidelines - Summer Schools: rule of 50% minimum participation from WBC had not been outlined in call guidelines

  • Remarks on PJC results: procedural weaknesses in the evaluationSome assessment/evaluation procedures of the PJC were not fully appropriate.

    Examples: - the same assessment (evaluation) criteria were applied for all three different instruments (RP, NP, SS) - different weights were applied for evaluation criteria - discrepancies between two evaluations: when shall a third evaluation be requested? - technical: an evaluator mixed up the evaluation sheets of two projects for SS

  • RECOMMENDATIONS/PROCEDURES:EVALUATION

    Consider establishing a scientific council (SC), composed of well renowned scientists.

    This council would support the project selection process by screening those remote evaluations for appropriateness, which show high discrepancies in scores and by checking and adjusting the ranking list of proposals selected for funding.

    Call: in relation to the size of the call in financial terms and in terms of projects to be funded. (small scale call: few colleagues, might consist of scientists not originating of countries involved in the consortium so as to keep this institution neutral)

  • RECOMMENDATIONS/PR and Awareness raising activities:Promotional conferences for a call: useful tool for consortium building and networking. Adapt the number and duration of such conferences to the size of call; (a call with a modest budget & a limited number of projects to be funded: promotional measures accordingly be limited and well targeted at countries with low participation in the pilot call)

    Take additional promotional measures for the call in those countries, where turnout of scientists was rather low, budget was not exhausted and which participation is essential for network-building for scientists from WBC (e.g. DE, FR).

  • RECOMMENDATIONS/Success rates:Better steering of the success rate: consider implementing a future call in a two step procedure. In a first step only short outline proposals of few pages, in which the scientific idea and approach is briefly described, shall be requested. These outline proposals shall be evaluated and only best ranked project consortia be invited to submit a full proposal. This procedure helps steering the success rate, reduces administrative effort on the side of scientists and avoids frustration.

    Another option for steering the success rate would be to have a more narrow topical focus of the call.

  • RECOMMENDATIONS/Success rates:In general it seems sensible to make a more profound analysis of possible topics of the call, by considering for example the scientific strengths of the WBC. Results of ongoing networking projects for the WBC region (e.g. INCO-NET WBC) should be taken into account here.

    Support of a call implementation agency (INTAS) proved essential for the pilot call and will be sensible also for the success of a larger scale joint call. Synergies with other regional ERA.NETs funded under FP7 should be considered here.

  • Remarks on PJC results: Success rateSuccess rate is rather low. Certainly it can be justified with the argument of the Pilot phase (testing for interest in such an activity); to a lesser extent with the limited effort for preparing a proposal.

    For the Real Joint Call the expectations will be a bit different. Target a better success rate, e.g. by calling for still more focussed topics, by limiting the number of different instruments, etc.

    Team success rate: - in absolute figures Greece, Serbia, FYROM most successful - in relation to eligible teams France, Germany and Hungary; - countries with high number of eligible teams pay to a certain extent price of this success: teams cannot be funded, exhaustion of funds - VCP

  • Remarks on PJC results: Success rate per instrument

    Chart2

    19215

    770

    536

    31321

    Funded projects

    Eligible projects

    Funded prop. type&country

    CountryResearch ProjectsNetworksSummer SchoolsTotal

    Albania0

    Austria11

    Bosnia & Herzegovina0

    Bulgaria235

    Croatia11

    France1214

    Former Yugoslav Republic of Macedonia0

    Germany112

    Greece628

    Hungary325

    Montenegro0

    Romania11

    Serbia22

    Slovenia213

    Total197632Zahlen korrigieren fr SS

    Research ProjectsNetworksSummer SchoolsTotal

    Funded projects197531

    Eligible projects2157036321

    Success rate8.84%10.00%13.89%9.66%

    &L&"Arial,Bold"&12SEE-ERA-NET Pilot Joint Call&C

    &"Arial,Bold"&12Funded proposals by type and country of the co-ordinator&R&"Arial,Bold"&11 27/06/07

    &L&"Arial,Bold"&12Prepared by INTAS

    Funded prop. type&country

    Funded projects

    Eligible projects

    Funded prop. type&country C

    AlbaniaAlbaniaAlbania

    Austria1Austria

    Bosnia & HerzegovinaBosnia & HerzegovinaBosnia & Herzegovina

    2Bulgaria3

    1CroatiaCroatia

    121

    Former Yugoslav Republic of MacedoniaFormer Yugoslav Republic of MacedoniaFormer Yugoslav Republic of Macedonia

    11Germany

    62Greece

    3Hungary2

    MontenegroMontenegroMontenegro

    1RomaniaRomania

    2SerbiaSerbia

    21Slovenia

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C&"Arial,Bold"&12

    Funded Proposals by country of the co-ordinator&R&"Arial,Bold"&11 &12 27/06/2007

    &L&"Arial,Bold"&12Prepared by INTAS

    Research Projects

    Networks

    Summer Schools

    Funded prop. field&country

    FIELDResearch ProjectsNetworksSummer SchoolsTotal Proposals

    05 - Computer Sciences0

    19 - Environmental Chemistry0

    22 - Ecology22

    23 - Plant Biology11

    24 - Zoology11

    25 - Microbiology22

    26 - Molecular Biology11

    27 - Biotechnology44

    31 - Geophysics11

    32 - Atmospheric Studies0

    33 - Hydrology & Marine Sciences0

    34 - Environment4239

    37 - Telecommunication0

    40 - Economics0

    47 - SEE-ERA.NET Sustainable Production4217

    48 - SEE-ERA.NET ICT213

    49 - SEE-ERA.NET Environment11

    TOTAL197632

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C&"Arial,Bold"&14

    Funded proposals by type and by scientific fields&R&"Arial,Bold"&11 &12 27/06/2007

    &L&"Arial,Bold"&12Prepared by INTAS

    Funded prop. field&country C

    05 - Computer Sciences05 - Computer Sciences05 - Computer Sciences

    19 - Environmental Chemistry19 - Environmental Chemistry19 - Environmental Chemistry

    222 - Ecology22 - Ecology

    123 - Plant Biology23 - Plant Biology

    24 - Zoology124 - Zoology

    225 - Microbiology25 - Microbiology

    26 - Molecular Biology126 - Molecular Biology

    427 - Biotechnology27 - Biotechnology

    31 - Geophysics131 - Geophysics

    32 - Atmospheric Studies32 - Atmospheric Studies32 - Atmospheric Studies

    33 - Hydrology & Marine Sciences33 - Hydrology & Marine Sciences33 - Hydrology & Marine Sciences

    423

    37 - Telecommunication37 - Telecommunication37 - Telecommunication

    40 - Economics40 - Economics40 - Economics

    421

    248 - SEE-ERA.NET ICT1

    49 - SEE-ERA.NET Environment49 - SEE-ERA.NET Environment1

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C&14&"Arial,Bold"Funded proposals by type and scientific fields&R&"Arial,Bold"&12 27/06/2007

    &L&"Arial,Bold"Prepared by INTAS

    Research Projects

    Networks

    Summer Schools

    Funded teams by country

    CountryNo teams in funded proposalsTeam success rate fundedNo teams in eligible proposalsTeam success rate eligible

    Albania85%6113%

    Austria85%5914%

    Bosnia & Herzegovina85%8310%

    Bulgaria138%12510%

    Croatia149%14210%

    France85%4418%

    Former Yugoslav Republic of Macedonia1510%11813%

    Germany117%7315%

    Greece1812%1929%

    Hungary96%6215%

    Montenegro64%5012%

    Romania64%837%

    Serbia1812%2278%

    Slovenia138%10113%

    Sum155142011%

    Italy1

    Moldova1

    Czech Rep.1

    Sweden1

    the Netherlands1

    United Kingdom1

    Total316

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C

    &"Arial,Bold"&12Number of teams by country in eligible proposals (all types)&R&"Arial,Bold"&11 27/06/2007

    &L&"Arial,Bold"&12Prepared by INTAS

    Funded teams by country C

    8

    8

    8

    13

    14

    8

    15

    11

    18

    9

    6

    6

    18

    13

    1

    1

    1

    1

    1

    1

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C

    &"Arial,Bold"&12Number of teams by country in funded proposals (all types)&R&"Arial,Bold"&11 27/06/2007

    &L&"Arial,Bold"Prepared by INTAS

    N teams in funded proposals

    Funded teams by Field

    FieldN teams in funded proposals

    05 - Computer Sciences

    19 - Environmental Chemistry

    22 - Ecology8

    23 - Plant Biology3

    24 - Zoology6

    25 - Microbiology6

    26 - Molecular Biology8

    27 - Biotechnology13

    31 - Geophysics13

    32 - Atmospheric Studies

    33 - Hydrology & Marine Sciences

    34 - Environment47

    37 - Telecommunication

    40 - Economics

    47 - SEE-ERA.NET Sustainable Production38

    48 - SEE-ERA.NET ICT15

    49 - SEE-ERA.NET Environment4

    Total161

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C

    &"Arial,Bold"&12Number of teams by scientific field in funded proposals &R&"Arial,Bold"&11 26/06/2007

    &L&"Arial,Bold"Prepared by INTAS

    Funded teams by Field C

    05 - Computer Sciences

    19 - Environmental Chemistry

    8

    3

    6

    6

    8

    13

    13

    32 - Atmospheric Studies

    33 - Hydrology & Marine Sciences

    47

    37 - Telecommunication

    40 - Economics

    38

    15

    4

    &L&"Arial,Bold"&12SEE-ERA.NET Pilot Joint Call&C

    &"Arial,Bold"&12Number of teams by scientific field in funded proposals &R&"Arial,Bold"&11 27/06/2007

    &L&"Arial,Bold"Prepared by INTAS

    N teams in funded proposals

  • Remarks on PJC results: Success rate per country

    Country No teams in funded proposalsTeam success rate fundedNo teams in eligible proposalsTeam success rate eligibleAlbania85%6113%Austria85%5914%Bosnia & Herzegovina85%8310%Bulgaria138%12510%Croatia149%14210%France85%4418%Former Yugoslav Republic of Macedonia1510%11813%Germany117%7315%Greece1812%1929%Hungary96%6215%Montenegro64%5012%Romania64%837%Serbia1812%2278%Slovenia138%10113%Sum155142011%

  • SEE-ERA.NET contactsMonitoring teamManfred Spiesberger (external expert)Email1: m.spiesberger@openmedicalinstitute.orgEmail2: manfred_spiesberger@yahoo.de

    Centre for Social Innovation:Marion Haberfellner (previously Peter B. Mayr)

    CNRS:Jean-Luc TeffoCeline-Delacourt Gollain

    National Authority for Scientific Research in RomaniaIulia Mihail, Anca Ghinescu, Alexandra Gurau

  • *Lessons learnt for the SEE-ERA.NET PLUS Joint Call

  • *LESSONS LEARNT FROM THE PJC 1/1FUNDINGFunding increased for the complete call budget and for each individual projectNot feasible:Virtual common pot:No national reserves for propping up of funds due to financial crisis

    PROCEDURESOnly one instrument (research projects)one single multilateral contract per projectRules of the game clearHowever: Different national eligibility criteria

  • *LESSONS LEARNT FROM THE PJC 1/2EVALUATIONScientific Council established

    PR/AWARENESS RAISI...

Recommended

View more >