moma.biz wp6 - evaluation

16
Kick Off Meeting 17-18 June 2010

Upload: hang

Post on 15-Jan-2016

35 views

Category:

Documents


1 download

DESCRIPTION

MoMa.BIZ WP6 - Evaluation. Kick Off Meeting 17-18 June 2010. WP6: Overview. WP Leader: Province of Asti (in close collaboration with iMpronta ) Importance of monitoring and evaluation: assist the project management by providing feedback and aiding accountability - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: MoMa.BIZ  WP6 - Evaluation

Kick Off Meeting17-18 June 2010

Page 2: MoMa.BIZ  WP6 - Evaluation

WP6: Overview

WP Leader: Province of Asti (in close collaboration with iMpronta)

Importance of monitoring and evaluation: assist the project management by providing feedback and

aiding accountabilitytrack achievements of targets/objectives: is the project

coming closer to its objectives or nothelp in the learning process: sharing and comparing similar

experiences highlights what did work, how barriers can be tackled, etc.

enhance knowledge about cause and effect relationships provide data for measuring cost-effectiveness of MM

measures

Page 3: MoMa.BIZ  WP6 - Evaluation

WP6: Goals WP Goals:

Evaluate local actions (and compare the results internationally)

Evaluate in general the impact of the project on the local communities, on the target groups and on the policy level (both at local and international level)

Evaluate the process, in order to maintain high quality, look at the whole implementation process, barriers encountered and type of solution found to get around barriers (related to the progress report in WP1)

Page 4: MoMa.BIZ  WP6 - Evaluation

Task Partner

1. Definition of the evaluation framework, including the definition and evaluation of sustainability indicators (CO2, energy consumption) for mobility in BIZ

Province of Asti & iMpronta

2. Final evaluation survey iMpronta, Tartu, EREN, EAP, ALTERnet, SSCCI

3. Collection and comparison of all the local participatory evaluation indicators

Province of Asti

4. Comparative evaluation results: barriers, indicators, solutions iMpronta

5. Provide local indicators and information to the WP leader Tartu, EREN, EAP, ALTERnet, SSCCI

6. Carrying out of two video-audits at each BIZ iMpronta

7. Editing of the guide “Boxed Solutions” methodology (English) iMpronta

8. Translation and printing of the guide in the remaining national languages

Province of Asti, Tartu EREN, EAP, ALTERnet, SSCCI (only printing)

9. Shooting and editing of the final conference video SSCCI

10. Organization & leadership of the Intermediate Evaluation Session. Organization, leadership & hosting of the Final Evaluation Conference

Province of Asti & SSCCI

11. Preparation & printing of the Final Publishable Report in English iMpronta

Page 5: MoMa.BIZ  WP6 - Evaluation

WP6: Deliverables D6a: Interim Report

D6b: “Boxed Solutions” methodology guide – in all the national languages of the partners, printing a total of 7000 copies

D6c: WebCast (video to be published on the web) presenting the most interesting aspects of the final project conference

D6d: Two video-audits of each BIZ (to be published on the web) before and after the mobility plan implementation

D6e: Final Publishable Report in English– printing and posting of 700 copies

Page 6: MoMa.BIZ  WP6 - Evaluation

WP6: Monitoring & Evaluation Tools Project Meetings

1.Intermediate Evaluation Meeting (18th month – October 2011) just before the presentation of the Interim Report to EACI

2.Final Evaluation - International Conference meeting (30th month – October 2012) at the end of the project

MaxSumoA tool to be adopted and adapted to MoMa.BIZ for

carrying out the monitoring and evaluation of the various project activities.

Page 7: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 1What is MaxSumo

Deliverable of the EU project Successful Travel Awareness Campaigns and Mobility Management Strategies completed in October 2009 (www.max-success.eu/)

Provides a systematic and standardised evaluation methodology designed for the monitoring and evaluation of mobility projects.

Page 8: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 2Why MaxSumoIt provides a simple and systematic approach for the

project monitoring and evaluation

It is the predecessor of SUMO (proven to work in over 100 projects) and has already been tried and tested in projects

Possibility to enter the project results in the MaxEva database, which allows the comparison of MoMa.BIZ with other similar European projects

Contribution to the development of Mobility Management on a European level as the project results could be used for optimising future work

Page 9: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 3MaxSumo Structure

The different assessment levels in MaxSumo are divided into four main categories;

1.Intervention framework conditions refer to underlying background conditions in the location where the project is to take place, and characteristics of the group that is the focus of the project.

2.Services provided by the project refer to the different activities and outputs the project provides in order to promote changes in travel behaviour (i.e. what the project is providing to people).

Page 10: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 4

3. Mobility options offered through the services provided refer to the travel behaviour the project is attempting to persuade the target sample to use (e.g. attempt to switch car drivers to public transport, cycling or walking for some or all of their trips)

4. Overall effects refer to main outcomes of the project with regard to new attitudes and behaviour adopted, and system impacts achieved by a change in behaviour (e.g. reduction in car mileage, CO2 emissions)

Page 11: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 4

Page 12: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 5

Page 13: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 6Adapting of MaxSumo to MoMa.BIZ

Two direct groups:Employees/commuters of the local companies (BIZ)Local stakeholders

One indirect group: European companies and BIZ & European Mobility Managers

So far three monitoring tables have been prepared, one for each of the above mentioned groups, that should guarantee the homogeneity between the data collected at the different BIZ.

The project indicators have been incorporated in these tables. 71% of the Project’s Specific Objective indicators are included in them.

Page 14: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 7Monitoring & Data Collection MethodsBackground study of each BIZProject Website: it is designed so as to provide statistics on its

visitorsDocumentation of the activities carried out and their costs

throughout the project implementation.Surveys:

home-work surveyfinal evaluation surveysatisfaction questionnaires at the end of the training sessions satisfaction questionnaires aimed at the local stakeholders at

the end of the projectsatisfaction survey aimed at the project partners

Video-audits before and after the implementation of the local mobility plan.

Page 15: MoMa.BIZ  WP6 - Evaluation

WP6: MaxSumo 8How to use the MaxSumo-MoMa.BIZ tables

The tables should be used throughout the project duration for monitoring the project activities at the time they are implemented.

Collect the data indicated at the tables for each activity. Possible that not all activities are covered, in that case communicate with the Project Coordinator in order to identify the indicators to monitor for the missing activity and for them to be communicated to the consortium (guarantee homogeneity)

Communicate the data collected at the Project Coordinator when asked (three times foreseen, each one just before the presentation of the three evaluation reports to EACI)

Page 16: MoMa.BIZ  WP6 - Evaluation

WP6: ConclusionWP Leader Province of Asti

Monitoring & Evaluation Tools

•Project Meetings•MaxSumo

Monitoring & Data Collection Methods

•Background study•Website •Documentation•Surveys•Video audits

Communication of Data to the Project Coordinator

• January 2011•October 2011•September 2012