module 2: indicators for monitoring and evaluation policy interventions anat lewin and isabelle...

Module 2: Indicators for Monitoring and Evaluation Policy InterventionsAnat Lewin and Isabelle HuynhMarch 8th, 2009

2

Module Outline

What are the main research questions in the ICT sector?Reviewing the new Core ICT Indicators

Which target indicators could be part of our framework?

Egypt’s ICT Policy as the basis for an M&E Framework

Finalizing the framework

3

Question to Participants

What are common ICT research and policy questions?

?

4

Common ICT Research Questions

USAGE

• Is ICT penetration at a high enough level in Egypt? Can it grow further?• Are ICTs available and accessible to all citizens in Egypt?• Is an appropriate offering of ICT services accessible to all types of

businesses (local, foreign, small, medium, large) operating in Egypt?• Are effective, efficient, user-friendly e-services by the Egyptian

government available to and being used by citizens and businesses?• Are effective, efficient, user-friendly e-services by Egyptian

businesses available to and being used by citizens and government?

QUALITY• Are available ICTs in Egypt of good quality (fixed, mobile,

international, data, e-Government)?

5


AFFORDABILITY• Are ICTs affordable to Egyptian citizens? • Are ICTs affordable to Egyptian businesses?• Can the poorest people in Egypt afford access to sufficient levels of

ICTs? Can women afford ICTs? Can rural people afford ICTs?• Are ICTs priced at a reasonable market rate?

MARKET• Are the ICT sub-sectors open and competitive?• Are Egyptian ICT companies competitive at a regional / global level?

LESSONS LEARNED• How have Egyptian policies affected the ICT sector and its impact on

the larger economy? • What additional reforms will reap further benefits?

6


IMPACT• What is the impact of the ICT sector on Egyptian GDP?• What is the growth rate of the Egyptian ICT sector? • What are the trends?• How many people are employed in the Egyptian ICT sector? How

many people benefit from that employment?• What is the profitability of the Egyptian ICT business sector?• What is the reduction of transaction costs to Egyptian businesses

and citizens through use of ICTs?• What is the impact of ICTs on Egyptian transparency and

accountability?• How much foreign investment is entering the Egyptian ICT sector?• What is the trickle down impact of the ICT sector to other sectors?• Are businesses and citizens saving time or money due to ICTs?• How converged are services in Egypt? What impact is convergence

having?

7

Reminder: types of indicators

Outcomes • Intermediate effects of outputs on clients

Outputs • Products and services produced

Activities• Tasks personnel

undertake to transform inputs to outputs

Inputs • Financial, human, and material resources

Impacts • Long-term, widespread improvement in society

Impl

emen

tatio

nR

esul

ts

Binnendijk, 2000

8

Module Outline





9

What kind of indicator is it?

Indicator # Basic Core ICT Indicators Type

A1 Fixed telephone lines per 100 inhabitants

A2 Mobile cellular telephone subscribers per 100 inhabitants

A3 Fixed Internet subscribers per 100 inhabitants

A4 Fixed broadband Internet subscribers per 100 inhabitants

A5 Mobile broadband subscribers per 100 inhabitants

A6 International Internet bandwidth per inhabitant (bits/second/inhabitant)

A7 Percentage of population covered by a mobile cellular

telephone network

A8 Fixed broadband Internet access tariffs (per month), in US$, and as a percentage of monthly per capita income

A9 Mobile cellular prepaid tariffs, in US$, and as a percentage of monthly per capita income

A10 Percentage of localities with public Internet access centres (PIACs) by number of inhabitants

10


Indicator # Households and Individuals Core ICT Indicators Type

HH1 Proportion of households with a radio

HH2 Proportion of households with a TV

HH3 Proportion of households with telephone (Fixed only, Mobile only, Both)

HH4 Proportion of households with a computer

HH5 Proportion of individuals who used a computer (from any location) in the last 12 months

HH6 Proportion of households with Internet access at home

HH7 Proportion of individuals who used the Internet (from any location) in the last 12 Months

HH8 Location of individual use of the Internet in the last 12 months (home, work, education, another home, community, commercial access points)

HH9 Internet activities undertaken by individuals in the last 12 months (from any location)

HH10 Proportion of individuals with use of a mobile cellular telephone

11


Indicator # Households (cont’d) and Businesses Core ICT Indicators

Type

HH11 Proportion of households with access to the Internet by type of access (narrowband, broadband (fixed, mobile))

HH12 Frequency of individual use of the Internet in the last 12 months (from any location)

HHR1 Frequency of individual use of the Internet in the last 12 months (from any location)

B1 Proportion of businesses using computers

B2 Proportion of persons employed routinely using computers

B3 Proportion of businesses using the Internet

B4 Proportion of persons employed routinely using the Internet

B5 Proportion of businesses with a web presence

B6 Proportion of businesses with an intranet

B7 Proportion of businesses receiving orders over the Internet

12


Indicator # Businesses, Sector and Trade Core ICT Indicators Type

B8 Proportion of businesses placing orders over the Internet

B9 Proportion of businesses using the Internet by type of access (narrowband, broadband (fixed, mobile))

B10 Proportion of businesses with a local area network

B11 Proportion of businesses with an extranet

B12 Proportion of businesses using the Internet by type of activity

ICT1 Proportion of total business sector workforce involved in the ICT sector (expressed as a percentage)

ICT2 ICT sector share of gross value added (expressed as a percentage of total business sector gross value added)

ICT3 ICT goods imports as a percentage of total imports

ICT4 ICT goods exports as a percentage of total exports

13


Indicator # Education Core ICT Indicators Type

ED1 Proportion of schools with a radio used for educational purposes (by ISCED level 1 to 3)

ED2 Proportion of schools with a TV used for educational purposes (by ISCED level 1 to 3)

ED3 Proportion of schools with a telephone communication facility (by ISCED level 1 to 3)

ED4 Student-to-computer ratio (by ISCED level 1 to 3)

ED5 Proportion of schools with Internet access, by type (by ISCED level 1 to 3)

ED6 Proportion of students who have access to the Internet at school (by ISCED level 1 to 3)

ED7 Proportion of students enrolled by gender at the tertiary level in ICT-related fields (for ISCED levels 5 and 6)

ED8 Proportion of ICT-qualified teachers in primary and secondary schools

EDR1 Proportion of schools with electricity (by ISCED level 1 to 3)

14

Question to participants

What are your observations on the Core ICT Indicators?

?

15

Burning the candle at both ends

Common Denominator Indicators: International Partnership’s Core ICT Indicators

Tailored Indicators:Egyptian ICT M&E Framework Indicators

•International Core ICT Indicators purposefully aim for a common denominator among all countries•Egypt needs to supplement with a specially tailored ICT M&E

Framework. What basis should we use for the M&E Framework?

16

Module Outline





17

Good Practice ICT Strategies

• Link to the country’s overall goals – political, economic and social• Use indicators to benchmark analysis and formulate clear and

realistic goals and targets• Implement mechanisms, including institutions, processes and

resources• Monitor and evaluate mechanisms, especially the responsibilities

and budgets for these efforts

HighLevelPolicy

Statement

PolicyGoals

PolicyTargets

Measure Each

Target With

Indicators

Review Measures

In Regular Intervals

Most ICT strategies have

Fewer strategies have

18

Egypt’s Policy Goals 2007-10

1. To continue development of state-of-the-art ICT infrastructure that provides an enabling environment for government and businesses throughout Egypt and links it globally2. To create a vibrant and export-oriented ICT industry3. To leverage public-private partnerships as an implementation

mechanism whenever possible4. To enable society to absorb and benefit from expanding

sources of information5. To create a learning community whose members have access

to all the resources and information they require regardless of gender and location, thus allowing all to achieve their full potential and play a part in the country’s socioeconomic development6. To support the development of the skills required by the ICT

industry7. To support research and innovation in the field of ICT

Source: Egypt’s ICT Strategy 2007-2010

19

Targets: ICT Sector Restructuring

–2.1 Development of State-of-the-Art Telecommunications Infrastructure and Export of Services

• 2.1.1 To integrate communication networks within global infrastructure

• 2.1.2 To provide state-of-the-art communication services throughout Egypt (broadband, convergence)

• 2.1.3 To develop exports of communications services by establishing a Telecommunications Free Zone

–2.2. Reform of the Postal Sector• 2.2.1 To develop a world-class postal service in terms of quality,

innovation and accessibility• 2.2.2 To increase overall levels of private sector investment in the

postal market through open and fair competition and progressive regulation

• 2.2.3 To create a new export-oriented postal industry in Egypt

–2.3 Enhancing the Framework Governing Use of ICT Networks and Services• 2.3.1 To integrate Egypt within international frameworks governing

trade in ICT• 2.3.2 To enact programs to ensure equitable access to

telecommunications services throughout Egypt• 2.3.3 To protect users’ privacy in the information society and fight

cyber-crime and harmful content.Source: Egypt’s ICT Strategy 2007-2010

20

Targets: ICT for Development

–3.1 ICT for All• 3.1.1 To assist the GoE in its policy to integrate ICT in government and public

services• 3.1.2 To facilitate ICT access for all Egyptians

–3.2 ICT for Education and Lifelong Learning• 3.2.1 To help the GoE achieve its vision of educate and lifelong learning as a drive

for socioeconomic development• 3.2.2 To integrate ICT within formal education at all levels and foster better

management of education systems• 3.2.3 To support the training of world-class technically skilled ICT graduates

–3.3 ICT for Health• 3.3.1 To improve the level of healthcare services in partnership with the MoH• 3.3.2 To boost information dissemination and knowledge acquisition for the

development and improvement of public health• 3.3.3 To assist in reducing the cost and increasing the efficiency of public health

services across the country–3.4 e-Content

• 3.4.1 To develop a world-class, high-value Arabic digital content industry and the required Arabic applications as a base for economic and social development

• 3.4.2 To increase the level and accessibility of Arabic online digital content• 3.4.3 To create an environment conducive to the sustainable production of Arabic

online digital content–3.5 ICT for Government

• 3.5.1 To provide the necessary technical support to the GoE in issues pertaining to ICT and find cost-effective ICT solutions to support the GoE in national projects

• 3.5.2 To liaise on behalf of the GoE in issues involving systems software & application


21

Targets: Innovation & Industry Development

–4.1 Development of the Export-Oriented IT-Enabled Services Industry• 4.1.1 To build niche strengths for the IT-enabled service sector• 4.1.2 To increase the profile of Egypt’s service industry in the export sector• 4.1.3 To advocate for policies that will encourage export growth for the sector• 4.1.4 To tap into knowledge-based human capital for growth and development

and develop the capacity of individuals, SMEs and industries to take full advantage of the commercial opportunities in the sector

–4.2 Developing the ICT Capacity of Egypt• 4.2.1 To leverage the capacity of the local business community to enhance

their global competitiveness• 4.2.2 To sustain the supply of skilled individuals needed for a growing ICT

Industry–4.3 Research and Innovation

• 4.3.1 To increase the quantity and quality of research and technology development activities undertaken in Egypt

• 4.3.2 To develop a favorable environment for innovation and foster links and improved coordination between the various public and private agents in the Egyptian research and innovation system

• 4.3.3 To define and coordinate research and innovation promotion policies and foster a scientific and technological culture in Egypt

–4.4. Promoting ICT Investment and FDI• 4.4.1 To develop an ICT environment attractive to FDI and BPO• 4.4.2 To develop strategic partnerships with multinationals to increase

investment, exports and employment and to support technology transfer


22


Does our strategy have measurable targets?

?

23

Module Outline





24

Group Work

1. Team 1 works to identify measurable indicators for ICT Strategy Section 2: ICT Sector Restructuring

2. Team 2 works to identify measurable indicators for ICT Strategy Section 3: ICT For Development

3. Team 3 works to identify measurable indicators for ICT Strategy Section 4: Innovation and Industry Development

Please use your handouts!

25

Target Indicators by Team 1

(This slide will be filled in on the day of the workshop by participants)

26



27



28

Module Outline





29


How do we draft a proposed M&E Framework for Egypt?

?

30

Finalizing the Framework

• List of all indicators currently covered by MCIT’s regular publications• List all indicators

available, from MCIT, CAPMAS and other sources

• List all the Core

ICT Indicators• List all the new

measurable target indicators we have identified for Egypt’s ICT Strategy

COMPAREMIX AND MATCH

DISTILL AN EGYPT ICT STRATEGY M&E FRAMEWORK

Thank you

[email protected]

The Postal Sector: Indicators for Monitoring and Evaluation Policy InterventionsIsabelle HuynhMarch 8th, 2009

33

Postal sector1.Which data are available?

a) UPU: public postal operators’ data (surveys sent to operators)

b) European Commission: Nov. 2002, March 2005, Oct. 2006, Dec. 2008 reports with standardized statistics collected through surveys

c) Eurostat: http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/KS-QA-07-012/EN/KS-QA-07-012-EN.PDF

d) Examples of regulators: France, UK

2.Linking data to research, strategy and policy analysisa) What drives postal performance? (World Bank)b) New postal economics models for DCs (UPU)c) European Commission: from the 2nd (2002) to the 3rd (2008)

postal directive

34

•Reform of the postal sector (Egypt ICT strategy)–Objective 1: Develop a world class postal service in terms of quality,

innovation and accessibility• State of the art postal network: ICT enabled and ubiquitous• Restructuring and modernization of Egypt Post: extending the reach and

portfolio services, distribution platform for public and private services, partnerships to enter the global supply chain and e-commerce industry

–Objective 2: Increase levels of private sector investment• Establishment of a regulatory mechanism• Adapting to new international postal regulations

–Objective 3: Create a new export-oriented postal industry in Egypt• Egypt as a postal hub• Cooperating with international operators through a postal free zone

•Postal statistics available on MCIT’s and Egypt Post’s website–MCIT: Service ports, global post, local post–Egypt Post:

•Linking data to the postal sector reform in Egypt–Current gaps–What can we learn from other organizations’ experience

Thank you

[email protected]

36

How does it all fits together?

Foundation-Telecommunications infrastructure (voice, data)-Distribution platforms-IT industry/IT sector (goods and services)-Content/media industry-Postal network

Reduce poverty and improve MDGs

-Education-Health-Environment-Gender-Rural development

Strengthen governance

-Social cohesion-Political participation by all

Increase business growth:

-Investment rate-Employment-Revenues/profitability-Productivity

Improve market mechanism:

-Access to market information-Reduce transaction cost-Trade opportunities-Expanded participation in markets

Improve public/social services:

-More & better services -Citizen satisfaction-Transparency & accountability

Increase economic growth & competitiveness

-Per capita income-FDI-Productivity-Employment-Export/trade

MICRO-LEVEL OUTCOMES

NATIONAL OUTCOMES

ICT as a Sector

ICT as an Enabler

Improve access to information/knowledge and networking:

-Human capital growth-Social networking -Political voices

Businesses

Government

Individuals

ICT Users ICT Applications

E-government (e.g. land registration, public service delivery)E-businessE-educationE-healthE-agricultureICT-enabled services (e.g. financial, insurance, information services, tourism)ICT use in R&D

ICT Sector Policies-ICT strategies -ICT institutions-ICT implementation capacities

module 2: indicators for monitoring and evaluation policy interventions anat lewin and isabelle...

Documents