1

Evaluation of the Multiyear Plan 2000-2003Evaluation of the Multiyear Plan 2000-2003

José Paulo SilveiraMinistry of Planning, Budget and Management

Secretariat for Planning

José Paulo SilveiraMinistry of Planning, Budget and Management

Secretariat for Planning

2

A focused objective A focused objective 

To promote the continuous

improvement of the Multiyear Plan

To promote the continuous

improvement of the Multiyear Plan

3

EVALUATIONEVALUATION

Two different targetsTwo different targets

Management

improvement

CONTROLCONTROL

Conformity

verification

4

·      PPA Evaluation Manual

·      Management Information System

·      Training

·      PPA Evaluation Manual

·      Management Information System

·      Training

A compreensive preparationA compreensive preparation

5

TrainingTraining

6

PPA Annual Evaluation Report

An evaluation in three stepsAn evaluation in three steps

Manager Sector Ministry Planning Ministry

• Results

• Program’s design

• Execution

• Results and strategy review

• Macroeconomicscenario

• Strategic objectivesreview

• Managementperformance

7

• Results (3)

• Execution (2)

• Recommendations for improvement (2)

Step 1: Program evaluationStep 1: Program evaluation

Multiple choice questions• Results (3)

• Program´s design (8)

• Execution (27)

Descriptive questions

8

• Program evaluation review

• Program results and strategy matrix

• Recommendations for improvement

• Program evaluation review

• Program results and strategy matrix

• Recommendations for improvement

Step 2: Results and sector strategy reviewStep 2: Results and sector strategy review

9

Program results and strategy matrix

Program results and strategy matrix

SECTOR STRATEGIC OBJECTIVES

SSO1 SSO2 SSO3 SSO4 ...PROGRAMS

Program 1R1R2R3

Program 2R1R2R3 ... Grade: 0 to 4

No contribution = 0 Full contribution = 4

10

• Accountability

• Resource allocation

• Partnership

PPA program conceptPPA program concept

A management unity for:

11

Example

Programa: ERRADICAÇÃO DO TRABALHO INFANTIL Objetivo: Eliminar a prática do trabalho por menores de 16 anos, salvo na condição de aprendiz.

Indicador: Índice mais recente: Índice final PPA: TAXA DE TRABALHO INFANTIL 11,170 5,000

12

Exemplo

Dados Financeiros em R$ milhões: Nacional: N NE SE CO S Total Recursos dos Orçamentos da União 362,0 51,1 611,5 33,4 37,0 0,6 1.095,8 Demais Fontes 0,0 0,0 0,0 0,0 0,0 0,0 0,0 Total 362,0 51,1 611,5 33,4 37,0 0,6 1.095,8

Example

13

Exemplo

Ações: Prod. Unid.Med. Nacional N NE SE CO S Total

Atendimento à criança e ao criança/adolescente em jornada escolar adolescente Unid. 749.323 120.090 1.353.253 62.440 61.164 0 2.346.270ampliada atendido

Concessão de bolsa criança/criança cidadã adolescente Unid. 456.522 62.156 802.343 43.848 55.314 0 1.420.183 atendido

Fiscalização para erradicação criança/do trabalho Infantil adolescente Unid. 0 25.990 30.436 49.152 16.686 12.754 135.018 atendido

Mapeamento dos focos de mapeamentodo trabalho Infantil por realizado Unid. 4 0 0 0 0 0 4Município

Example

14

5agendas

5agendas

388 Programs388 Programs

4 strategic options

28 strategic objectives

Guidelines

4 strategic options

28 strategic objectives

Guidelines

Sectorial Strategy Sectorial Objectives

Sectorial Strategy Sectorial Objectives

PPA strategic basePPA strategic base

15

• Analysis of the macroeconomic scenario

• Management performance survey

• Strategic objectives review

• Programs results and recommendations

• Physical and financial execution report

• Analysis of the macroeconomic scenario

• Management performance survey

• Strategic objectives review

• Programs results and recommendations

• Physical and financial execution report

Step 3: Plan evaluationStep 3: Plan evaluation

16

Report was sent to Congress on April 12, 2001

 

Available at:

www.planejamento.gov.br

PPA Annual Evaluation ReportPPA Annual Evaluation Report

17

Preparation July/00 to Nov/00

Step 1 Nov/00 to Jan/01

Step 2 Jan/01 to Feb/01

Step 3 Feb/01 to April 12/01

A nine month effortA nine month effort

18

www.abrasil.sociedade.gov.brwww.abrasil.sociedade.gov.br

SIG 2000 Citizen´s moduleSIG 2000 Citizen´s module

19

20

21

22

23

24

2000

2001

AvaluationAvaluation

PL LDO 15.02

15.04

31.08

PL OAP

DC

A

Linkages with in the decision making processLinkages with in the decision making process

25

• PPA revision

• Cooperation with World Bank: International

benchmarking

• Cooperation with IDB: Pilot project for “real

time” evaluation

• PPA revision

• Cooperation with World Bank: International

benchmarking

• Cooperation with IDB: Pilot project for “real

time” evaluation

Next stepsNext steps