ius final evaluation unza
Post on 07-Apr-2018
229 Views
Preview:
TRANSCRIPT
-
8/6/2019 IUS Final Evaluation UNZA
1/122
-
8/6/2019 IUS Final Evaluation UNZA
2/122
The Evaluation Commission
The external evaluation commission or the partnership programme with the
University o Zambia was composed o two individuals with extensive experi-
ence with regard to higher education matters. Mr Paul G. de Nooijer, team leader,
is senior education consultant with SPAN Consultants rom the Netherlands.
He has long-term experience in undertaking evaluation research, in particular
in the eld o higher education and inter-institutional cooperation programmes,
including programmes that have similarities with the VLIR-UOS IUC Programme.
Mr. Bornwell Siakanomba is managing consultant with SIBO Development
Consultants, Lusaka, Zambia.
Background and disclaimer
The VLIR-UOS Programme or Institutional University Cooperation (IUC), which
started in 1997, is an inter-university cooperation programme o the Flemish universi-
ties1. Based on a system o programme unding provided by the Belgian Government,
the Programme is directed at a limited number o careully selected partner universities
in the South. Each partnership, covering a maximum period o ten years, consists o a
coherent set o interventions geared toward the development o the teaching, research,
and service unctions o the partner university, as well as its institutional management.
Every three to ve years, the cooperation with a partner is evaluated. All ongoing
cooperation programmes are evaluated by an external, independent evaluation com-
mission. The country visits o these commissions, usually composed o an international
and a local expert, are preceded by an extensive sel-assessment process. All evaluation
commissions have produced an evaluation report that, in principle, is meant to be sel-
contained, i.e. containing the essential actual inormation, as well as conclusions and
recommendations.
This report represents the views o the members o the commission that evaluated
the IUC Programme with the University o Zambia (UNZA); it does not necessarily
refect the opinions o VLIR-UOS. The evaluation commission bears sole responsibility
or the report in terms o its content, as well as its structure.
-
8/6/2019 IUS Final Evaluation UNZA
3/122
Acronyms and abbreviations
AP Annual Programme
B.Sc. Bachlor o Science
CAMAS Computers or Administration, Management and Academic Services
CBU Copperbelt University
COMESA Common Market or Eastern and Southern Arica
DDE Directorate o Distance Education
ELISA Enzyme-linked immuno-sorbant assay
EU European Union
GDP Gross Domestic Product
GIS Geographical Inormation System
HE Higher Education
HIV Human Immunodeciency Virus
HR Human Resources
ICT Inormation and Communications Technology
INESOR Institute or Economic and Social Research
ISP Internet Service Provider
IT Inormation Technology
IUC Institutional University Co-operation (programme)
JICA Japan International Co-operation Agency
M.Sc Master o Science
MU Mulungushi University
NAC National Aids Council
NGO Non Governmental Organisation
Nufc Netherlands organisation or international cooperation in higher education
OECD Organisation or Economic Cooperation and Development
PABX Private Automatic Branch Exchange
PC Personal Computer
PCM Project Cycle Management
Ph.D. Doctor o Philosophy
SADC Southern Arican Development Community
SDF Staf Development Fellow
ToR Terms o Reerence
UK United Kingdom
UNICEF United Nations Childrens Fund
UNISA University o South Arica
UNZA University o Zambia
USAID United States Agency or International Development
VLIR Vlaamse Interuniversitaire Raad (Flemish Inter-university Council)
ZAMNET Zambian Internet Service Provider
-
8/6/2019 IUS Final Evaluation UNZA
4/122
Final Evaluation o the UNZA-IUC partnership
Foreword 3
THe eVALUATIoN eXerCISe 5
Terms o Reerence or the evaluation 5
Evaluation approach and methodology 6
Evaluation criteria and indicators 7
Evaluation limitations 7
ZAMBIAN SoCIo-eCoNoMIC ANd HIGHer edUCATIoN CoNTeXT 9
Social - Political characteristics o the Economy 9
Macro - Economic Framework 9
Policy and Structure o Education System 10
Higher education in Zambia 12
IUC ProGrAMMe AT UNZA - GeNerAL 15
THe UNZANeT CoMPUTer CeNTre & LIBrArY ProJeCT 19Introduction 19
Realisations: Computer Centre 20
Realisations Library 23
Assessment 24
dISTANCe edUCATIoN ProJeCT 27
Introduction 27
Realisations 27
Assessment 31
CoMPUTer STUdIeS ProJeCT 35
Introduction 35
Realisations 36
Assessment 39
Food SCIeNCe ANd TeCHNoLoGY ProJeCT 41
Introduction 41
Realisations 41
Assessment 45
VeTerINArY MedICINe ProJeCT 49
Introduction 49
Realisations 50
Assessment 51
GeoLoGY GeoLoGY ANd SoIL SCIeNCeS 55
Introduction 55
Realisations 56
Assessment 59
INTer-dISCIPLINArY reSeArCH 63
Introduction 63
Realisations 64Assessment 65
ProGrAMMe MANAGeMeNT 67
General 67
Management General 67
Programme unding and inancial management 69
oVerALL ProGrAMMe ASSeSSMeNT 73
Relative strengths 73
Relative weaknesses 74
General Recommendations 74
APPeNdICeS 77
Appendix I: Contents 78
Appendix II : Flemish Interuniversity Council 100
Appendix III : Reerences 103
Appendix IV : Overview o persons met 105
Appendix V : Overview o approved and implemented research projects (by programme year) - Multidisciplinary
Research project 105
Appendix VI : Publications resulting rom the VLIR-IUC Programme 108
Table of contents
-
8/6/2019 IUS Final Evaluation UNZA
5/122
Final Evaluation o the UNZA-IUC partnership
2
-
8/6/2019 IUS Final Evaluation UNZA
6/122
Final Evaluation o the UNZA-IUC partnership
Eective nal programme evaluation should yield valuable inormation that can be
used by programme stakeholders and unding agencies about whether the programme
has indeed realised what it set out to do in the beginning and about lessons learned that
could be useul or the uture.
For such an evaluation to be successul, active participation o all key stakeholders is a
sine qua non. In the case o the partnership with the University o Zambia (UNZA),
the evaluation process was thereore designed to be iterative and participatory, involving
three dist inct opportunities or input rom and involvement by the partners: during the
sel assessment, during the visit o the evaluation commission rom 21 to 29 February
2008 and during the review o the drat nal report o the evaluation commission in the
course o early months o 2008.
As indicated in the Terms o Reerence (see Appendix 1 to this report), the ocus o the
nal evaluation was as ollows:
the global state o implementation o the programme, reali sation o objectives
the qual ity, eciency, ecacy, impact, development relevance and sustainability
o the programme and programme management
the position o the IUC programme within the international cooperation
activities o UNZA and the added value o the IUC Programme ... in compari-
son to other ongoing donor cooperation programmes
the ollow up plan o the programme as elaborated in the sel assessment
report
The evaluation covered the entire IUC Programme, which consisted o two phases, i.e.
rom 1997 to 2001 and rom 2002 to 2007.
Based on these Terms o Reerence, the structure o the report is as ollows:
Chapter 1 briefy describes the evaluation process, sources o inormation and
indicators used during the process as well as the limitations o the evaluation
conducted
Chapter 2 provides some background on the context o the partnership, includ-
ing some data on Zambias socio-economic status and developments, the coun-
trys overall and higher education system as well as some general inormation on
UNZA
Chapter 3 provides a brie on the overall VLIR-UOS IUC Programme with
UNZA, including elementary data on the projects that were undertaken in the
two phases o the Programme.
The chapters 4 to 10 subsequently provide detailed inormation on each o the
projects that was nanced. The presentation ollows the sequencing o projects
CONTENTS
-
8/6/2019 IUS Final Evaluation UNZA
7/122
Final Evaluation o the UNZA-IUC partnership
in the Programme document or the 2nd phase, starts with the Computer
Centre/Library (ormer UNZANET) project in chapter 4 and concludes in chap-
ter 10 with a description o the Interdisciplinary Research project. Each chapter
contains detai ls on objectives and anticipated results and describes what has been
achieved or key elements o the project concerned. Each chapter is concludedwith a brie assessment in which attention is paid to relevance, eectiveness,
eciency, impact and sustainability issues.
Chapter 11 concerns issues o programme unding and nancial management
Chapter 12 nally provides a summary assessment o the VLIR-UOS IUC
Programme with the University o Zambia as a whole.
The appendices to the report include the ollowing:
Appendix 1 Mission Terms o Reerence
Appendix 2 Inormation on VLIR-UOS and the IUC Programme
Appendix 3 Documentation used
Appendix 4 List o interviewees
Appendix 5 Overview o research projects unded and implemented under the
Interdisciplinary Research project
Appendix 6 Overview o publications resulting rom the Programme
The evaluation commission would like to express its appreciation to all o the indi-
viduals we met in the course o the evaluation. The inormation, the dialogue, and the
ideas shared with these individuals were instrumental in shaping our thinking. Last but
not least, we want to thank everyone or their hospitality during visits to Brussels and
Lusaka.
-
8/6/2019 IUS Final Evaluation UNZA
8/122
Final Evaluation o the UNZA-IUC partnership
This chapter provides some inormation on the scope o the evaluation, the way in
which the evaluation was conducted and evaluation criteria and indicators used as well
as the limitations o the evaluation exercise.
Tms rnc th valuatin
Terms o Reerence (ToR) or the nal evaluation o the partnership with UNZA
were issued in June 2007 and are provided in Appendix 1 to this report. According to
these ToR (page 9), issued or the three nal evaluations simultaneously, the nal evalu-
ation was meant to generate conclusions that wil l allow:
the identication o strengths and weaknesses o each specic IUC collabo-
ration with the three institutions in particular, and o the IUC programme in
general;
VLIR-UOS to identiy departments and/or research groups that have received
substantial support rom the IUC programme in Phase II and thus can present
proposals or the IUC Research Initiative Projects
the ormulation o recommendations to al l stakeholders in terms o the ollow up
plan that has been elaborated by the Northern and Southern project leaders
to identiy and comment upon possible venues or the uture o the involved
projects in view o establishing sustainability
According to ToR (page 9-10), the scope o the evaluation was to be as ollows:
the present implementation o the programme, ocusing on the global state
o implementation o the programme, realisation o objectives o the various
projects, as well as programme management in both Flanders and the Southern
institution
the nature o the programme, evaluating the quality, eciency, ecacy, impact,
development relevance and sustainability o the programme in the light o the
overall goal o the IUC Programme and the cooperation between all parties
involved
the position o the IUC programme within the international cooperation activities
o the partner university, which is about the added value o the IUC Programme ...
in comparison to other ongoing donor cooperation programmes
the ollow up plan o the programme as elaborated in the sel assessment
report
CONTENTS
-
8/6/2019 IUS Final Evaluation UNZA
9/122
Final Evaluation o the UNZA-IUC partnership
evaluatin appach an mthlgy
GeneralGeneralThe methodology used or this nal evaluation o the UNZA IUC Programme is
based on the VLIR-UOS methodology or evaluation. Use has been made o:The selassessment orms that were prepared by UNZA - IUC Programme par-
ticipants (October-November 2007)
Other documentation, including annual planning and progress reports and pro-
gramme documents
Meetings with VLIR-UOS (Brussels)
Meetings with UNZA aculty who had been involved in the UNZA-IUC
Programme
Meetings with current and ormer project leaders, i.e. representatives o the
Flemish universities participating in the UNZA-IUC Programme as well as
On-site campus visits.
A short debrieng session was held on 29 February 2008, which was attended by
representatives rom UNZA, the Flemish universities as well as VLIR-UOS.
Sel assessment ormsSel assessment ormsThe orms were prepared, sometimes in consultation between Flemish and Zambian
partners, though not always, around October November 2007, i.e. several months
ater the Programme has come to an end.
Document reviewDocument reviewIn preparation or the evaluation, the commission reviewed all available documenta-
tion (both paper documents and electronic documents). Inormation on Zambias higher
education sector as a whole was reviewed as well. In addition, nancial data were
reviewed. An overview o reerences used is provided in Appendix 3 to this report.
InterviewsInterviewsAt the University o Zambia, meetings were held with:
The current and immediate ormer Vice Chancellor
The current and ormer National Coordinator
Current and ormer project leaders rom UNZA and the Flemish universities
The Programme Manager
Former (Ph.D. and M.Sc.) trainees and one student o Computer Studies
Flemish project coordinators and a member o the ICOS at Gent University
In Brussels, the team leader held meetings with sta o VLIR-UOS. Appendix 4
provides inormation on the people with whom interviews were held.
In the interviews a preprepared checklist o questions was utilised as well as open-
ended questions, based on programme documents and internal assessment orms.
-
8/6/2019 IUS Final Evaluation UNZA
10/122
Final Evaluation o the UNZA-IUC partnership
7
evaluatin citia an inicats
In assessing the programme and its constituent projects, the ollowing main criteria
were used:
Development relevance - i.e., as per the OECD Glossary: (the) extent to which
the objectives o a development intervention are consistent with beneciaries re-
quirements, country needs, global priorities and partners and donors policies2
Eectiveness which, according to the OECD 3, reers to (the) extent to which
the development interventions objectives were achieved, or are expected to be
achieved, taking into account their relative importance.
Eciency i.e. the relationship between the objectives and the means used to
reach the objectives or, as per OECD, (a) measure o how economically resourc-
es/inputs (unds, expertise, t ime, etc.) are converted to results4.
Impact which, according to OECD reers to (positive) and negative, pri-
mary and secondary longterm eects produced by a development intervention,
directly or indirect ly, intended or unintended5
Sustainability - or (the) continuation o benets rom a development inter-
vention ater major development assistance has been completed6 (nancial and
institutional sustainability)
Quality was not treated as a separate criterion.
Indicators used include the ollowing:
Relevance extent to which the programme and the projects addressed real
needs and issues outside the academic community; relationship with relevant
development policies
Eectiveness ormulation o objectives and results; outputs realised, and the
quality thereo, and related activities
Eciency unding o the collaboration activities; use made o the unding;
costs and benets o inputs; programme and project (nancial) management
Sustainability - co-unding by the partner university; availability o resources
or continuation o operations and maintenance o physical inrastructure; ca-
pacity to attract new unds through consultancy and research; sta retention;
commitment o Flemish universities to continue the collaboration; continuation
perspectives o ongoing research projects; presence o quality ollow-up plans
Impact (potential) impact at the level o the private sector arming communi-
ties; involvement in providing policy advice, university wide impact, i.e. outside
the departments and centres in which the programme operated; possible new
teaching styles; the extent to which academics, involved in the IUC programme,
are cal led upon by the government or policy advice, etc.
evaluatin limitatins
An evaluation mission o 6 working days to assess a 10-year programme almost 1
year ater it has come to an end is bound to be aected by lack o time to ully grasp the
evolution o the programme and its constituent projects. Moreover, the act that the
evaluation took place almost one year ater the programme has come to an end, made it
dicult at times to determine whether certain accomplishments could be attributed to
2 Glossary o Key Terms in Evaluation and Results Based Management, 2002, page 32.
3 Glossary o Key Terms in Evaluation and Results Based Management, 2002, page 20.4 Glossary o Key Terms in Evaluation and Results Based Management, 2002, page 21.
5 Glossary o Key Terms in Evaluation and Results Based Management, 2002, page 24.
6 Glossary o Key Terms in Evaluation and Results Based Management, 2002, page 36.
-
8/6/2019 IUS Final Evaluation UNZA
11/122
Final Evaluation o the UNZA-IUC partnership
the programme or whether these were due to subsequent interventions.
This situation was urther compounded by the ollowing actors:
The quality o the internal assessment orms proved to be variable; oten they
did not give a clear overview what was done and what was accomplished overthe Programmes lietime. Quality o reporting was aected by an unnecessary
com-plex and not always consistent reporting ormat and the act that additional
orms were embedded in the orms but oten remained unused.
The lack o inormation in the assessment orms required a more substantial
use o other programme documentation, especially the annual progress reports.
In certain instances, especially when report sections were merely copied rom
preceding reports, these reports were not very inormative in terms o providing
clear data on activities carr ied out and results achieved.
Consistent and reliable data on programme unding were dicult to obtain and
although an eort was made, the nal picture on programme unding remains
somewhat blurred.
For several days, the mission coincided with the nal meeting o the Zambian
and Flemish Steering Committees. This limited the time that people could
devote to the evaluation.
While the evaluation commission was also expected to review the ollow up plan o
the programme as elaborated in the sel assessment report, perusal o the available docu-
mentation indicated that there was no such plan, although some o the les contained a
preliminary SWOT analysis. Hence, the evaluation commission is not in a position to
express an opinion.
-
8/6/2019 IUS Final Evaluation UNZA
12/122
Final Evaluation o the UNZA-IUC partnership
Scial - Plitical chaactistics th ecnmy
Zambia became an independent nation in 1964 with a multi-party democracy up to
1972 when it changed to a one-party system o governance. This lasted up to 1991 when
the country reverted to a multi-party system o democratic governance.
The country has an area o 752,614 km 2 and an estimated total population o 10
mil lion (2000 Census). 40% o the population lives in urban areas, making Zambia
one o the most urbanized countries in Sub-Saharan Arica. The population in un-
evenly skewed with children in the age range o 0-14 making up 45% o the population;
women account or 50.7% o the tota l population. The under-ve mortality rate in 2000
was estimated at 202 per 1,000 live births while recent data show that approximately
60% o the children in Zambia are malnourished. Also, the HIV/AIDS pandemic has
dealt a severe blow on the population. According to the National Aids Council Report,
it is estimated that 20% o the population between 15 and 49 is inected, 35% o these are
in urban areas (NAC Strategic Plan, 2002-2005). Lie expectancy by 2000 was estimated
to have dropped to below 40 years compared with 54 years at the end o the 1980s.
Since the mid 1990s, poverty levels continued to increase or the most part. The o-
cial gures indicate a rise rom 69.2% in 1996 to 72.9% in 1998 with only a modest drop
to 67% by 2004. It is estimated that over 80% o Zambians currently live below the pov-
erty line o US$1 a day. The statistics rom the Living Conditions Monitoring Survey o
2006 urther highlight that although overall poverty levels dropped to 64% in 2006, rura l
poverty increased rom 78% to 80% while urban poverty dropped rom 53% to 34%.
Mac - ecnmic Famk
Zambian economy should be evaluated against the backdrop o economic perorm-
ance rom the 1990s. The Zambia Demographic Health Survey (1990 1999) indicates
that the economy grew at 1%, which is the lowest among the SADC countries and
also below the sub-Saharan Arica growth rate o 1.4%. However real GDP grew at
the rate o 2.2% in 1999, 3.6% in 2000, and 4.9% in 2001, but declined to 3.0% in 2002
(Reduction Strategy Paper, 2002-2004). Between 2000 and 2004 the Zambian economy
registered positive real growth at an average o 4.6%. The growth in real GDP in 2007
continued to be positive at a preliminary estimate o 6.2% against the targeted 7%. In
contrast to the fuctuating growth pattern that characterized the 1990s, the economic
growth has so ar been sustained. The only set back is that it is partially being negated
by the population growth rate, which currently stands at 2.7% hence achieving only a
marginal growth in per capita income.
CONTENTS
-
8/6/2019 IUS Final Evaluation UNZA
13/122
Final Evaluation o the UNZA-IUC partnership
7 Support to the Education Sector in Zambia, Phase II, 2005-07, Volume 1, page 15.
An important eature o this growth is that the country has started to see some struc-
tural change as the economy begins to register growth in sectors other than mining.
In particular, recent Government policies have ostered diversied growth in sectors
such as agriculture, tourism and manuacturing which have recorded growth between
2002 and 2004 (2005: Economic Report 2004). In addition, during this period, theGovernment has continued to pursue stringent stabilization policy measures such as
reduction in Government borrowing. These measures have resulted in stability in the
macro environment. As at the end o December 2007 the annual infation gure had
drastical ly dropped to a single digit gure o 8.9%. Similarly, the Kwacha has remained
stable over the past ew years largely to the depreciation o the US Dollar, thereby aid-
ing economic growth.
Overall the perormance o the Zambian economy has picked up momentum ater
2001. Prospects or growth in the coming years look modest as the economy is projected
to continue to grow. The public expenditure on education in general and higher educa-
tion in the context o UNZA should be examined against this background.
Plicy an Stuctu eucatin Systm
Zambias ormal education system currently consists o academic learning at the pri-
mary, secondary and tertiary levels. The primary level comprises lower and upper basic
schools, high schools and tertiary education, which includes teacher training colleges
and universities. This system is currently in transition, being moved rom a 7-5-4 struc-
ture (7 years o primary, 5 o secondary and 4 years o university education) to a 9-3-4
structure (9 years o basic, 3 years o high school and 4 years o university education up
to rst degree).
According to the Ministr y o Education, the total number o educational institutions
di-rectly under its auspices is 5,131 including 4,662 Basic Schools, 353 High Schools,
14 Teacher Training Colleges and 2 public Universities7. Recently, the Mulungushi
University was established in Kabwe, Central Province. There are also a number o
private educational institutions, though some o them could be operating without ull
compliance to the Ministrys regulatory directives. In addition, there are almost 1,900
Community Schools (which provide primary education) and about 500 Interactive
Radio Initiative Centres that provide alternative basic education.
The policy on higher education in Zambia is guided by the national policy on edu-
cation as spelt out in the policy document entitled Educating Our Future (1996). This
document reers inter alia to the importance o increasing access to education and lie
skills training, education management capacity building, policy coordination and the
rationalisation o resource mobilisation and utilisation. The general principles o the
current Government policy on education have their origins in an ever-deteriorating
macroeconomic situation which Zambia experienced since the early 1980s. The decline
in the economy aected all sectors including education. To restore this situation the
government had to resort to severe economic adjustment programmes. The early ad-
justment programmes ailed to shield social sector expenditures and resulted in a sharp
decline in unding or education and health. The scal pressure to curtail nancial
commitments was urther compounded by the rapid population growth at the time.
-
8/6/2019 IUS Final Evaluation UNZA
14/122
-
8/6/2019 IUS Final Evaluation UNZA
15/122
Final Evaluation o the UNZA-IUC partnership
8 Examples are: the National Resources Development College, National Institution or Public Administration (NIPA) and
Agricultural Colleges.9 Report o the Mid-Term Evaluation o the IUC programme at the University o Zambia UNZA, 28 August
6 September 2001, page 12.
High ucatin in Zambia
Higher education presently includes three public universities, i.e. UNZA in Lusaka,
the Copperbelt University (CBU) in Kitwe and the Mulungushi University (MU) in
Kabwe and 14 teacher training colleges under the authority o the Ministry o Education.CBU has our schools, i.e. Business Studies, Environmental Studies, Forestry & Wood
Sciences and Technology and MU nine. There are approximately 150 other colleges
providing post-secondary education and training8. Eorts are underway to convert
some colleges into university colleges. The Government urthermore allowed private
universities to open; one example is the Zambian Open University that was established
in 2004 to allow or expansion o HE enrolment in view o increased demand among
high school graduates.
UNZA, established in 1966, is the biggest university in the country. UNZA has
nine schools, i.e. Agricultural Sciences, Education, Engineering, Humanities & Social
Sciences, Law, Medicine, Mines, Natural Sciences, and Veterinary Medicine and oers
diploma and rst degree as well as postgraduate programmes. The University derives
a major share o its income rom an annual government grant (some 2/3 rd o total in-
come) based on a ormula that involves sta-student ratios, student ees, and income-
generating undertakings. The Universitys rst Strategic Plan, Putting Quality First,
was drawn up or the period 1994-1998, with the aim o reviewing the Universitys
mission, reocusing its objectives, and setting new targets within the overall govern-
ment policy on higher education. According to UNZA in this Strategic Plan, higher
education should:
Provide learning by oering opportunities or advanced education to all suitably
qualied persons without discrimination.
Improve the quality o l ie o the people through relevant research in the identi-
ed areas o need.
Explore a wide variety o higher education provisions or those willing and able
to benet, but unable to participate in regular ul l time programmes.
Advance national development through the applications o learning and
research in the proessions, industry, agriculture, commerce and public lie.
Contribute to the socio-economic growth o the nation through the dissemi-
nation o relevant research ndings and consultancy services.
Foster a network o relationships with tertiary institutions in Zambia and
elsewhere.
Help promote the development o programmes o excellence in national
institutions.
Continue to press or adequate unding rom government while striving to
increase its income rom other sources9.
UNZA embarked on a second ve-year strategic plan entitled Relevance, Excellence
and Accountability or the period 2002-2006. According to this strategic plan, (the)
experiences over the last decade have put great pressures on the operations o the Uni-
versity. Emanating rom these pressures are several internal constraints, which have
maniested themselves in such actors as: decline in the teaching and learning envi-
ronment; reduced research activities; reductions in support to sta development pro-
grammes; and lack o capital development. Some o the consequences o the external ly
generated constraints have been sta exodus rom the University or better job opportu-
-
8/6/2019 IUS Final Evaluation UNZA
16/122
Final Evaluation o the UNZA-IUC partnership
nities both within and outside the country; dilapidation in inrastructure; deterioration
in the student welare; reduction in the procurement o library books and periodicals
and other education materials; signicant reductions in the admission numbers o stu-
dents; and the general decline in the morale o sta10. In addition, the austerity meas-
ures associated with the economic structural adjustment programme or the countryhave created peculiar hardships or the University, and lecturers continue to resign in
search o greener pastures elsewhere11. Unortunately, this is happening at a time when
the country needs high-level manpower to spearhead the eorts in economic recovery,
growth and social development. Measures under the st rategic plan include sta develop-
ment and expansion o student and sta accommodation. The University intends also to
embark on commercial ventures through some o the potential money-earning units to
increase interna l revenue generation. A UNZA building development project was pre-
pared in 2005, i.e. the Building development and management through public-private
partnership at UNZA Great East Road Campus, a conceptual paper o January 2005.
UNZA receives considerable donor unding; the mission was not in a position to
collect the necessary details but understands that this includes inter alia the Netherlands
unded project Triple S project, working amongst others on UNZAs ICT inrastruc-
ture and the project Strengthening HIV-related interventions in Zambia: co-operation
in research and institution capacity bui lding unded by Norway.
10 Strategic Plan 2002-2006, page 4.11 UNZAs Annual Work Programme document o December 2003 states (page 4), as beore, two o the main problems
acing UNZA remain on one hand the insuciency o the allocated budget rom public unding, which barely covers
salaries, and on the other hand the institutions accumulated debt to its retired sta and towards service providers orwater, electricity and telephone. The maintenance o the university inrastructure has suered severely rom this situa-
tion, and the supply o consumables necessary or education, research and other academic activities is somewhat unreli-able. Though UNZA has seen (an) increase in the enrolment o privately- or sel-sponsored students has been adding
a moderate source o complementary income to UNZA, and other sources o income generation are being explored
through contracted public service, consultancy work and joint ventures. UNZA, however, still remains substantiallydependent upon donor-unded projects.
-
8/6/2019 IUS Final Evaluation UNZA
17/122
Final Evaluation o the UNZA-IUC partnership
-
8/6/2019 IUS Final Evaluation UNZA
18/122
Final Evaluation o the UNZA-IUC partnership
Pjct UNZA dpatmnt Flmish Univsity ovall bjctiv Spcifc bjctiv/pups
UNZANET UNZA Computer
Centre
University o Antwerp To improve the quality o
education and research
throughout the university
To make new inormation and
communication technologies
more widely available and acces-
sible to academic sta, studentsand proessional sta in all
schools o the university and to
establish decentralised manage-
ment and administrative systems
Distance Education Department o
Distance Education(DDE)
Vrije Universiteit Brussel To improve the quality, socio-
economic relevance, scopeand accessibility o distance
education oered by UNZA
To build and strengthen the
capacity o the Directorate oDistance Education to deliver its
courses and support services to
distance learners through the
application o inormation andcommunication technologies.
Computer studies School o NaturalSciences
K.U. Leuven To improve the perormanceo the Zambian economy in
both the public and private
sectors through the eec-
tive application o computertechnology
To establish a ully operationalDepartment o Computer Stud-
ies within the School o Natu-
ral Sciences, which will oer
programmes o study at BSc,Postgraduate Diploma and MSc
levels, as well as research and
consultancy services to indus-
trial and administrative agencies
Food Science andTechnology
Food Science andTechnology Depart-ment
University o Gent To provide qualied humanresources or the Zambianood industry and related
institutions
To establish a Department oFood Science and Technologywithin the School o Agricultural
Sciences oering a our-year
training programme
Veterinary Medicine School o Veterinary
Medicine
University o Gent To contribute to increased
livestock productivity and
public health in Zambia.
To improve the practical skills
o vets qualiying rom UNZA by
means o practical and clinicaltraining at the eld station, and
to increase knowledge o helmin-
thology in Zambia
CONTENTS
-
8/6/2019 IUS Final Evaluation UNZA
19/122
Final Evaluation o the UNZA-IUC partnership
12 This component also included unding or common services to the programme under the heading o programme
support (such as costs related to the resident expatriate sta, orwarding and clearing costs o project equipment,insurance and security, etc.).
1
The mid-term evaluation o the Programme in 2001 had raised some issues with
respect to the 2nd phase o the programme. The evaluation called, among others, or a
more institutional approach and a move towards local managerial ownership. In this
regard also the idea to address the needs o the UNZA library was introduced. In
the process o taking up these issues in the 2nd phase o the programme, various mis-
sions were undertaken in 2003, including a visit o the incoming rector o UNZA to
Belgium. In view o constraints aced, and order to allow or an approval o the Annual
Programme (AP) or 2003, a DGDC act-nding mission with participation o VLIR-
UOS was undertaken in August 2003. Areas or immediate action were agreed upon,
and the AP 2003 was approved while the ormulation process o both the partner pro-
gramme as a whole and AP 2004 was nalised. The 2nd phase o the programme com-
prises the ollowing projects:
Pjct UNZA dpatmnt Flmish Univsity ovall bjctiv Spcifc bjctiv/pups
Geology School o Mines University o Gent To improve the perormance
o the mining and environ-
mental sectors through theprovision o better educated
Earth Science graduates,
so that they will make anenhanced contribution to theZambian economy
To improve the quality o educa-
tional, research and consultancy
services oered by the Schoolo Mines
InterdisciplinaryResearch12
Directorate oResearch and Grad-
uate Studies (DRGS)
University o Gent Enhancement o researchcapacity at UNZA
To encourage young researchersat UNZA to carry out applied
interdisciplinary research using
the equipment provided by the
IUC programme
Pjct UNZA dpatmnt Flmish Univsity ovall bjctiv Spcifc bjctiv
Computer Centre and
Library
Computer Centre;
Library
University o Antwerp The quality o education,
research and management at
UNZA has improved
The library becomes aNational Resource Centre
Ecient ICT services are provid-
ed in the University community
The library acquires equipment
or access as well as securityand purchases books to meet
the demand
Distance Education DDE Vrije Universiteit Brussel To improve the quality, socio-
economic relevance, scope
and accessibility o distance
education by UNZA
Build and strengthen the capaci-
ty o the directorate to deliver its
courses and support the services
to distance learners through theapplication o ICT
Establishment o a
programme in com-puter studies
School o Natural
Sciences
K.U. Leuven Deciency o computer
experts on the labour marketis reduced
The Department o Computer
Studies us ully operational
Establishment o aB.Sc. (M.Sc.) pro-
gramme in Food
Science and
Technology
Food Science andTechnology Depart-
ment
Ghent University Develop basic and appliedresearch relevant to the
development o the ood in-
dustry in Zambia, thus creat-
ing ood security
Contribute to ood security byenhancing agro-processing and
preservation methods in col-
laboration with local and interna-
tional stakeholders
Consolidation o ac-
tivities in School oVeterinary Medicine
School o Veterinary
Medicine
Ghent University Productivity o livestock in
Zambia has increased andpublic health is improved
Research capacity o veterinary
school concerning relevantveterinary issues in Zambia is
enhanced and appropriate inor-
mation on important veterinary
issues in Zambia is available toextension services
-
8/6/2019 IUS Final Evaluation UNZA
20/122
Final Evaluation o the UNZA-IUC partnership
17
Pjct UNZA dpatmnt Flmish Univsity ovall bjctiv Spcifc bjctiv/pups
Geology and Soil
Science
School o Mines and
School o Agricul-
tural Sciences,
Ghent University Contribution o small scale
mining and agriculture
industries to rural povertyalleviation and sustainable
economic development o
rural areas
Provision o sustainable quality
human resources, technical and
analytical services to small scalemining and agriculture people
Interdisciplinary
Research
Directorate o
Research and Gradu-
ate Studies (DRGS)
Ghent University To strengthen the scientic
renown o UNZA both in the
international academic com-munity and in the Zambian
public and private sector
To successully complete inter-
disciplinary research projects
and to disseminate the resultsin international journals, coner-
ences and workshops
-
8/6/2019 IUS Final Evaluation UNZA
21/122
Final Evaluation o the UNZA-IUC partnership
1
-
8/6/2019 IUS Final Evaluation UNZA
22/122
1
Final Evaluation o the UNZA-IUC partnership
13 AP 2000, page 74.14 According to the Phase II Partner Programme document, the specic objective reads as Ecient ICT services areprovided to the University community (academic and administrative sta and students (page 28).
15 According to the mid-term evaluation report: It is understood that the proposal to include the central managementand administration o the university in this component was abandoned. It is thereore unclear whether or not it has been
eective in decentralising these unctions.
16 On page 51 o the Phase II Programme document, overall objective and specic objective are ormulated somewhatdierently.
17 Phase II Programme document, page 45. Page 51 and 52 o this document do not include the last two intermediate
results.
Intuctin
The original UNZANET project was an extension to the campus wide bre optic
network that had been set up with support rom the Netherlands (i.e. the Computers
or Academics, Management and Administrative Support (CAMAS) project) and
CIDA and had been operational as o 1996. The UNZANET project was to support
the new Computer Centre, tasked to provide hardware and sotware support services to
the university community as well as consultancy services and training in IT, hardware,
sotware, networks, systems development and communication or internal and externa l
clients. The project was to contribute towards the urther development o an integrated
computer network o the University, which would, in turn, contribute towards an
eective improvement o the quality o education and research throughout the univer-
sity. It will also lead to a decentrali sed management and administrative system or the
institution..13. Specic objectives o the 1st phase o the UNZANET project were as
ollows14:
To develop an integrated internal computer network encompassing all aculties
o the university.
To establish a decentralised management and administration system or the
university15.
To improve the quality o education and research by making IT more widely
available to academic sta and students.
In order to allow more cooperation and interdisciplinary research among the dier-
ent UNZA departments, and because o the mission shared with the Computer Centre
o servicing the entire university community, it was agreed in 2001 to introduce a joint
Computer Centre and Library project in the 2nd phase. Overall objective o this new
project reads as (the) quality o Education, Research and Management at UNZA is im-
proved by making use o ICT and its specic objective as Ecient ICT services are
provided to the University Community which includes Academics, Administrative sta
and Students16. Intermediate results or the second phase are ormulated as ollows17:
(a) Through-put o the Network is increased; (b) Security on the Network has im-
proved; (c) Competent and qualied computer sta is available at the Computer Centre;
(d) Dissemination o Research results; (e) Formulation o sustainability mechanisms.
As ar as the library is concerned, the overall objective reads as (the) quality o in-
ormation service delivery to support teaching, research and public service is improved,
its specic objective as (ecient) library service responsive to specic needs o the
user community (teaching/research sta and students o the University) is provided.
Intermediate results enumerated or the library component are: (a) Up-to date inorma-
CONTENTS
-
8/6/2019 IUS Final Evaluation UNZA
23/122
Final Evaluation o the UNZA-IUC partnership
18 I.e. 280 computers (o which 100 or students and 180 distributed across the schools), 25 printers, 10 copiers and
10 scanners or teaching and research, radio links or the School o Medicine and the Institute or Economic and Social
Research (INESOR),19 Interesting observations are made in the mid-term evaluation report on this: UNZANET could, in theory, become a
commercial venture i the need arose, but this would detract rom the original philosophy or establishing it. It wouldorce it to charge the university or every hour used on university services, including teaching, at a cost the university
would not be able to aord.
20 Annual report 2003, page 7.21 Annual programme 2004, page 15.
22 According to the Kort verslag van de Vlaamse begeleidingscommissie UNZA, Gent o 24 September 2003,
the project would pay or the installation o the satelite dish ( 10,000) and subscription costs (24.000) or 2003.Project contributions to the subscription costs would decline to 18,000, 12,000 and 6,000 or subsequent years.2
tion resources needed or teaching, learning and research are provided; (b) Access to
electronic publications is achieved; (c) Security o Inormation resources is enhanced;
(d) Existing library management system is upgraded; (e) Sta capacity is built
ralisatins: Cmput Cnt
Computer inrast ructure & bandwidthComputer inrast ructure & bandwidthUp to 2001, improvement o inrastructure nanced under the project included the
provision o IT hardware18 and sotware and literature. In subsequent years, project pro-
visions included a new PABX, cabling o the engineering bui lding, School o Medicine
and INESOR, reurbishment o the library basement as a computer lab or students,
installation o security bars and alarm systems, the provision o air conditioners or
computer labs and a 4x4 vehicle. A mail server was urthermore procured in the course
o AP-2004 and two more servers were procured under AP 2006.
The mid-term evaluation o 2001 identied that UNZANET had a major problem
with the bandwidth, the unreliability o the services urnished by the Internet Service
Provider (ISP), i.e. ZAMNET, and with inter-campus connectivity. Moreover, at the
time, access to Internet was limited by the lack o computers in the University.
From AP-2002 onwards, project activities thereore ocused on dealing with the
bandwidth issue between ZAMNET, which is a private company ully owned by the
University19, and UNZA. ZAMNET could not cope with the increase in Internet trac
both inside and outside the University; though negotiations were held, UNZA, being
just one o ZAMNETs customers, was not given priority and the report on AP-2003
observed that while the University had good equipment to cater or large bandwidth
the ISP could not provide the required bandwidth and access and reliability problems
persisted.
In the course o AP-2002, radios to improve bandwidth were received and insta lled,
though with delays due to late delivery, the need to replace broken radios and the need
to undertake additional civil works. The Computer Centre nal ly opted or a solution
where the University has direct links with a satellite or its downward requirement and
goes through ZAMNET or its uplink connectivity20. It was also agreed that payment
or this set up would be on a cost sharing basis, with VLIR paying the ul l amount or
the rst year and UNZA progressively meeting the cost on sharing basis with 25%, 50%
and 75% o the amount being paid by UNZA21. In 2003, the project met the costs o
increased bandwidth by reallocating some unds rom the Library component, one rea-
son being that library sta was slow in articulating its requirements. However, imple-
mentation (i.e. purchase and installation o a satellite dish, VSAT) met with considerable
delays and was only realised in the 1st quarter o 200422.
In 2004, only minor improvements were realised: the download speed increased
rom 128kbps to 512kbps, while or the uplink remained the same at 128kbps. While
already in the course o AP-2004, it was recognised that bandwidth management tools
were needed to monitor and manage this bandwidth, only during AP-2005 did UNZA
-
8/6/2019 IUS Final Evaluation UNZA
24/122
Final Evaluation o the UNZA-IUC partnership
23 Annual report 2005, page 8:24 Annual programme 2005, page 925 Aim o this project is to improve the Management Inormation Systems o the University o Zambia. One o the com-
ponents o the project to improve the ICT inrastructure and includes replacement o all hubs and D-link switches at thecentre o the network would be replaced by the CISCO switches and router.
26 Annual report 2006, Page 10.
21
management (procure) a bandwidth management tool23 however this was not in-
stalled and according to the selassessment report, there is still no bandwidth monitor-
ing sotware in place. An additional problem was that many computers still had only
a 10mbits network card installed. To urther improve connectivity, it was decided to
replace the hubs across the campus wide network and D-link switches. However, therouter that was oreseen was not bought (or its delivery delayed) and while AP-2005 saw
replacement o some hubs by switches, the router at the centre remained the same, op-
erating at 10Mbits only, and network access speed problems persisted. Moreover, (ater)
the installation o the VSAT it was discovered that the type o servers the Computer
Centre had were o low capacity and could not handle the kind o internet trac that
was passing through the new VSAT whilst perorming other services such as WEB
services, PROXY, DNS, EMAIL DHCP etc.24. The situation was urther compounded
by problems with the DNS server.
Another issue concerned network saety and perormance; according to the progress
report on AP-2002, (sotware) to monitor network perormance was identied, and
bought in Belgium but not installed; the reasons or this are unknown. The situation
remained unchanged in 2003 and only in 2004 was network saety addressed through
installation o anti-SPAM and anti-virus sotware.
In the course o AP-2006, activities ocused on the replacement o the remaining
hubs with D-link switches and the replacement o the router. During the same pe-
riod UNZA initiated the Netherlands unded Triple S project 25 (unded rom the
Netherlands NPT programme). To avoid duplication o eorts , it was agreed that in-
stead o purchasing D-link switches the project would nance two servers that host the
administrative systems such as Students Records Systems and a DNS server, which had
been giving problems during student registration and Internet access26.
Despite the eorts made, the network continued to be slow, though security had
improved by the end o the projects lietime.
Since then, the situation seems to have improved urther as indicated in the inter-
nal assessment report: Down time: Currently System non-availability is approximately
10%; Response Time: Response time less than a second; Number o users: increase
rom approximately 900 to 1,800 users at present; Network through-put: increase rom
512 Kbps (downlink) 28 Kpbs uplink to current 7MB downlink 1MB uplink; Network
Security: Had approximately ve intrusions in the system, reduced to zero with the in-
stallation o a Fire Wall.Sta interviewed acknowledged that there had been improve-
ments in the computer services and Internet availabil ity but continued to express a lack
in condence in the system (an indicator being the continued use o yahoo and g-mail
accounts rather than University e-mail accounts).
Servicing o equipment is reported to have been an ongoing aair since 2002; in
AP-2003, a number o spares were urthermore bought to repair malunctioning equip-
ment in the basement as well as other areas within the University.
-
8/6/2019 IUS Final Evaluation UNZA
25/122
Final Evaluation o the UNZA-IUC partnership
27 Annual report 2004, page 8
22
Capacity building - Competent and qualiied ICT sta isCapacity building - Competent and qualiied ICT sta isavailable at the Computer Centreavailable at the Computer CentreSta training activities have included the ollowing:
During phase 1, three engineers attended network training in Antwerp and an-
other attended a workshop in South Arica. Training was also organised or theDirector o the Computer Centre in management and leadership.
During AP-2002, three sta were sponsored to attend to the CISCO programme
at the Department o Computer Studies while two sta attended a course on the
making and repair o Power Surge Protectors and UPSs
During AP-2003, three sta were sponsored to attend the CISCO programme
while two sta par ticipated in training on 2003 server and windows XP.
AP-2004 saw two sta trained in LINUX at Intoweb Training Centre in
South Arica (March 2005) and three sta trained in a LINUX tailored course
suitable or the UNZA network solutions that was oered by ZAMNET in
January 2005. In addition, the Zambian Project leader attended two workshops
on Open source and Internet security organised by INWENT or Inormation
Technology in Arican Business, a SADAC ICT network (Johannesburg (August
- September, 2004) and Mozambique (November 2004))
During AP-2005, one sta was sent on a M.Sc. programme while another sta
member went or a CISCO train ing locally. In 2006, since the Master student did
not perorm, and programme rules do not allow a student to repeat, a tailored
programme in networking was arranged instead.
According to the selassessment report, the Centre still does not have sta with
expertise in certain ICT elds, particularly networking. Moreover, according to inter-
viewees at the Computer Centre, some o the training received in Flanders may well
have been too theoretical and has been dicult to use in practice.
While a number o sta were trained in various ICT elds, insucient attention has
been paid to the issues o sta retention and motivation; two network engineers trained
already obtained more lucrative employment outside UNZA. This issue was already
highlighted in the mid-term evaluation report o 2001, which also stressed the impor-
tance o constant training to keep up with new developments in the ICT world and
recommended that (discussions) are held with the university administration with the
aim o creating enhanced conditions o employment or specialist IT sta to ensure that
adequate sta to run the Computer Centre can be recruited and retained. The remarks
made in 2001 remain valid to date.
ResearchResearchWhile the intention was to (carry) out research activities that will direct the
University in the direction o e-learning to attract more students, this will be in col-
laboration with both Computer studies and Distance education it is understood that
some research on e-learning was undertaken by the then Project leader o the project
and another sta member o the Computer Centre. However, the research ndings
were not presented during any o the two conerences on interdisciplinary research.
-
8/6/2019 IUS Final Evaluation UNZA
26/122
Final Evaluation o the UNZA-IUC partnership
28 Annual report 2002, page 12: Owing to budget shits or the Library Project (rom 90,000 EUR to 62,500 EUR
to 30,000 and nally ending at 21,000) it became virtually impossible or the Library to implement most o theactivities planned or the year 2002.
29 Annual report 2002, Page 12. Despite the electronic surveillance contract with Pre-Secure Security Ltd ( 2,000), apc and monitor were stolen in AP 2004.
30 2005 Annual report, page 11.
31 In 1995 the Library installed a good automated library management system called Dynix. Both the library sotwareand hardware were paid or by FINNIDA. With FINIDAs support UNZA Library was also able to solicit and achieve
complete retrospective record conversion o its entire manual card catalogue. Although the Library was able to pay or,
and install, all the modules o the Dynix system (Cataloguing, Circulation, Online Public Access Catalogue (OPAC),Serials management, Short Loan Collection etc.), UNZA Library has not beneted rom sotware upgrades due to our
non-renewal o sotware maintenance licence. This will be achieved in AP2003.
32 Annual report 2004, page 12.
2
ralisatins Libay
Procurement o booksProcurement o booksBook purchases under AP-2002 were cancelled due to budget reductions with
more money going to the Computer Centre than originally planned28
. In 2003-2004,books were purchased or a limited amount ( 5,000). In 2005, books were purchased
rom Mallory International Limited (GBP 6,266.65) and Universal Education and
Inormation Services (GBP 6,324.27). In 2006, though it was oreseen to purchase
books rom Mallory International Limited, due to problems, the books were never
purchased.
Access to electronic publicationsAccess to electronic publicationsOver the lietime o the project, the ollowing investments were made in ICT: 4 Dell
Dimension 8250 PCs, 5 ASUS PCs and 1 laptop; subscription to CD-ROM databases
(AP-2002); devise Server, 19 PCs, 1 network copier/printer, 1 oce printer, 19 com-
puter tables and chairs as well as other items (Norton anti-virus sotware or single user,
3 (24-port) and 5 (8-port) network switches) (AP-2004); LCD projector, heavy duty col-
our printer and photocopier (AP-2005); additional server and a power generator (ZMK
67,773,000.00) (AP-2006).
SecuritySecurityProcurement o an electronic book detection system was not undertaken in AP-2002
due to insucient unds but an emergency lighting system was bought and installed,
Security related activities in AP-2003 included maintenance o the surveillance system
and construction o security grille ence around the CD-ROM area and o a burglar
proo deck (February 2004). According to the 2002 Annual report, (the) main activi-
ties in the Library Project .. have been the improvement o security provided by a lo-
cal security rm A major impact o this activity has resulted in zero break-ins29.
Contracting o the security company (Rapid Security Intervention System) continued
up to 31 March 2006 when the university started paying or the service30.
Upgrading Library Management systemUpgrading Library Management systemFunding was provided or an upgrade o the Dynix Sotware31 and or a Dynix one-
year maintenance renewal in AP-2004 since the system support maintenance had been
put on maintenance hold. This had put the Library in an awkward situation whereby
the numerous system errors being experienced cannot be attended to32.
Library sta trainingLibrary sta trainingThe Dynix related training that was oreseen or AP-2002 did not take place due
to some uncertainty regarding the uture o Dynix. Again, in 2003, this training was
not done because o the possibility o migrating to a windows based library system as
-
8/6/2019 IUS Final Evaluation UNZA
27/122
Final Evaluation o the UNZA-IUC partnership
33 Annual report 2003, page 19.
34 The sel-assessment o the library in this respect repors: the twining o the Library and the Computer Centre under
one project was not healthy or the Library. The Computer Centre had undue advantage as the ormer Computer CentreDirector occupied a prominent role in the VLIR Project and infuenced decisions to benet his unit. Frequently some o
the unds allocated to the Library were reallocated to the Computer Centre to meet the needs o the latter which wereelt to be o the highest priority by the Vice Chancellor. This resulted into the Library ailing to meet some o the objec-
tives in the Project (2008 Sel-Assessment project 1.2 Library).
24
recently advised by the Dynix sotware vendors33. In AP-2005 it was planned to send a
sta member or training to the UK; however the library was advised to send two sta
or training at Universal Knowledge System (UKS) in South Arica. Training o one
Ph.D. was originally oreseen; the Ph.D. scholarship was, however, cancelled during
AP-2003, although some expenditure (travel o candidate to Belgium) had already beenincurred. The sta member concerned managed, nevertheless, to complete his Ph.D.,
though without programme support, except or nancing o t ravel and subsistence cost
or his thesis deence in Belgium.
Assssmnt
RelevanceRelevanceThere is no doubt that in todays world, in order to be able to eectively and e-
ciently provide teaching, learning, research and services, and to communicate with
the outside (academic) world, a university requires adequate, reliable and sae access to
Internet as the inormation highway. Similarly, a proper unctioning o the University
library is a prerequisite or the academic community to undertake its tasks o teaching,
research and community services. The project is hence extremely relevant.
EectivenessEectivenessAt the time o project closure (March 2007), the network was still unreliable and
unable to cope with increased Internet trac. The situation has improved considerably
since then, not in the least, because o supplementary intervention o another donor (the
Netherlands), which built on what was real ised under the project. Though sta tra ining
was undertaken, it has been less than originally oreseen. Sta development alls still
short in some key areas, particularly network management and urther sta develop-
ment will be needed to be able to keep the Centre operational. No research was under-
taken as originally envisaged. Due to repeated cuts in the budget or the library compo-
nent , the project has real ised its original objectives only to a limited extent.
EiciencyEiciencyEciency o project implementation was aected by slow decision-making on the
side o University management on how the ICT system should be designed, coupled
with uncertainties on the most appropriate (and aordable) technical approach to be
ollowed and the technical choices to be made. According to the current director o the
Computer Centre, eciency was also aected by the act that neither the Flemish nor
the UNZA project leaders had a background in networking. The delivery o computers
through the Close the Gap initiative met with considerable delays; moreover, UNZA
was said to be unlucky as regards the quality o the computers provided. Instability
in the Librarians oce also aected project implementation o the Project, with local
leadership changing six times during the projects lietime. Several exchange visits were
made by the Zambian and Flemish project leaders; an ICT steering committee was set
up at one point in time which was supposed to be an Advisory Unit on ICT matters at
UNZA. However, the reports available shed no urther l ight on this topic.
-
8/6/2019 IUS Final Evaluation UNZA
28/122
Final Evaluation o the UNZA-IUC partnership
35 Only 71 positions out o 140 established positions are lled.
2
ImpactImpactIt is only recently that the network unction at UNZA has improved and appreci-
ated. However, the actual impact o ast and reliable access to Internet on the quality
o the Universitys teaching and research provision remains to be seen. Facilities at the
library have improved though the building itsel is urgently requiring rehabilitation;however, access to electronic databases was only improved ater the computer network
started to unction properly.
SustainabilitySustainabilityThe Computer Centre is currently seriously understaed and receives minimal
nancial support (other than salaries) rom central administration. The existing sta is
currently 25 technical personnel, o whom 3 hold an M.Sc, 6 a B.Sc,, and 16 the equiva-
lent o a diploma. Despite the available provision or 9 sta or network services and 14
or systems development, there are only 6 network engineers, including the Director o
the Centre. With greener pastures outside the University, this implies a considerable
risk. To enhance sustainability, more sta ought to have been trained than has been the
case.
The nancial situation o the Computer Centre is compounded by the low student
ees charged and the act that income earning activities (e.g. training on LAN manage-
ment, UNIX, Word Processing) are not yet sucient developed to generate enough
prot which can serve to recruit and retain enough qualied IT sta and to replace the
available equipment. At the same time, and this is contrary to the past, it is understood
that UNZA management now realises the importance o ICT and has increasingly em-
braced ICT as a major aspect o training and research at the institution and has taken
over the nancing o the increased bandwidth.
Despite these more positive signs, the mission endorses the recommendation made
in the mid-term evaluation report o 2001 that (a) business unit is set up to record all the
income and expenditure related to commercial IT services provided by the Computer
Centre, to develop new services and to maximise the income rom these .... It is hoped
that the orthcoming ICT policy, which is in its nal drat, together with a new pro-
posal to restructure the Computer Centre, coupled with the proposed sta retention
strategy, which is currently with UNZA management or decision making, wil l be able
to address the above concerns.
Issues observed with respect to sustainability o the library are: (a) the lack o senior
library sta35 and (b) the state o the library building, acing considerable leakage during
the rainy season which may well threaten both the equipment installed and the librarys
collection o books, journals and magazines. The Mission learnt urthermore that
the library receives only ZMK 15 Million (the equivalent o 2,700) per month rom
Central Administration or its operations.
-
8/6/2019 IUS Final Evaluation UNZA
29/122
Final Evaluation o the UNZA-IUC partnership
-
8/6/2019 IUS Final Evaluation UNZA
30/122
Final Evaluation o the UNZA-IUC partnership
Intuctin
For the 1st phase o the Programme, the project aimed to improve the quality, socio-
economic relevance, scope and accessibility o distance education oered by UNZA.
The immediate objective mentioned in the interim-evaluation mission report reads
as (to) build and strengthen the capacity o the Directorate o Distance Education to
deliver its courses and support services to distance learners through the application o
inormation and communication technologies. Intended outputs or this phase were
(a) Improved inrastructure and systems or distance education; (b) Enhanced quality o
distance education and (c) Increased number o courses and distance students. For the
2nd phase, the overall objective was (to) improve the quality, socio-economic relevance,
scope and accessibility o distance education oered by UNZA. The specic objective
reads as (to) build and strengthen the capacity o the Directorate o Distance Education
(DDE) to deliver high quality courses and support services to distance learners through
the application o inormation and communication technologies. The envisaged inter-
mediate results or this phase were the ollowing:
Availability o trained and motivated sta or programme implementation
A wider range o quality programmes and courses oered by distance learning
Increased access to University programmes o study
Improved quality o course materials
Administrative/Management system automated and improved
Improved student support system
Inrastructure enhanced
Operation o DDE sustainable at the end o the project
ralisatins
Capacity Bui lding /sta developmentCapacity Bui lding /sta developmentDuring the 1st phase o the programme, the ollowing training activities were
undertaken:
one sta member ollowed an M.Sc. in Educational Research in Belgium
one sta registered on a Ph.D. programme at UNZA with joint supervision rom
the Belgian project leader
two sta enrolled on postgraduate diploma courses in Distance Education at
UNISA in South Arica
Furthermore, 15 sta members were trained in computer skills and Instruc-
tional Design to produce course materia ls on computers, and computer training
o UNZA Regional Ocers.
CONTENTS
-
8/6/2019 IUS Final Evaluation UNZA
31/122
Final Evaluation o the UNZA-IUC partnership
AP-2003 and AP-2004 saw some upsurge in training activities, including:
workshops or lecturers in ICT, instructional design, student monitoring, and
tutoring planned or 2002 but postponed to August 2003 due to unoreseen
changes in the University o Zambia academic calendar as a result o closures
Training o DDE sta in the use o ICT or distance education management
Training o Resident Tutors and their Secretaries in computer usage, general
principles o distance education, student support and use o the new system
Training o lecturers in basic computer skills
Training o one DDE sta in advanced computer usage and simple basic pro-
gramme and hardware maintenance.
Furthermore, in the course o AP-2003, one sta member completed the post gradu-
ate diploma in distance education with UNISA while another continued into 2004
but could not complete the training because UNISA discontinued the programme.
Training undertaken in the last two years o the project included:
One sta member participated in training in the Production o Audio Visual
learning materia l at K.U. Leuven
Two sta were trained in Basic Computer Repair and Maintenance (March
2005)
a sensitisation workshop was held on the use o ICT in education or principal
ocers o UNZA (March 2006)
A ToT workshop on the use o ICT in education was held in March 2006
Sta training in Inormation and Communications Technology (March 2007)
A 2-day training workshop or resident tutors (March 2007) on PC and Internet
basics.
The Ph.D. candidate went through several supervisors and Ph.D. proposals, under-
took a mission to Brussels in 2004 and 2005 and submitted his thesis during AP-2006.
He was subsequently appointed as Director DDE and, more recently, as head o UNZAs
library. A second Ph.D. training that was originally oreseen was not implemented;
though training was considered important, it proved dicult to nd the right people
or this level o education.
A wider range o qualit y programmes and courses oeredA wider range o qualit y programmes and courses oeredby distance learningby distance learningDuring the lietime o the project, the number o distance education programmes
oered increased rom three to six, i.e. B.A. o Arts (B.A), B.A. o Arts with Education
(B.A. Ed.); B.A. o primary education; B.A. o special education, and B.A. o Arts with
Library and Inormation Studies. These remain, however, incomplete programmes as
3rd and 4th year courses (which were discontinued already in the early 1980s), which
would have allowed or a ul ly parallel distance higher education programme, were not
developed as originally intended. Some course materials were re-written in ormats that
were more appropriate or distance learning.
The mission is not a position to judge the quality o the content o the learning
materials and the quality o their delivery, which are the responsibility o academic sta
outside DDE but are clearly undamental to the eectiveness o any distance education
programme.
-
8/6/2019 IUS Final Evaluation UNZA
32/122
Final Evaluation o the UNZA-IUC partnership
36 Mansa (4); Kitwe (4); Livingstone (4); Chipata (3); Mongu (3); Kabwe (3); Solwezi (3); and Kasama (3). 10 comput-ers were allocated to Choma Secondary School.
Increased access to University programmes o studyIncreased access to University programmes o studyThe available data (see the table below) indicate that distance student enrolment
increased rom 386 in 1996/1997 to 1,606 by 2006/2007 and 1,743 in 2007/2008.
Ya enlmnt Ya enlmnt1996/1997 386 2002/2003 888
1997/1998 314 2003/2004 841
1998/1999 371 2004/2005 1,165
1999/2000 444 2005/2006 1,612
2000/2001 635 2006/2007 1,606
2001/2002 586 2007/2008 1,743
The project acilitated this increase by improvement o the student management sys-
tems; however, it seems to have done little in actual ly promoting this increase. Distance
education students account or some 14-15% o total enrolment at UNZA; close to 50%
o the distance education students are women.
To ease access the payment plan system was modied to allow students to pay their
ees in ve instalments instead o three, which had proven dicult or many sel-spon-
sored students.
Enhancement o inrastructureEnhancement o inrastructureMain activities during the 1st phase o the project were:
the provision o hardware and sotware or the production o course materials
and the administration o distance students
improvements to DDE central and remote premises; this included the reparti-
tioning o DDE oces, the provision o urniture, lighting and security systems
and air conditioner or the computer room and o documentation and books.
the provision o IT equipment or DDE central and remote premises.
To enhance the available inrastructure, the 2nd phase included purchases o inter alia
ICT equipment (laptop or Ph.D. candidate, fat screen PCs (AP-2005), memory sticks,
etc.), reproduction acilities or provincial centres (such as computers, printers, scanners,
etc), an electric stapler, video camera and accessories, LCD projector and consumables
or heavy duty photocopier (drum units). During AP-2006, a Close the Gap (CTG)
initiative proposal, initiated by DDE together with the Nkrumah Teachers Training
College, was approved by VLIR-UOS and 200 computers were provided. 25 PCs were
reserved or DDEs Computer room, and the Registry and Course Materials sections
and 27 were allocated to provincial centres36. Project unding was urthermore provided
or the maintenance o three heavy-duty photocopiers rom AP-2004 onwards. The
project urthermore paid or the maintenance o computers and printers in both DDE
and Provincial Centres.
While some books were acquired in 2001, books and journals were not bought in
2002 and 2003, instead unds were used or buying stationary or the production o
course materials. Books and journa ls on distance education were ordered in Belgium
in the course o AP-2004.
-
8/6/2019 IUS Final Evaluation UNZA
33/122
Final Evaluation o the UNZA-IUC partnership
37 2006 Annual report, page 14.
38 I.e. Kitwe, Livingstone, Choma, Chipata, Mongu, Mansa and Kasama.
39 During AP-2001, PCs were installed or the Assistant Registrar o DDE, as well as 7 provincial centres and; theprovincial centres were also connected to Internet
40 I.e. Kitwe, Livingstone, Choma, Chipata, Mongu, Mansa, Kasama, Kabwe and Solwezi. During AP-2003, two new
computers installed at Kabwe and Solwezi centres.41 The 2003 Annual Report observes in this respect: The internet connectivity or all the provincial centres, which we
had hoped would be achieved, was not done due to operational problems on the part o service providers. Incidentally,the same problem aects the intra-network services at the university (Annual report 2003, page 17).
42 Annual report 2005, page 15.
43 2004 report, page 15
Improved course qualit yImproved course qualit yImplementation o the project saw a gradual increase o the materials developed and
typed on computer and stored electronically, rom 50% o the courses in AP-2002, to
60% in AP-2003, 80% in AP-2004 and 95% at present, a painstaking process because o
the high rate o sta turnover. The write-up continued unti l the end o the project asnew courses were being introduced. Support or the development o course materials
was provided throughout the projects lietime, amongst others through the provision
o computers or lecturers in DDEs course materia ls section. According to the Annual
report on 2006, (an) e-learning environment (DOKEOS) was installed on the DDE
Server and can be accessed... (to) register and create courses, enrol students etc. There
is, however, need to organize a ToT workshop on how to use the learning environ-
ment. This could not be done during the reporting period37. All in al l, improved course
quality is to be seen in terms o lay-out and use o house style and the availability o
materials on computer.
Improved student support systemImproved student support systemThe intention was to connect eight (later nine) provincial centres to the UNZAcomputer network and that provincial sta and students would use these acilities to
communicate with DDE.
According to the report on AP-2001, seven provincial centres38 with computers had
Internet connection39, with some doing better than others in terms o connectivity. By
the end o AP-2003 all nine provincial centres40 with computers had Internet connec-
tivity. However, the communication system did not work - both at the centres and at
UNZA41. As o AP-2002, the project thereore agreed to pay telephone and internet
bills to a llow provincial centres that were previously disconnected to be reconnected in
the course o AP-2004. Payment o telephone and Internet bill s continued into AP-2005
as well as AP-2006. However, in 2005, since the centres, because o poor telephone
connectivity (dial-up), made very l ittle use o these services despite incurring monthly
xed charges it was decided that ZAMNET temporarily disconnects the centres42.
As part o the eorts to enhance the student support system, the intention was to
appoint student support ocers who would be working under DDE in the provincial
centres. These would be working in parallel with the tutors or provincial resident
lecturers that are working in these centres - but come under the aegis o UNZAs adult
education department.
Up to AP-2003, the (conditions) or Student Support Service Ocers were not
worked out because o the general university restructuring exercise and recruitment
and training o the ocers did not take place as planned. The project had to wait till
AP-2004 to learn that UNZA management did not support the recruitment o these
ocers as it was considered a duplication. It was pointed out that the already established
Resident Lecturers oces in all the provinces could perorm distance education activi-
ties and that Resident Lecturers would be given new job descriptions to incorporate the
distance education component as part o their normal duties43.
-
8/6/2019 IUS Final Evaluation UNZA
34/122
Final Evaluation o the UNZA-IUC partnership
44 Annual Report 2006, page 14.45 Annual report 2001, page 9. Similar observations are made in the Annual report 2004: However, to ascertain the
overall perormance o the programme, there will be need or more systematic assessment, evaluation and monitoring
(page 17).
Admin istrative/Management system automated andAdmin istrative/Management system automated andimprovedimprovedA computerised management inormation system containing student records, details
o courses, etc. was established during the 1st phase o the project. Intention was that,
with this system in place, DDE would be able to cope with increased numbers o stu-dents and courses. In AP-2001, a prototype was tested, the student record management
expanded and rened and a new version o student records developed. The development
process continued into AP-2002 when some training was held or DDE sta in record
management.
AP-2003 saw the continuation o ll ing the system with data on students, lecturers,
courses, etc.; this exercise continued also into AP-2004 and AP-2005. According to the
2006 Annual report, (the) Student Management System is running .. There is a need
to upgrade the system to allow importing rom the Student Registration System (SRS).
Furthermore, there is need or DOKEOS and the SRS to operate in an integrated man-
ner44. At the same time, the internal assessment report observes that a (template) o the
prototype (was) developed but not util ised as a separate system. DDE continued to rely
on the UNZA system, which has some aspects o the prototype. The Mission under-
stands that there is an issue o lack o compatibility between the DDE system and the
general student administration system.
Assssmnt
RelevanceRelevanceDistance education - which is oten second chance education with a large number o
students being teachers going or a higher degree - allows the Zambian higher education
system to expand enrolment, however without overburdening the rather limited higher
education institutions. However, til l now, it only covers, and only or some disciplines,
the rst two years o higher education, ollowing which students have to continue their
higher education as regular students at UNZA in Lusaka.
EectivenessEectivenessThe main purpose o the 1st phase was to build and strengthen the capacity o DDE
to deliver its courses and support services to distance learners through the application
o inormation and communication technologies. Also in the 2nd phase, the main em-
phasis was on the provision o distance education inrastructure and management tools,
as well as sta development, mainly at technical level through training in the use o
ICT. According to the interviewees, 25 out o the 100 teaching sta involved in distance
education have started to use a dierent approach to distance education. The Ph.D.
holder, who graduated in the eld o distance education in Zambia, is at the same time
no longer working in DDE.
To a certain extent, the eorts made have provided the requisite environment or
the increase in the number o students pursuing their degree programmes through dis-
tance education. There is also some evidence o improved management as a result o
the development o new procedures and skill s, and the introduction o a computerised
management inormation system and sta capacity to manage a larger number o dis-
tance education students by making use o this system. There nevertheless remains need
or more systematic assessment, evaluation and monitoring45.
-
8/6/2019 IUS Final Evaluation UNZA
35/122
Final Evaluation o the UNZA-IUC partnership
46 Annual report 2006, page 1647 Annual report 2006, page 15-16.
2
Other remaining key issues are the ollowing:
the quality o the contents o the distance education provision - which was not
really tackled though the quality o course materials (in print) has improved in
terms o layout ollowing the introduction o a house style
the act that UNZA has no institutional policy on distance education dening
roles, responsibilities, priorities and accountabilities with regard to the govern-
ance structure, management, teaching, leaner support and stang.
EiciencyEiciencyRelatively requent missions were undertaken by the Flemish project leader
(2003-2007), who played a key role in getting the ICT operational with return visits un-
dertaken by the Zambian project leader in 2004 and 2005. The presence o the Flemish
expert was essentia l to get things done.
The mid-term evaluation mission urthermore reported on a Senate Distance
Learning subcommittee that provides policy advice to the universitys management;
however, project progress reports do not shed light on the role and unct ioning o this
committee. Management o the distance education provision was aected by the act
that sta o the provincial centres come under the Universitys department o adult edu-
cation - and not DDE. This remains an issue to be addressed in uture as the division o
responsibility between DDE and adult education can lead to conusion and delays.
ImpactImpactDierent categories o sta have received training in computer skills, in manage-
ment o distance education programmes, were motivated to use modern IT equipment,
and were trained in basic computer repair and maintenance. This is expected to en-
hance DDEs capability to continue to implement its distance education programmes.
Still, there is .. more to be done beore ICT could be ully utilised and hence obtain
maximum benets rom the use o the same46. At the same time, the improved commu-
nication inrastructure has created a basis or better and aster communication between
distance education students and their tutors. The ull benets o this wil l only be known
in the years to come.
DDE is involved in a mathematics and science teacher training programme, nanced
by the Arican Development Bank, together with the Arican Virtual University; how-
ever, this programme is expected to take o only later in 2008.
SustainabilitySustainabilityOver the years, there has been considerable optimism as regards the sustainability o
the distance education system. For example, the mid-term evaluation report observed:
DDE is increasingly becoming sustainable and income rom distance education serv-
ices allows or the nancing o a ll the operational costs, except salaries It is expected
that DDE wil l be able to raise more revenue because o increases in the student enrol-
ment gures and the prospect o selling surplus study materials to ull-time, students
and other interested parties. Similar optimistic observations are made in the progress
reports on AP-2001 and 2002. Again in 2006, it was stated that the current culture o
continuing education in the country, coupled with limited institutions that provide
top related