evaluation of saffl
DESCRIPTION
safflTRANSCRIPT
-
EVALUATION OF
THE SPANISH AS THE FIRST FOREIGN LANGUAGE (SAFFL)
INITIATIVE of the
GOVERNMENT OF THE REPUBLIC OF TRINIDAD AND TOBAGO
FINAL REPORT
Submitted by
LLOYD W. PUJADAS AND
ALVIN ASHTON
June 2010
-
Table of Contents 1 Introduction ................................................................................................................................1
2 Evaluation Approach ...................................................................................................................5
3 Programme Analysis and Recommendations.............................................................................16
4 Integration of Evaluation Results/Recommendations................................................................90
5 Recommendations on the Way Forward ...................................................................................95
6 THE WAY FORWARD - THE NEXT STEPS....................................................................................103
7 BIBLIOGRAPHY/REFERENCES....................................................................................................143
-
EXECUTIVE SUMMARY1. Achievement of the objectives of the consultancy, as defined in the Terms of
Reference (reproduced at Annex A of this Report) constitutes the main purpose of the evaluation study. Its Scope of Work is extremely wide (see page xxx - items (a) to (i)).
2. The evaluation is intended to provide the key decision-makers in the Ministry of Public Administration and Cabinet with the relevant data, analysis and evaluation of the required information on the SAFFL Initiative/Programme which satisfactorily address any particular concerns or questions which they may have or may have had about the value of the SAFFL Initiative/Programme and its accomplishments over the five-year life of the Secretariat for the Implementation of Spanish (SIS), the Unit charged with the responsibility for implementing this Initiative.
3. The findings and recommendations of this study should greatly assist the relevant decision-makers in deciding or having to decide whether to terminate, continue, improve or modify the SAFFL Programme in its present configuration.
4. The Report is organised as follows:
Section 1 - Introduction
Section 2 - The Methodology for Carrying Out the Evaluation
Section 3 - Description, Analysis, Findings Interpretation/Discussion and Recommendations for each of the five (5) major components/stages of the SAFFL Initiative/Programme: (a) Programme Initiation; (b) Programme Installation; (c) Programme Implementation; (d) Programme Products/Outputs; (e) Programme Structure/Organisation/Resources
Section 4 - Integration of Evaluation Results related to the five (5) components/stages of the SAFFL Programme;
Section 5 - Recommendations and the Way Forward
5. The following are some of the main findings of the evaluation:
i. The objectives of the SIS/SAFFL were not measurable.i
-
ii. There was confusion between the SAFFL as a policy statement/decision requiring its own goals/objectives and those of a coordinating agency, as the SIS was intended to be, which then determined its own objectives.
iii. The SAFFL Initiative/Programme was neither clearly conceptualised nor well thought out.
iv. The SIS engaged in a plethora of activities which made management of them extremely difficult. It used a scatter-shot approach. It did not target nor prioritise its activities. It seemed to base its achievements on numbers (number of activities in as many areas as possible). The achievements could not be measured and evaluated because the objectives were not specific, measurable, achievable, realistic and time-bound.
6. The following are some of the main recommendations of the consultants:
i. The SAFFL Initiative/Programme should be located within the framework of a national language policy.
ii. The SAFFL Initiative/Programme should continue but carefully reviewed and re-conceptualised.
iii. The SIS should be restructured and reorganised to perform its role of coordinating, facilitating, supporting mechanism effectively and efficiently.
iv. A strategic plan and an implementation plan derived from it should be developed for the SAFFL Initiative.
v. Serious consideration should be given to the introduction of Distance Education delivery modes as well as combinations of distance education and traditional delivery modes of instruction (dual modes).
vi. There must be greater collaboration and cooperation at the planning and implementation stages of projects/sub-projects between the Coordinating/Implementation Unit and the public/private sector beneficiaries of SAFFL related projects/programmes.
7. The Report concludes by suggesting the next steps in the way forward (see Section 5 of the Report). These include:
i. The appointment by Cabinet of a Joint National Committee/Council for Languages comprising professional foreign language educators (based in the Universities - U.W.I. and UTT) and representatives of the public and private sectors.
ii
-
ii. The Joint National Committee/Council for Languages (JNCL) advises Government on public language policy for English, Trinidad Creole English, Spanish and other foreign languages.
iii. The appointment by Cabinet of a Task Force on Language Education which will work closely with the JNCL.
iv. The development of a strategic and corresponding action plan to implement the national language policy and the reconfigured SAFFL Initiative/Programme.
iii
-
ii
Introduction
-
EVALUATION OF THE SPANISH AS THE FIRST FOREIGN LANGUAGE (SAFFL)
FINAL EVALUATION REPORT
1 Introduction 1. As stated in the Terms of Reference (TOR) and reiterated in the contract for
consultancy services, with reference to the Evaluation of the Spanish as the First Foreign Language (SAFFL) Initiative of the Government of Trinidad and Tobago, awarded by the Ministry of Public Administration (MPA), there is a requirement for a final report. This report is intended to fulfil that requirement.
2. Our evaluation of the SAFFL Initiative had as its specific focus achievement of the objectives of the consultancy as defined in the Terms of Reference:
i. To determine how well the SAFFL initiative has met its original intention to make Spanish the First Foreign Language in Trinidad and Tobago;
ii. To review the attainability of the Initiatives goals;
iii. To determine what were the obstacles/challenges, if the SIS has not fulfilled the intended purpose;
iv. To assess the continued relevance of such an initiative;
v. To make recommendations for the way forward for Trinidad and Tobago in the context of its language initiatives as part of Vision 2020;
vi. To take account, in respect of (v) above, of the economic, political and other circumstances which initially precipitated the decision that Spanish should be the first foreign language;
3. The evaluation study also required that the consultants respond directly to the Scope of Work also defined in the Terms of Reference. As can be seen from the Scope of Work in the TOR cited below, the assignment represented a formidable and challenging task for the evaluators:
a. Examine the original goals and objectives of the establishment of the SIS in the context of national objectives which gave rise to its establishment and make comments thereon;
1
-
b. Undertake an analysis of the political, social and economic circumstances in the region that may have influenced the choice of Spanish as the first foreign language and make recommendations as to the continued relevance of this language;
c. Review the work of the SIS including its subcommittees and its outreach programme, in light of the objectives of its establishment;
d. Review the management of the SIS to determine the fit of the structure and staffing with the attainment of the stated goals of the SIS;
e. Interview key stakeholders, including line ministries, relevant public and private sector institutions, the relevant Embassies and Ministries to determine the efficiency of the SAFFL Initiative;
f. Based on the on-going discussions at the political level regarding the development of regional integration policies, set out the options of the Government for Trinidad and Tobago regarding a language of choice, discuss the pros and the cons of each option and make recommendations on the language of choice for the consideration of the client;
g. Recommend options for the pursuit of the goal for the acquisition of foreign language skills and the target audiences based on the priorities which can be gleaned from vision 2020;
h. Design a preliminary programme for the attainment of (g) above and propose an appropriate organisational structure; and
i. Make recommendations on evaluation criteria and indicators to be used to measure the countrys attainment of various stages of its goal of foreign language fluency.
4. Accordingly, the evaluation study was designed to elicit credible, useful and reliable information upon which the analysis and evaluation findings related to the Objectives of Consultancy and Scope of Work (reproduced above) would be based.
5. It seeks, as a consequence , to furnish the key decision-makers in the Ministry of Public Administration and the Government of Trinidad and Tobago with the relevant data, analysis, interpretation and evaluation of the needed information on the SAFFL Initiative/Programme - which satisfactorily address any special concerns, issues or questions which they may have or may have had about the value of the SAFFL Initiative/Programme and its accomplishments over the five-year life of the Secretariat for the Implementation of Spanish (SIS), the Unit charged with the responsibility for implementing this Initiative/Programme.
6. More importantly, the findings and recommendations of this evaluation project should greatly assist the relevant decision-makers in deciding or having to decide
2
-
whether to terminate, continue, improve or modify the existing SAFFL Programme. In addition, based on its findings, the consultants have included several concrete recommendations concerning the way forward where the focus was on our response to Consultancy Objectives (iv), (v) and (vi) cited at paragraph 1.2 above and Scope of Work items (f), (g), (h) and (i) quoted at paragraph 1.3 above.
7. The rest of the Report which follows is organised as follows:
Section 2- The Methodology for Carrying Out the Evaluation
Section 3- Description, Analysis, Findings.
This section covers interpretation/discussion and recommendations for each of the five (5) major components of the SAFFL Initiative/Programme:
a. Programme Initiation
b. Programme Installation
c. Programme Implementation
d. Programme Products/Outputs and
e. Programme Structure/Organisation/Resources
Section 4- Integration of Evaluation Results related to the five (5) Components of the SAFFL Programme;
Section 5- Recommendations and the Way Forward.
3
-
The Methodology for carrying out the Evaluation
4
-
2 Evaluation Approach
1. The evaluation approach, methodology and plan for this undertaking were all designed to elicit, interpret and evaluate the information required for responding to the needs/concerns/questions of its primary audience- the Programme Manager, the Permanent Secretary and the Ministry of Public Administration, the Cabinet, the Programme Director of the Secretariat for the Implementation of Spanish (SIS) as well as the Chairperson of the Steering Committee for Spanish as the First Foreign Language Programme (SCSAFFLP).
2. A combination of the following evaluation approaches was employed:
i. Objectives-oriented Approach
ii. Management-oriented Approach
iii. Expertise-oriented Approach
N.B. The above-mentioned Evaluation Approaches are briefly described in the Glossary annexed to this Report.
3. In view of the principal users, uses, and purpose(s) to be served by the evaluation findings and recommendations, the Management-Oriented Evaluation approach predominated. Consequently, a systems approach utilising the CIPP Evaluation Model largely informed the evaluation methods/techniques selected. It is to be noted that the first letter of each type of evaluation - context, input, process and product - has been used to form the acronym CIPP (Please see Glossary for more information on the CIPP Model).
2.1 Evaluation Perspective1. In essence, the evaluation was undertaken from two major vantage points:
i. From the perspective of the Secretariat for the Implementation of Spanish (SIS) and the Steering Committee for Spanish as the First Foreign Language Programme - the consultants analysed, interpreted and evaluated the operations of the SIS and the SCSAFFLP and their achievements on the basis of what they perceived to be their mandate, the objectives they set themselves, the activities in which they engaged to achieve these objectives, their achievements and evaluation of their achievements; and
5
-
ii. From the perspective of the consultants - namely the flaws and/or deficiencies which the consultants considered to be inherent in the SIS/SCSAFFLP Initiative/Programme, their conceptualisation of the Initiative/Programme and the approach/method of its implementation.
2.2 Data Gathering Methods1. For each evaluation question/issue/objective selected the required information
needs and relevant information sources were determined. The following data-gathering methods/instruments, sources of information and their corresponding data analysis procedures were employed in this evaluation study:
Discussions/Focus Group Meetings with the following critical stakeholders in the SAFFL/Initiative/SIS Programme:
Members of the SCSAFFLP
Members of the SIS staff
Representatives/Providers of Spanish Programmes organised by the SIS
Representatives of Government Ministries
Persons/Representatives of communities involved in SIS Outreach programmes - e.g. the Spanish Language Acquisition Programme (SLAP)
Representatives of the Private Sector
Curriculum Officer(s) (Modern Languages) of the Ministry of Education
2. Regrettably, time constraints and scheduling difficulties did not permit the consultants to hold meetings with the following important groups and/or individuals: the Trinidad and Tobago Manufacturers Association (TTMA), the Trinidad and Tobago Unified Teachers Association (TTUTA), UTT, UWI Language/Literature/Language Education Lecturers, Secondary School Spanish Teachers, and randomly selected members of the public and representative(s) of the Tobago House of Assembly (THA). In the opinion of the consultants, their inability to meet with these groups/organisations /individuals have not, in any significant way, compromised the integrity of the findings of our Report.
Structured Interviews with some of the stakeholders who participated in the Focus Group meetings
Documentary Evidence:
6
-
3. Critical examination of SIS/SCSAFFLP documents, Cabinet Notes and Minutes and other pertinent records and publications such as planning documents, programmes, instructional packages, publicity packages, files, minutes of various meetings of the Steering Committee, SIS Subcommittees, written agreements with various Ministries and Service Providers, SIS Publications, Financial Records, Budgeting Allocation, SIS Staff CV's and Job Descriptions, etc.
Review of Relevant Literature related to Bilingual Education, Foreign Language Education, Language Policy and Language Planning-National, Regional and International Language Policies, Research in Language acquisition and language learning and Best Practice approaches to Foreign Language Education Policies, Planning and Programmes.
2.3 Data Analysis1. Data analysis instruments and procedures commonly used in qualitative
evaluation approaches/models such as those described earlier in this report (see Section 2.2 above) were utilised in analysing the data obtained.
2.3.1 Interpreting and Evaluating the Data 1. Based on the criteria agreed upon by the consultants, the MPA Programme
Manager, and specialists in foreign language teaching/learning, the standards/criteria for interpreting and evaluating the data were applied.
2.3.2 Evaluation Plan 1. The evaluation plan matrix, which follows, attempts to summarise the evaluators
approach, evaluation questions, objectives, tasks/activities, consultancy objectives, scope of work, decision-making areas, information needed, information sources and methods of collecting information which shaped the evaluation while applying the previously described models and methodology (see Section 2 above).
N.B. It is to be noted that under the Consultancy Objectives column, the specific objective(s) is/are referred to are consistent with the numbering system used at paragraph 1.2 above, for example, Consultancy Objective (i) To determine how well the SAFFL Initiative has met its original intention to make Spanish the First Foreign Language in Trinidad and Tobago is referred to in its abbreviated firm as co (i) (see paragraph 1.2 above). We have also included in the Matrix a column under the heading Decision-Making Area. The decision-making areas are:
7
-
i. Judging the worth of the Governments Spanish as the First Foreign Language (SAFFL) Initiative.
ii. Determining to what extent the SAFFL Initiative has met its original intention to make Spanish the First Foreign Language of Trinidad and Tobago.
iii. Assessing the attainability of the Initiatives goals.
iv. Determining the degree to which the SIS has successfully executed its mandate.
v. Assessing the continued relevance and viability of the SAFFL Initiative in terms of its goals, current organisational structure/arrangements, institutional capacity, resources (including costs) in order to decide whether to terminate, continue, improve or modify the existing SAFFL Programme.
vi. Weighing the options for the pursuit of the goal for the acquisition of foreign language skills and the target audience(s) based on the priorities which can be gleaned from Vision 2020 (and also resulting from the evaluation of findings and feasible recommendations for the Way Forward).
N.B. In the evaluation plan matrix, as in the case of the Consultancy Objectives, a particular decision-making area as identified above is referred to in its abbreviated form. For example, decision-making area (iii) assessing the attainability of the Initiatives goals appears coded as DMA (iii)
8
-
9
-
EVALUATION PLAN MATRIX
Evaluative Questions/ Objectives/ Issues/ Concerns
Consultancy Objective
Decision-Making
Area
Information Needed Information Sources Method of Collecting
Information
Duration
1. What is the worth / value of the Governments Spanish as the First Foreign Language Initiative?
Do the terms first foreign language and bilingualism represent two distinct concepts? Are they interchangeable?
What need(s) did/ does the SAFFL Initiative meet?
Should the SAFFL Programme be continued, terminated or modified?
Has the SAFFL fulfilled its original intention?
What does SAFFL Initiative really mean?
Was/Is there shared understanding/agreement among the key stakeholders of what it means?
CO (i)CO (ii)CO (iii)CO (iv)CO (vi)
DMA (i)DMA (ii)DMA (iii)DMA (iv)DMA (v)DMA (vi)
Ratings of the worth of the SAFFL Initiative
Arguments/ Influential views related to the value of the Programme- from the time it began to the present.
Expert opinion re the concepts of bilingualism and first foreign language
Monitoring and Evaluation information obtained during the implementation of the SAFFL Programme.
Primary Audience Chairman,
Members of the Steering Committee
UWI Documentary
Records of the Ministry of Trade
Minutes of meetings
Foreign Embassies and Missions
Line Ministers TTUTA Chamber of
Commerce TMA SIS documents
Structured Interviews
Meetings/ Discussions
Analysis of documentary evidence
Survey Questionnaires
Expert Opinions sought (i.e. from foreign language educators, teachers, linguists and applied linguists.)
60 Days
Evaluative Questions/ Objectives/ Consultancy Decision- Information Needed Information Sources Method of Duration
10
-
Issues/ Concerns Objective Making Area
Collecting Information
2. To what extent has the SAFFL initiative met its original intention to make Spanish the First Foreign Language (SAFFL) of Trinidad and Tobago?
Were the SIS Programmes and activities governed by clear, specific, measurable, observable, achievable, realistic and time-based objectives?
Was there a monitoring and evaluation system put in place to track the SIS implementation activities?
Were the providers of SIS Spanish instructional programmes guided and supervised by the SIS?
CO (i)CO (ii)CO (iii)
DMA (ii)DMA (iii)DMA (iv)
Documents related to programme planning
Documents identifying behavioural objectives for each Programme and/or Activity
Sample Curricula/ Programmes
SIS Website Information
TV and Radio SIS scripts or video clips/ footage if available
Monitoring and Evaluation Tracking Documents
Views of those involved as to performance of the Programme
Programme Director, SIS
Assistant Director, SIS
Members of SIS Staff
Chairman and other members of the Steering Committee
Providers of SIS Programmes
Representatives of Embassies and Missions
UWI Language and Literature Specialists
Language Teaching Specialists
Obtaining copies of relevant documents- programmes, memos, minutes of meetings- from the SIS and the Steering Committee
Distributing Survey Questionnaires to be filled out by the line Ministries and other key stakeholders
Meetings/ Discussions
Structured Interviews
60 Days
11
-
Evaluative Questions/ Objectives/ Issues/ Concerns
Consultancy Objective
Decision-Making
Area
Information Needed Information Sources Method of Collecting
Information
Duration
3. What obstacles/ challenges, can be identified, if the SIS has not fulfilled the intended purpose?
CO (iii) DMA (iv)DMA (ii)
Documentary evidence from SIS and the Steering Committee where discussions took place or memos/ papers were presented that addressed and/ or spoke to problems/ challenges the SIS was encountering in the implementation of its programmes
Information related to the institutional capacity of the SIS
Information concerning the discrepancy between intention and achievement of stated objectives
SIS SCSAFFLP Key stakeholders Experts on
Objectives- Oriented Evaluation Approach
Collecting documents, papers, minutes of meetings
Structured Interviews
Survey Questionnaires
Memoranda from foreign language teaching specialists
Review of foreign language education literature
Views of Curriculum Officers
60 Days
12
-
4. Is the SAFFL Initiative still relevant? Should the programme be
continued, terminated, improved or modified?
CO (iv)CO (v)CO (vi)
DMA (i)DMA (iii)DMA (v)DMA (vi)
Evaluation Findings/ Recommendations
Evaluation Report Primary Audience
Consultants Evaluation Report
60 Days
5. Determine the design and outline of a programme which leads and directs the acquisition/learning of the preferred language recommended by the consultants report. Design an appropriate
organizational structure and draft job descriptions of the key managerial and technical positions.
Recommend evaluation criteria and indicators to measure the countrys attainment of the various stages of its goal of foreign language proficiency
CO (iv)CO (v)CO (vi)
DMA (v)DMA (vi)
SWOT analysis of existing foreign language national capability
Environmental scan of Trinidad and Tobago linguistic/ situation
Research related to Political, Economic, Educational, Social, Cultural, Linguistic, and Technological factors/issues affecting foreign language education
60 Days
13
-
2.4 Reporting the Evaluation The format and structure for reporting the remaining part of the evaluation is as
follows:
Section 3- Description, Analysis, Findings, Interpretation/Discussion and Recommendations related to each of the five (5) components of the SAFFL Initiative/Programme
Section 4- Integration of Evaluation Findings/Results related to the five (5) components
Section 5- Recommendations and the Way Forward
14
-
Analysis, Findings and Recommendations for the SAFFL
Programme:
15
-
3 Programme Analysis and Recommendations
3.1 Genesis of the SAFFL Initiative Programme InitiationThe following chronicles the genesis of the SAFFL Initiative
i. 2003- Position Paper of the Ministry of Trade and Industry on Bilingualism and the FTAA, prepared in the context of Trinidad and Tobagos bid to be selected as the capital/headquarters of the Free Trade Area of the Americas (FTAA), triggered the SAFFL Initiative.
Inter alia the paper stated that
with the FTAA looming in 2005, and with Spanish fast becoming the
lingua franca of business and travel, the time is ripe for Trinidad and
Tobago to put in place a national agenda for the oral training of all
citizens to become bilingual in Spanish because soon Spanish skills will
be essential for communication and survival in the global village.
ii. 2003- Following the Ministry of Trade and Industrys (MTI) position paper, Cabinet by Minute No. 3091 dated December 03 2003, agreed to the appointment of a Steering Committee on Bilingualism (SCOB) to spearhead the initiative of making Trinidad and Tobago a bilingual society
iii. 2004- In June, 2004, the Minister of Trade and Industry submitted as a Note for Cabinet, the Report and Recommendations of the Steering Committee on Bilingualism, Cabinet agreed to its recommendations.
iv. 2004- Pursuant to the recommendations of the SCOB and their endorsement by the Ministry of Trade and Industry in the Note for Cabinet referred to at (iii) above, Cabinet agreed:
a. That Spanish be designated the First Foreign Language of Trinidad and Tobago; the bilingual initiative to consequently be described in terms of Spanish as the First Foreign Language (SAFFL);
b. To the establishment of a Secretariat for the Implementation of Spanish (SIS) in the Ministry of Trade and Industry, to coordinate, support and facilitate the planning and implementation of the various
16
-
projects in having Spanish as the First Foreign Language of Trinidad and Tobago.
c. To the employment, on contract, of specified staff for a period of two (2) years.
d. That the Steering Committee on the Bilingualism be reconstituted as indicated in the Cabinet Minute and be known as the Steering Committee for Spanish as the First Foreign Language Programme (SASAFFLP)
e. That the terms of reference of the reconstituted committee be as follows:
To ensure that, in accordance with the Government policy the Spanish as the First Foreign Language Programme is designed to meet its agreed goals and objectives
To ensure that the programme achieves its agreed goals and objectives by overseeing its implementation, monitoring and evaluation activities, human, physical, financial and technical
To make recommendations for:
the provision of the necessary resources for the effective implementation of the programme;
the approval of the programmes budget
the procurement of goods and services (including contracts/consultants for technical assistance) required for implementing the programme.
v. 2004- The same Cabinet Note alluded to at (iii) above, had also recommended the establishment of a Programme Implementation Unit (earlier referred to as the SIS at (iv) b above) whose principal role will be that of a coordinating, supporting and facilitating mechanism for effectively accomplishing the varied and various tasks and activities involved in the preparation, initiation, planning, design, development, implementation and evaluation stages of the Spanish as the first Foreign Language (SAFFL) Programme which consists of several projects and sub-projects.
Cabinets decision to accept this recommendation of the Steering
Committee on Bilingualism took affect when the Secretariat for the
17
-
Implementation of Spanish (SIS) was duly established on September
09, 2004.
3.2 Composition of the SAFFL Steering Committee 1. As approved by Cabinet, this Steering Committee was to be chaired by the
Permanent Secretary, Ministry of Trade and Industry with the Principal, UWI, St. Augustine, as Deputy Chairperson. The Programme Director (i.e. Director of SIS) would be an ex officio member. In addition, the reconstituted Steering Committee included sixteen (16) other members listed below. Members/Representatives of the following Ministries/Organisations (Persons of senior rank with decision-making authority):
Ministry of Trade and Industry
Ministry of Education
Ministry of Foreign Affairs
Ministry of Science, Technology and Tertiary Education
Ministry of National Security
Ministry of Tourism
Ministry of Works and Transport
Ministry of Social Development
Ministry of Public Administration and Information
Ministry of Culture, Community Development and Gender Affairs
Ministry of Planning and Development
College of Science, Technology and Applied Arts of Trinidad and Tobago (COSTAATT)
University of the West Indies (UWI)
Tourism and Industrial Development Company (TIDCO)
Trinidad and Tobago Chamber of Industry and Commerce
Trinidad and Tobago Manufacturers Association (TTMA)
18
-
3.3 Evaluation Questions - Issues1. With respect to the genesis of the SAFFL Initiative and the SAFFL/SIS
Programme Initiation Component/Stage, the consultants examined the pertinent documents (viz. Cabinet Notes/Cabinet Minutes) in the light of the following evaluative questions/issues:
a. What prompted the SAFFL Initiative?
b. What was the justification for the SAFFL Initiative?
c. What was the goal/objective of the SAFFL Programme?
d. Was the SAFFL Initiative/Programme well thought out and/or clearly conceptualised?
e. Does bilingualism, bilingual education (in terms of Spanish/English, English/Spanish) equate with Spanish as the First Foreign Language (SAFFL)?
f. Is Spanish as the First Foreign Language (SAFFL) a government policy decision (to be supported, of course, by policy goals/objectives) or a policy statement expressed somewhat mistakenly, misleadingly and bewilderingly as make SAFFL a reality or alternatively as making Trinidad and Tobago a bilingual society?
g. What were the structures/mechanisms established to implement the SAFFL Programme/Initiative?
3.3.1 Findings, Analysis and Evaluation - Programme Initiation1. In this section the consultants respond to the evaluation questions posed at
3.3.1. above.
a. What prompted the SAFFL Initiative/Programme?
3.3.1.1 Findings
1. The Initiative originated in the strong bid of Trinidad and Tobago to be selected as the capital of the FTAA. It could be interpreted as an important part of the overall strategy to strengthen this countrys bid. Bearing in mind that Trinidad and Tobago had to win the support of a majority of the Spanish-speaking countries which were to form the FTAA, the SAFFL policy was intended to send a clear signal that, despite the fact that Trinidad and Tobago was an English-speaking country, Spanish should not be viewed as a language barrier to its selection as the FTAA Headquarters. The nations Spanish as the First Foreign
19
-
Language (SAFFL) policy demonstrated its firm commitment to preparing all its citizens to achieve communication proficiency in Spanish to the highest level possible-in a few short years time. As previously, it is in this context that the Ministry of Trade and Industrys 2003 Position Paper and its companion document Action Plan Towards a Bilingual Society had their genesis. It was this bid, strongly led by the Minister of Trade and Industry that precipitated the Governments SAFFL policy decision. It was a decision that directly resulted in the establishment of the Steering Committee for Spanish as the First Foreign Language Programme (SCSAFFLP) and its implementation/coordinating Unit, the Secretariat for the Implementation of Spanish (SIS).
b. What was the justification for the SAFFL Initiative?
3.3.1.2 FINDINGS
1. The consultants found acceptable the justification for Spanish being chosen as the language of choice as expressed in several SIS Diga Que S publications and SIS reports:
Spanish is increasingly becoming the language of trade and industry in our region. In fact, accordingly to CSO statistics, an estimated $1.3b was exported to 14 Spanish-speaking countries between January to September 2004.
Trinidad and Tobago, if it is to be competitive in the global economy, needs to strengthen, to a significant degree, its national capability in Spanish (including in the area of translation and interpreting)
Benefits, as a result of the SAFFL Initiative, include the potential for increased investment in the financial sector and in the oil and gas sector (from Spain) and greater economic growth (expansion of export markets as well). The involvement of the business sector in the SAFFL/SIS instructional programmes would make Trinidad and Tobago more attractive on the global market.
Trinidad and Tobagos proximity to Venezuela and the predominantly Spanish-speaking countries of the South American continent (the twin island republic is located just seven miles away from the South American mainland) makes proficiency in the Spanish language not only an asset but a necessity.
20
-
As far as the FTAA was concerned, of the thirty-four (34) countries expressing interest in the FTAA proposal, Trinidad and Tobago and the other interested English-speaking CARICOM member states, constituted a significant linguistic minority.
The goal of promoting bilingualism was in keeping with Trinidad and Tobagos Vision 2020-achievement of developed country status by 2020.
As a consequence of being the headquarters of the FTAA it was envisaged that the country would witness a dramatic increase in the number of Spanish-speaking visitors and hence the need for our countrys citizens to be bilingual.
c. What was/were the goal(s)/objective(s) of the SAFFL Initiative/ Programme?
3.3.1.3 FINDINGS
1. According to an undated SIS publication, the SAFFL was a long-term vision with specific goals. These goals were:
1. To facilitate a new learning environment through which the citizens of Trinidad and Tobago will learn and adopt Spanish as the First Foreign Language (SAFFL) by the year 2020.
2. To ensure there is a clear understanding of the cultures, which are emerging in our society and their impact on the cultural landscape of Trinidad and Tobago.
3. To ensure there is public awareness of and support for the Spanish as the First Foreign Language (SAFFL) Initiative.
2. The evaluators found, with respect to the above-listed goals, that:
1. these specific goals were not measurable. For example, it was unclear what (the first goal) facilitate a new learning environment really meant. This objectives/ specific goals were both vague and impossible to measure. It needs to be rewritten.
We believe that citizens can learn Spanish as their first foreign language but not adopt it since Governments SAFFL policy has already done so.
2. the second goal to ensure there is a clear understanding of the cultures is somewhat baffling as it seems to assume that Spanish-
21
-
speaking cultures would soon be invading and impacting negatively the culture of Trinidad and Tobago. The evaluators concluded that there was no convincing justification for this objective/goal. They could find no reasonable basis for the SIS assumption.
3. The words to ensure which begin the statement of the third goal should be replaced by the words to promote. Not only is to ensure not measurable but it is difficult to understand how one can ensure public support and awareness since the public cannot be compelled to do so.
3. The consultants observed that the goals of the SAFFL Initiative seemed to be identical with these objectives of the SIS which were stated in the SIS/SIE-Secretariat for the Implementation of Spanish Annual Report-December 2005, p.p. 4-5 as follows:
1. Facilitate a new learning environment through which the citizens of Trinidad and Tobago will learn and adopt Spanish as the First Foreign Language by the year 2020.
2. Ensure that there is a clear understanding of the cultures which are emerging in our society and their impact on the cultural landscape of Trinidad and Tobago.
3. Ensure there is public awareness of and support for the Spanish as the First Foreign Language
4. Nevertheless, in the Directors Monthly Report-January 2006 (Director of SIS letter to the Steering Committee dated January 18, 2006), these objectives, while remaining similar to the objectives for the SAFFL and SIS cited above, were restated with some changes in their wording as follows:
In the Directors first quarterly report (September 2004-December 2004) three main objectives to attain the above goal (viz. the goal of making Spanish the First Foreign Language of Trinidad and Tobago) were stated:
1. Structure a new learning environment through which citizens of Trinidad and Tobago, students, public servants and business persons alike, will learn and adopt Spanish as the First Foreign Language by the year 2020 and beyond.
2. To ensure that the public buys in to the Initiative of learning SAFFL (Source- Directors Monthly Report-January 2006, p.4).
22
-
5. The comments of the consultants with respect the specific goals of the SAFFL equally apply to the rewritten objectives of the SIS. We have treated the goals/objectives of both the SAFFL and the SIS at some length because of their pivoted importance in the SAFFL Programme. It was these objectives which informed/drove all the activities/projects/programmes of the SIS. Later, in this Report, the consultants will return to the subject of the SAFFL and SIS objectives and how we view them - i.e. our perspective.
d. Was the SAFFL Initiative/Programme well thought out and/or properly conceptualized?
3.3.1.4 FINDINGS
1. The consultants are of the considered view that the SAFFL Initiative/Programme was not well thought out by the SIS and that the Steering Committee (SCSAFFLP) must bear some responsibility for this weakness because, in their overseer/supervisor role, they approved, if not formally, at least tacitly, the SIS flawed implementation plans, which showed unmistakeable signs of the absence of careful planning and deliberations on its part.
3.3.1.5 FINDINGS
1. What is the evidence for the consultants opinion?
2. They based their opinion on the following observations:
1) In June 2004, the Minister of Trade and Industry submitted, as a Note for Cabinet, the Report and Recommendations of the Steering Committee on Bilingualism. Cabinet agreed to its main recommendations (see pp.16 paragraph 3.1 (iv) above). The following recommendations to which Cabinet agreed, concern us here:
That Spanish be designated the First Foreign Language of Trinidad and Tobago, the bilingual initiative to consequently be described in terms of the Spanish as the First Foreign Language.
That the Steering Committee on Bilingualism be reconstituted as indicated in the Cabinet Minute and be known as the Steering Committee for Spanish ass the First Foreign Language Programme (SCSAFFLP).
The role of the SCSAFFLP was to ensure that, in accordance with Government policy, the Spanish as the First Foreign
23
-
Language Programme is designed to meet its agreed goals and objectives.
To ensure that the programme achieves its agreed goals and objectives by overseeing its implementation, monitoring and evaluation activities, human, physical, financial and technical.
It (the Programme Coordinating Unit, i.e. the SIS) will be responsible, using a project management approach for the preparation and submission of the following: (a) Detailed Programme/Project Proposal document; (b) Programme/Project Plan document based on the (Logical Framework) Log Frame approach, and (c) Implementation Plan and Schedule derived from the Log Frame-based model.
2) The minutes of the Steering Committee meetings which were held at the initiation stage of the SAFFL Programme and the documents produced by the SIS with respect to their planned and executed SAFFL activities/programme reveal no signs of their having taken cognisance of (i) the change in designation from bilingual initiative to Spanish as the First Foreign Language initiative and the implications of the change (a justification for the change accepted by Cabinet was included in the Cabinet Note) for SAFFL Programme planning; and (ii) the role and functions of both the Steering Committee and the SIS (which was referred to in the Cabinet Minute as the Programme Coordinating Unit).
3) The consultants carefully examined all available documents and interviewed several key players involved in the SAFFL Programme but could not find no reference, no recollection, no evidence that the SIS, as required by the Cabinet Minute which established the SIS Unit, prepared:
a. a detailed Programme/Project Proposal document;
b. a Programme/Project Plan based on (the Logical Framework) Log Frame approach; and
c. an Implementation Plan and Schedule derived from the Log Frame model.
4) Instead, the SIS appeared to omit the necessary (a), (b), (c) steps outlined at (3) above and to proceed directly to producing an Implementation Plan by way of a document titled SAFFL Work Programme/SIS WORK PLAN dated January 21, 2005 (some four (4) months after its establishment). The consultants found that the SIS seemed to have completely ignored the SAFFL planning implications of the change in
24
-
designation from bilingual initiative to SAFFL Initiative, and seemingly based their Work Plan (Appendix B of the 2005 SAFFL Work Program/SIS Work Plan) on the original Ministry of Trade and Industrys Action Plan Towards a Bilingual Society.
It is to be noted that the SIS Work Plan outlined its strategies to attain its objectives. Each strategy:
1. was linked to a specific objective;
2. identified a target group;
3. projected a target date for expected outputs
3. It should also be noted that the specific objectives which were to be operationalised were the three SIS/SAFFL objectives outlined at 3.3.1.3 above (see pp.21). Strategies were developed for each objective separately. The objectives and their strategies for implementation, in our view, lacked cohesiveness. No real attempt appeared to have been made to have an integrated set of objectives and strategies that were observable and measurable.
4. One explanation which has been given for the SIS and the Steering Committees failure to think the SAFFL Initiative/Programme through thoroughly, was the pressure (i.e. the compressed timelines) under which they were working at the time of the Trinidad and Tobago bid to be the FTAA capital. The country was keen to show their Spanish-speaking neighbours highly visible signs that Trinidad and Tobago was truly on the way to becoming a bilingual country. Hence, the plethora of activities involving public awareness and education campaigns, mass media programmes as well as projects such as the bilingual traffic directions (signs) as well as bilingual signage and Spanish classes in the offices of Government Ministries, approaches to Spanish-speaking Missions/Embassies and the SIS strenuous efforts to promote Spanish language and culture programmes in the private sector and local communities.
5. Nevertheless, the consultants are persuaded that in 2005 and 2006 when it was clear that the FTAA was dead in water, the Steering Committee and the SIS should have reviewed the existing projects and activities and made the necessary changes. However, neither Steering Committee Minutes of Meetings, SIS documents, SIS staff nor Steering Committee members interviewed recalled any discussions nor made mention of any such review.
e. Does bilingualism, bilingual education (in terms of Spanish/English, English/Spanish) equate with Spanish as the First Foreign Language (SAFFL) (Please see Glossary for explanation of these terms).
25
-
3.3.1.6 FINDINGS
1. As indicated in the Glossary (Annex B) the term bilingual may be defined in several ways:
a. The ability to speak two languages
b. Frequent use (as by a community) of two languages
c. Using or able to use two languages with equal or near equal fluency
Bilingualism (the noun) is defined as:
a. the ability to speak two languages
b. individuals or groups of people who acquire communicative skills in oral and/or written forms, in order to interact with speakers of one or more languages at home and in society.
On the other hand, the term First Foreign Language, in the
context of international usage and language planning and policy,
is used primarily to denote the importance of acquiring
communicative proficiency in a particular foreign language for the
population of an individual country. The First Foreign Language is
generally one of the main languages for international
communication (i.e. a world language) and for overcoming
barriers to the flow of information, goods and people across
national boundaries and for which there is the strongest local
demand.
As a consequence, the term First Foreign Language reflects the
preference of a State to promote a particular language to be the
official language policy in the educational system (pre-school,
primary, secondary and tertiary levels). This approach is adopted
in order to strengthen the capacity of the state for all its citizens
to possess communicative proficiency at various levels in the
foreign language chosen.
26
-
Designating a language as the First Foreign Language does not
exclude other foreign languages from being offered in the school
system. It simply means that the state has decided to commit its
resources to the teaching of the First Foreign Language (in our
case, Spanish) as a foreign language instructional
priority.(Source: SCOB statement (justifying the name change
from bilingual initiative to First Foreign Language Initiative) in
the Cabinet Note on Rationale for Spanish as the First Foreign
Language, April 01, 2004).
3.3.1.7 FINDINGS
1. It is patently evident from the definitions given above that the terms
bilingual/bilingualism and First Foreign Language represent two distinct
concepts. One cannot be and should not be equated with the other. They are
not interchangeable.
2. Nevertheless, examinations of relevant SIS documents disclose that no
distinction between the terms was ever made. The SIS continuously and
consistently described its objectives as making Trinidad and Tobago a bilingual
society by 2020 and making the SAFFL a reality. It is because the SIS and the
SCSAFFLP seemed oblivious of the significance of Cabinets decision to replace
the term/concept the bilingual initiative by the Spanish as the First Foreign
Language and stubbornly clung to the misguided notion of a bilingual initiative,
of making Trinidad and Tobago a bilingual (in Spanish) society that the
consultants came to the conclusion that the SAFFL Programme, as conceived and
implemented by the SIS was neither carefully conceptualised, thought out nor
properly planned. It lacked conceptual clarity. The consultants, later in this
Report, will revisit the issue of conceptual clarity and how it affected the
implementation of the SAFFL Programme/Initiative.
f. Is the Spanish as the First Foreign Language (SAFFL) a government policy decision (to be supported, of course, by policy goals/objectives) or a policy statement expressed somewhat mistakenly, and
27
-
misleadingly as make SAFFL a reality or alternatively making Trinidad and Tobago a bilingual society?
3.3.1.8 FINDINGS
1. It is indisputable that the Government took a policy decision when Cabinet
designated Spanish as the First Foreign Language (SAFFL) of Trinidad and
Tobago. It did so in the light of its bid to be the capital of the FTAA. It also did so
on the basis of the argument put forward by the SCOB in the June 2004 Cabinet
Note submitted by the Minister of Labour. In this Note, the SCOBs
recommendation that the term bilingual initiative should no longer be used
but instead it (the Initiative) should be described as the Spanish as the First
Foreign Language Initiative was accepted and approved by Cabinet.
2. Cabinet expected the Steering Committee and the Secretariat for the
Implementation of Spanish (SIS) to formulate the policys supporting goals and
objectives. Although the SIS did formulate its own objectives for the Programme
(see pp. 21 Section 3.3.1.3 above), as mentioned earlier, the consultants found
these specific goals to be not susceptible of measurement. They were not
stated in behavioural terms. It would, therefore, be difficult if not impossible to
determine the extent to which these goals were being achieved. However, the
larger problem was that there was confusion between the SAFFL as a policy
decision requiring its own goals/objectives and those of a coordinating agency,
as the SIS was intended to be, which would then determine its own objectives as
a Secretariat.
g. What were the structures/mechanisms established to implement the SAFFL Programme/Initiative?
1. As indicated at Section 3.1 (d) above (see pp. 17), Cabinet agreed to: (1) the
establishment of the Steering Committee for Spanish as the First Foreign
Language Programme (SCSAFFLP) to oversee the Programmes implementation,
monitoring and evaluation activities. It also had the power to make
recommendations inter alia, for: the provision of the necessary resources for the
implementation of the programme and approval of the programmes budget;
28
-
and (2) the creation of a Programme Implementation Unit (also referred to as
the SIS) whose principal role will be that of a coordinating, supporting and
facilitating mechanism for effectively accomplishing the varied and various tasks
and activities involved in the preparation, initiation, planning, design,
development, implementation and evaluation stages of the Spanish as the First
Foreign Language (SAFFL) Programme which consists of several projects and
subprojects.
2. As shall be shown when we take a look at the Programme Implementation
Stage/Component of the SAFFL Initiative, the reality was completely different.
There was, as the consultants discovered in their scrutiny of the operations of
the SIS and the SCSAFFLP, an almost total discrepancy between what Cabinet
decided the respective roles and functions of these two entities should be and
what obtained as the Programme/Initiative unfolded. In brief, the Steering
Committee, whatever its reasons, (and we shall give, later in this Report, some
of the reasons proffered by SCSAFFLP members interviewed) appeared to have
abdicated its responsibilities (i.e. its role and function) as outlined in the relevant
Cabinet Minute. It (the SCSAFFLP) seemed reluctant to exercise its powers with
respect to its role as the body (headed by a Permanent Secretary) to whom the
SIS and its Director reported and were accountable.
3. With regard to the SIS, as will be seen when we treat with the Programme
Implementation Stage/Component, it did perform some of its coordinating,
facilitating functions, but then it did so (and to a limited extent) for the very
programmes/projects/activities that the SIS Unit itself indicated and was in the
process of implementing. This was certainly not what Cabinet intended and
agreed that its role should be.
4. Our findings, with reference to our evaluation of the Programme Initiation
Stage/component, suggest that the SAFFL Initiative, which we argue
subsequently in this Report is still relevant and needed, must first of all be
reviewed and reconceptualised with greater clarity and sharpness if it is to be
29
-
planned and executed (as it should be) in terms of a foreign language education
policy thrust and not simply and indeed simplistically as a bilingual initiative.
5. This bilingual label and the concomitant thinking merely lend themselves to
ambiguity and confusion of objectives at the operational level. It looks as if both
the SIS and the Steering Committee underestimated and/or did not take into
account the magnitude and complexity of the challenge which they both faced.
They apparently failed to recognise that, even when they had to hasten their
efforts because of the nations bid to be the capital of the FTAA and the
attendant pressure that this brought on them- definitely later as well when the
negotiations for the proposed FTAA (circa 2005,2006) had obviously stalled-
there was still the need for careful language planning (see Glossary for definition
of language planning) and well thought out implementation plans and
strategies.
3.3.2 RECOMMENDATIONS - PROGRAMME INITIATION1. Our recommendations have been derived from our close examination of what
actions characterised the Programme Initiation Stage/Component of the SAFFL
Initiative/Programme and equally based on the premise (to which we shall
return below) that the SAFFL Initiative should continue but in a radically
improved /changed approach.
2. Accordingly, the consultants wish to make the following recommendations with
respect to the Programme Initiation Stage/Component of a revised SAFFL
Initiative/Programme:
1. There should be greater consultation with key stakeholders such as
foreign language specialists, foreign language teachers (Spanish and
other languages), the UWI,UTT,COSTAAT foreign language education
departments, the TTMA, the Chamber of Industry and Commerce, the
Ministries of Tourism, National Security, Education, Science, Technology
and Tertiary Education, Trade and Industry, Foreign Affairs, separately
and not jointly in order to ascertain their language needs with regard to
30
-
their own personnel and their clients/customers who need to acquire
specific communicative skills, in Spanish for specific purposes-when
engaged in developing Spanish language instructional programmes for
private and public sector personnel and their clients/customers.
2. Research into the national language needs (languages include Trinidad
Standard English (i.e. International English), Spanish, French, German,
Portuguese, Hindi, Chinese, to name a few), (language needs which must
include translation and interpreting needs) must be undertaken in the
context of national developmental objectives and global economic
developments. It is only on the basis of solid and appropriate research
studies that Trinidad and Tobago can and should develop a meaningful
strategic plan and national language policy to meet its language needs.
3. Emanating from the language needs assessment research suggested at 2
above as a necessary preliminary step - a sine qua non - there should
follow a national language policy with supporting goals/objectives,
strategies, timeframes and indicators related to the monitoring and
evaluation of achievement of the precisely defined objectives.
4. Based on the needs assessment and national language policy (see
Glossary for the definition of language policy) Trinidad and Tobago is
then required to construct a strategic plan for meeting its language needs
with short-term, medium-term and long-term time horizons.
5. Following steps 1, 2, 3 and 4 above, comprehensive detailed
Programme/Project/Subproject proposal documents needs to be
produced for approval by a Steering Committee who then in turn will
submit them, with its recommendations and approval, to the
Permanent Secretary. It is only after this is done that the project and
sub-project plans and accompanying implementation plans should be
formulated for the SAFFL Initiative which the consultants are convinced
should be continued but radically revised, redesigned and improved in
its conception and implementation.
31
-
6. Effective and efficient governance and management structures are also
required to be put in place to manage the SAFFL Initiative. In the light of
observable deficiencies identified by the consultants in this Evaluation
Report, both the Steering Committee (SCSAFFLP) and the SIS must be
restructured and reorganised so that they can be both held accountable
for their actions - their failures and their successes.
3.4 Programme Installation 1. The consultants were unable to locate any documents which described in
chronological sequence the roll-out of the SAFFL Programme. However, they are
of the view that several activities linked to the earlier cited goals/objectives of
the SIS/SAFFL (see pp. 21 section 3.3.1.3. (c) above) commenced at the
Installation stage almost simultaneously. Relying on the SAFFL Work
Programme/SIS Work Plan dated January 21, 2005 and the Directors Report at
Appendix A of this document, the consultants believe that the Programmes
Installation in 2004 involved:
i. The SIS collecting information from a variety of stakeholders to assist it
in identifying the resources and needs of the local language-learning
environment.
ii. Holding meetings with the Cuban and Venezuelan Embassies.
iii. Assisting the Ministry of Tourism in the design and implementation of
an on-the-job Spanish language and cultural awareness launch at their
Ministry. Assistance was also given to this Ministry in the translation of
beach signs.
iv. Producing a brochure outlining essential SIS information.
v. Installation of Spanish/English Street Signs.
vi. Installation of bilingual traffic signage.
vii. Bilingual (English/Spanish) signage in Government office buildings, e.g.
hospitals.
32
-
viii. Introduction of Spanish language classes for public offices in several
Government Ministries.
ix. Securing Spanish Language Programme Coordinators in several
Ministries.
x. Initiating a mass media public education campaign to promote the
importance and value of the SAFFL Initiative.
xi. Meetings (one-on-one) with the private sector to promote the initiation
of Spanish programmes in their respective organizations. and
xii. Holding (Spanish) cultural awareness workshops for the business
community.
3.4.1 FINDINGS1. The consultants were impressed with the large number of SAFL Programme-
related activities undertaken by the SIS in its first full year of operation. They
recognise that the SIS did every thing possible to make the SAFFL Initiative a
highly visible presence. From the SIS perspective, its various interventions (see
activities listed i -xii above) demonstrated both to the citizens of Trinidad and
Tobago and to our Spanish-speaking neighbours in Central and South America
that the Government of Trinidad and Tobago was seriously committed to the
goal of having its citizens acquire communicative competence in the Spanish
language. The contribution of the SIS in aggressively addressing the
goals/objectives of the SAFFL Programme and firmly establishing the acquisition
of communicative proficiency by all citizens as an urgent national imperative is
an undeniable achievement.
2. However, it is not a question of nit-picking to point out some of the weak
spots/limitations of the numerous SIS activities/programmes/projects carried
out during the Programme Installation Stage/Component (and which persisted
and were amplified during the Programme Implementation Stage).
33
-
3. Some of the areas of concern to the evaluators were:
i. The research carried out by the SIS
a. Personal Profile of Community Members (Draft); and
b. Community Profile (Draft) (Source: SAFFL Work Plan December
2005 Appendices E and F respectively)- which sought to
determine the Spanish language needs of the individual and
community were useful starting points. Nevertheless, because
the SIS had so many irons in the fire at the same time and
lacked the required technical support in the form of foreign
language education and curriculum specialists, the
consultants did not see any evidence of the appropriate
application of the research findings in the SIS organised and
conducted Spanish language classes. The evaluators recognise
that prospective students were assigned to Basic,
Intermediate and Advanced Spanish classes on the basis of
such assessment. However, they saw no evidence of curricula
and instructional programmes specifically tailored to reflect
these profiles.
Our finding here has to do with the SIS institutional capacity
and is not a criticism of the needs assessment approach but
rather is meant to highlight the limitation(s) with the SIS was
forced to operate. Of course, if there is no effective
professional/technical oversight of the instructional
programmes and no verification of the professional
competence of the Spanish language providers, then there is
no guarantee of quality and relevant instruction being
provided to learners.
ii. While the SIS must be complimented for the initiative it took in
arranging and holding meetings with Embassies of Spanish-
34
-
speaking countries (e.g. Venezuela and Cuba). An initiative
which initially had the support of the Ministry of Foreign Affairs,
the consultants found no evidence the Ministries, such as
Ministry of Education and that of Science, Technology and
Tertiary Education, were consulted before, during or after these
meetings. It seemed to the evaluators that the SIS, in its
enthusiasm, considered such consultation with other key
Ministries (the Ministries of Foreign Affairs, Tourism, trade and
Industry and National Security were other key Ministries) time-
consuming and unnecessary. It preferred to report to some of
these Ministries the promises of support and cooperation it (the
SIS) had received from these Embassies.
iii. The SIS regular publication of brochure and newsletters
providing useful information and updates of SAFFL/SIS activities
was one of the SIS activities and achievements that can hardly
be faulted. However, some of the newspaper articles e.g. those
featuring the history and literature of some Spanish-speaking
Latin American countries would have appealed mostly to those
readers who already had a personal interest in these areas.
They would not have appealed to the ordinary members of the
public.
iv. The SIS registered what may be considered a major
achievement with the installation of bilingual street signage in
Port of Spain. Combined with bilingual directional traffic signs
and bilingual signs and labels in Government offices and other
public buildings there is little doubt about its dramatic, highly
visible publicity effect. Indeed, a video clip highlighting the Port
of Spain bilingual street signage was used to promote our bid to
be the headquarters of the FTAA. It was also shown on local TV
stations.
35
-
The Secretariat for the Implementation of Spanish (SIS) justified the
bilingual (Spanish/English) Signage Policy for Government/State-
owned Properties in the following way:
The Secretariat for the Implementation of Spanish (SIS) aims to
structure a new language environment through which the
citizens of Trinidad and Tobago will learn Spanish as the First
Foreign Language by the year 2020. One means through which
it intends to accomplish this will be by ensuring that signage
(street, traffic, buildings etc.) throughout Trinidad and Tobago
is written in both Spanish and English.(Source: SAFFL WORK
PROGRAMME/SIS Work Plan, p.20, January 21, 2005).
The consultants, however, saw no justification for the huge
expenditure incurred by the installation of bilingual steer and
traffic signage (as well as buildings) at the time that this was
done. Their reasons for not accepting the SIS
explanation/justification are as follows:
From a foreign language instructional strategy point of
view there would appear to be little motivational value in
these signs for the average citizen. One local TV news clip
actually captured the bewilderment occasioned by these
street signs when some people in the street were
interviewed about their reactions to these bilingual signs.
If these signs were intended to assist prospective Spanish-
speaking visitors to make their way in Port of Spain then it
(the initiative) needed the support of tourist information
kiosks strategically located throughout the city and
equipped with bilingual tourist information brochures,
maps and bilingual personnel. This support was either not
available and/or not put in place.
36
-
In terms of priorities of programmes/projects/subprojects
for achieving the overarching goal of the SAFFL Initiative-
strengthening the nations communicative capability in
Spanish (i.e. meeting the nations Spain language needs)-
bilingual street signage had little if any justification.
The funds which were allocated and spent on the bilingual
signage programme would have yielded greater value for
money spent if they were allocated to local language
teaching research and teacher training programmes.
v. While the introduction of Spanish classes for the public officers
in several Government Ministries was in keeping with one of
the objectives of the SIS and was a laudable achievement that
attested to the serious efforts of the SIS and the Government
to set the country on a bilingual path, the consultants feel
that the approach should have been more narrowly targeted.
Instead of having classes for all officers interested in learning
Spanish for communicative purposes and accordingly grasping
them into Basic/Beginners, Intermediate and Advanced classes,
the approach, in the opinion of the consultants should have
targeted, in the first instance those Ministries with the greatest
need for building and/or improving their communicative skills
in Spanish-Ministries which had frequent, intense and
significant interaction with nationals of Spanish-speaking
countries and in which the personnel who needed to achieve
various levels of communicative proficiency for various
purposes and in various communicative situations (both
professional/official/work-related and personal/social)-could
be identified and trained. This is not to say that the
consultants are or were blind to the positive aspects of this
initiative which was pursued vigorously in both the private
37
-
and public sectors-instruction in Spanish at the workplace in
Spanish. This initiative, while being high profile, would no
doubt have served to emphasise the importance Government
attached to the learning Spanish as well as motivate those
who had not enrolled in such classes to do so.
vi. Of the other Installation Programme activities (listed 1-12
above), the evaluators limit themselves to the following
comments:
a. The evaluators endorse the early one-to-one meetings
which the SIS held with the private sector to promote the
initiation of Spanish classes in their respective
organisations. In view of the fact that an enhanced
capability to communicate effectively in Spanish was
considered as an important tool in overcoming linguistic
barriers to expanding Trinidad and Tobago trade and
investment with Latin America, this SIS initiative was
justified. In this context, the holding of (Spanish) cultural
awareness workshops, in collaboration with the
Embassies of Spanish-speaking countries, could be and
should be favourably viewed as an indispensable part of
the sensitisation process in preparing our businessman to
explore new markets for their goods and services and
investment opportunities in Latin America.
The SIS rightly viewed the strategy of implementing a mass
media public education/awareness campaign to promote
the value and importance of the SAFFL Initiative as a key
strategy for attaining the goals of this Initiative. As a
consequence, it established a Communications
Department with a Communications/Marketing Specialist
assigned to it. As described in the SIS Annual Report
38
-
(December 2005) this Unit/Department had the
responsibility for helping the SIS achieve the following two
SIS objectives:
1. Ensure that there is a clear understanding of the
cultures which are emerging in our society and
their impact on the cultural landscape of Trinidad
and Tobago. and
2. Ensure there is public awareness of and support
for the Spanish as the First Foreign Language
(SAFFL) Initiative. (p.5).
vii. The activities of the Communications Department, with regard to the
objectives stated above included, inter alia:
Developing a corporate identity for the SIS including selection
of logo design and printing of stationery, production of SIS
uniform (polo shirts)
Coordinating production of promotional items for branding
Creating a SIS and SAFFL information kit
Running media campaigns educating the public about Latin and
South American culture
Developing a SIS brochure for distribution at seminars and Trade
Fairs
Publishing articles fortnightly on Hispanic culture, language, SIS
and SAFFL initiative in all daily media (i.e. local newspapers)
Creating a SIS bilingual Newsletter
Organising and preparing instructional programmes for
broadcast on Radio and TV stations
39
-
Identifying and obtaining sponsors for radio and TV segments
3.4.2 FINDINGS1. The consultants have listed, at some length, the imposing number and the
nature of public awareness, (including activities of an instructional nature) media
exercises in which the SIS engaged for several reasons. These include:
In the view of the consultants, the SIS, as a result of their media publicity
campaign, did establish a strong print and electronic media presence. As
a consequence, a significant number of Trinidad and Tobago citizens
would, no doubt, have become conscious of the fact that the
Government of Trinidad and Tobago considered learning to communicate
in Spanish an important and useful skill that was urgently needed to be
acquired by the countrys citizens.
Several of the activities in which the SIS Communications Unit engaged
seemed to place an equal emphasis on establishing the SIS as an entity
that shared equal importance with the SAFFL Initiative itself. Why was it
necessary for the SIS (as it did) to develop a corporate identity including
selection of logo design and printing of stationery, a production of SIS
uniform (polo shirts)?. The evaluators found that throughout the life of
the Secretariat for the Implementation of Spanish (SIS) there were
several activities that were intended to give undue prominence and
unjustifiably high profile to the SIS as a Unit and its accomplishments
with respect to the SAFFL Initiative. Moreover, the distinction between
the SIS and the SAFFL Initiative/Programme became increasingly blurred
as the Programme/Project went on. The result was that one (the SIS)
became indistinguishable from the other (the SAFFL Initiative).The
consultants in their experience of Projects and Project Implementation
or Project Coordinating Units (as the SIS was intended to be) have never
encountered a situation where the Implementation/Coordinating Unit
40
-
found it necessary to brand itself as the SIS sought and succeeded in
doing.
i. The consultants are of the view that the linkage between the
publicity/public education/marketing activities of the SIS and the specific
objectives/goals of the SAFFL/SIS was and could be no substitute for a
coherent, fully integrated, communications policy plan and strategy.
Although superficially and seemingly connected with the SIS specific goals,
the communications strategy appeared disjointed and lacking in internal
consistency and connectivity. This was the result of failing to design an
overall/overarching communication policy and strategy that would be
informed by the SAFFL/SIS objectives but not strictly determined or
implemented in terms of having an isolated one-on-one correspondence
with specific goals/objectives. The consultants hold this opinion because
they observed that the SIS print and electronic mass media interventions
were a hotchpotch of public awareness, public education, Spanish
instructional programmes and activities for children, public awareness
caravans etc. The consultants would have preferred a more measured and
precisely targeted SAFFL publicity campaign. and
ii. The large budget allocation for publicity/public relations/public
awareness should have been significantly reduced and/or drastically cut in
view of other more relevant teacher training/language teaching/learning
projects/research programmes which were/are at the heart of the SAFFL
Initiative. We cite below the kind of budget allocation the SIS proposed (and
it clearly received most of the funds requested because of their highly
visible SIS mass media publicity-related advertisements and programmes):
a. At attachment IX in the SIS document titled Proposed Budget for the
Establishment of the Programme Implementation Unit (Note that the
name had not yet been changed to SIS) for Spanish as the First Foreign
Language, the amount purposed for the line item reading Promotions,
Publicity and Printing is $200,000.00.
41
-
b. In the SIS Communications/Marketing Budget 2005-2006, under the
heading Projects for Communications/Marketing Area of SIS, the total
sum requested is $1,1777.00. For various line items the sums proposed
are as follows:
Print Media (Ads on SAFFL) $ 100,000.00
Educational Fair (On Latin America trade fair) $ 200,000.00
Competitions-To provide reinforcement for
Spanish knowledge $ 100,000.00
Targeted Business Forums-To encourage
private sector to go bilingual featuring speakers
from Latin America (2) $ 100,000.00
Functions:
Others as developed/required $ 100,000.00
End of the year (celebrating achievements) $ 75,000.00
c. For the SIS 2006-7 Budget Estimate for the SIS
Communications/Marketing Department a total sum of $2,122,500.00+ /
-10% was proposed. Distributed over four (4) quarters (October-
December 2006), January-March 2007, April-June 2007 and July-
September 2007 we saw line items and requested amounts such as:
Billboards $ 120,000.00
Development of Professional Info Pack $ 190,000.00
Press Advertising Campaign $ 67,500.00
Travelling Road Show $ 500,000.00
42
-
Media Campaign Road Show $ 100,000.00
Production Media Segments $ 127,000.00
Development of Educational Programmes $ 175,000.00
iii. The consultants remain unconvinced that the SIS, particularly after 2005-2006
when the FTAA talks had reached a stalemate, needed to engage so heavily in
several of the activities listed above, for example, Billboards, Travelling Road
Show, Media Campaign Road Show and Development of Professional Info Pack.
It is interesting to note also that:
a. the Steering Committee appeared not to have questioned the
vast sums requested and/or actually spent on publicity by the SIS.
and
b. the SIS had no Accountant nor Accounts Officer on its staffing
establishment who would have been expected to exercise some
control over proposed and/or actual expenditure and also would
be responsible for monies spent and/or received. The consultants
found no evidence of strict professional accounting procedures
employed by the SIS.
3.4.3 RECOMMENDATIONS - PROGRAMME INSTALLATION 1. Based on the preceding findings/observations concerning the Programme
Installation Sate/Component, the consultants recommend:
1. Spanish language instructional programmes should be more carefully
planned, designed and implemented at the programme installation stage.
In addition, they should be continuously monitored and evaluated at this
stage so as to remedy any defects.
2. There should be greater involvement of professional/technical
individuals/organisations in the planning, design, implementation and
evaluation of foreign language curricula (in this instance, Spanish) and
their delivery.
43
-
3. There should be greater consultation and collaboration with key
Ministries (e.g. the Ministries of Education, National Security, Trade and
Industry, Tourism, Foreign Affairs, etc.) prior to meeting with the
Embassies of Spanish-speaking countries because they were to be the
beneficiaries of the collaboration, cooperation and support which these
Embassies promised to lend to the SAFFL Initiative.
4. The street and traffic bilingual (Spanish/English) signage programme
should continue only if there is demand for it, i.e. if there is an influx of
Spanish-speaking visitors (business and tourist visitors).
5. Classes and Spanish language training in various Government Ministries
should first target staff members who have the greatest need for
acquiring high levels of communicative competence in Spanish.
6. The SIS initiative of promoting in the business community, the learning of
Spanish and its relevance for expanding trade and business with Spanish-
speaking countries of Latin America and Spain should continue. However,
Spanish for business, trade and international marketing falls under the
Language for Special Purposes (LSP) rubric and should only be
undertaken by instructors specially trained in the field of designing,
developing, implementing and evaluating LSP curricula.
7. There must continue to be a mass media public awareness/education/
marketing component of the SAFFL Initiative/Programme. However, this
communications/marketing thrust must not attempt, as was the case
with the SIS media and publicity blitz, to be all things to all men.
Rather, what is needed is a coherent, properly designed and executed
communications, policy plan and strategy which is integrated,
coordinated, properly organised and coherent. It must be conceived as
being the vehicle to promote the achievement of the SAFFL goals and not
simply as a tool for separate and disconnected purposes and/or
objectives of an Implementation/Coordinating Unit.
44
-
8. There must be tight control over the communications/marketing budget
so as to ensure that there is value for money and/or value added for
whatever communications/marketing expenditure is incurred. Each line
item of publicity/advertisement expenditure must be scrutinised and
justified in terms of how it contributes to the total achievement of the
SAFFL Initiative.
9. There should be a qualified accountant attached to any Implementation
or Coordinating Unit responsible for disbursing funds or incurring
expenditure involving funds drawn from its own budgetary allocation or
received from sponsorships.
3.5 PROGRAMME IMPLEMENTATION1. It is useful to remind the reader, before proceeding with our description of the
SIS implementation process, of some of the critical SAFFL/SIS inputs which were
crucial for achieving the intended outputs of the SAFFL Initiative and those of the
SIS intervention through the implementation process.
2. Here we outline some of these inputs which contributed to and were
transformed in the implementation process into the SIS outputs:
i. The Ministry of Trade and Industry Cabinet Note and its justification
for: (a) embarking on the SAFFL Initiative; and (b) its establishment of
the Steering Committee for the Spanish as the First Foreign Language
Programme (SCSAFFLP) and the Programme Implementation Unit (the
SIS former name). These entities were assigned certain roles,
functions and responsibilities in the attachments to the earlier cited
Cabinet Note.
ii. The SIS was provided with the physical, technical, financial and human
resources required for carrying out its mandate. For example, the
original funding required for the creation of the Programme
Implementation Unit (the SIS) was estimated to cost $242,200.00 in
Capital Costs and total recurrent expenditure of $1,409,169.28 - a total
45
-
cost of $1,651,369.28. It should be noted that the proposed SIS budget
for 2007-2008 was $3,027,500.00. With respect to its human
resources, Cabinet initially agreed to the following staffing
establishment of the SIS (on a contract period of two (2) years): (1) a
Programme Director, (2) an Assistant Programme Director, one (1)
Secretariat Officer, one (1) Foreign Language (English/Spanish)
Specialist, one (1) Communications/Marketing Specialist, one (1)
Researcher, one (1) Executive Administrative Assistant, one (1)
Secretary- a total of eight (8) contract positions. It is worthy of our
attention that, within one (1) year of its establishment, the SIS sought
and received Cabinet approval for a significant increase in its staffing
establishment. According to a SIS document captioned New Job
Descriptions - Assistants to Officers (dated 30/09/05), the following
were the additional contract positions approved by Cabinet:
1. Assistant to Communications/Marketing Specialist
2. Assistant to Researcher
3. Assistant to Foreign Language Specialist (English/Spanish)
4. Assistant to Secretariat Officer
5. Administrative Assistant
3. A total of five (5) new posts were created in the Secretariat for the
Implementation of Spanish. In addition, some of the original positions were
given new job titles with corresponding duties and responsibilities:
i. Executive Secretary, Secretariat Officers were now converted into SIS
Officer 1 and SIS Officer II; Foreign Language Education Specialist,
Bilingual Language (English/Spanish) Specialist; and Programme
Secretary. It is to be noted that the SIS at one time had a staff
establishment of thirteen (13) persons. Other human resources were also
available to the SIS: (a) the Steering Committee and its individual
46
-
members, for example, its foreign language education specialist, such as
the COSTAAT, UWI, UTT foreign language education specialists, who were
members of the Steering Committee; and (b) Representatives of various
Government Ministries, including the Ministries of Education, Trade and
Industry, Foreign Affairs, etc.; (c) Language Service Providers and (d)
Consultants.
ii. The SIS was also provided with its own office, furniture and technical
equipment needed to carry out its responsibilities and functions. The list
of equipment which is located in Annex F includes: eleven (11) Desktop
Computers, eight (8) laptops, one (1) television set, one (1) digital
camera, one (1) projector, one (1) copier, one (1) printer, one (1) fax
machine, five (5) CD Radio Cassette Players, one (1) DVD/CD/VCD and
VCR combination.
iii. In order to implement its plans, programmes and projects, the SIS
deployed its staff in what it considered strategically effective positions in
order to perform assignments/tasks such as those as described in its
December 2005 Annual Report (p.5) where, under the heading Proposed
Activities for 2004-2005, it stated: With the recruitment of staff, the SIS
work plan was developed, and designed to meet the three (3) SIS
Objectives and are broken down into four (4) departmental sub-units of
the SIS-The Communications Department, the Research Department,
the Foreign Language Department and the Public Sector
(Ministries)/Private Sector Department. These activities will help
ensure all nationals are proficient in Spanish within the next ten to
fifteen years and our cultural fabric is strengthened by the
reintroduction of Spanish to our twin island republic.
iv. As shown in the SIS Work Plans/Programmes for the various officers, (See
Annex), in accordance with their job title and job description, officers
were assigned to the sub-units named above. For example, one SIS
Officer was assigned to the Public Sector, another to the Private Sector
47
-
and the Communications/Marketing Specialist to the Communications
Unit.
v. Each Officer and each of the four (4) Units prepared their annual work
plans in tabular format. For example, Departmental Objectives were tied
to the relevant