The World Bank Report No: ISR13984 Implementation Status & Results Ghana Ghana Skills and Technology Development Project (P118112) Public Disclosure Copy Operation Name: Ghana Skills and Technology Development Project Project Stage: Implementation Seq.No: 5 Status: ARCHIVED Archive Date: 29-Apr-2014 (P118112) Country: Ghana Approval FY: 2011 Product Line: IBRD/IDA Region: AFRICA Lending Instrument: Specific Investment Loan Implementing Agency(ies): Key Dates Board Approval Date 29-Mar-2011 Original Closing Date 30-Jun-2016 Planned Mid Term Review Date 02-Dec-2013 Last Archived ISR Date 13-Oct-2013 Effectiveness Date 23-Nov-2011 Revised Closing Date 30-Jun-2016 Actual Mid Term Review Date 12-Dec-2013 Project Development Objectives Project Development Objective (from Project Appraisal Document) The project objective is to improve demand-driven skills development and increase adoption of new technologies in selected economicsectors. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Component 1: Institutional Strengthening of Skills Development 4.00 Component 2: Institutional Strengthening of Science and Technology Development 4.00 Component 3: Financing of Skills and TEchnology Development Programs through the Skills 50.00 Development Fund (SDF) Component 4: Project Management and Monitoring and Evaluation 5.00 Public Disclosure Copy Overall Ratings Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Unsatisfactory Overall Risk Rating Substantial Substantial Implementation Status Overview The GSDTP has made notable progress since the last ISR (October 13, 2013). In particular, the implementation and achievements made under the Skills Development Fund (Component 3) continue to be strong and is quickly catching up with the original implementation schedule, agreed in June 2011. Available data show increased investments and Page 1 of 13 The World Bank Report No: ISR13984 productivity among participating firms and beneficiary survey data provide evidence that trainees and employers are largely satisfied with the capacity-building activities. The number of applications and approvals continues to rise. Given the increased attention that the SDF is receiving, it will be important for the Government to take concrete steps to ensure a robust and transparent process moving forward, in terms of targeting, outreach, oversight on how resources provided by the Fund are being used by beneficiaries. Furthermore, it will be important for the Government to take the necessary steps to institutionalize the SDF to ensure its overall sustainability and contribution to the TVET sector in the long-term. Public Disclosure Copy Another major achievement under the Project is the establishment of a fully functional M&E system which allows for timely monitoring and analysis and can provide detailed reports on project outputs and outcomes (see Results Framework for most recent data). This M&E system now needs to be complemented with an independent verification system. Since 2/3rd of the funding from the GSTDP is earmarked for the implementation of the Skills Development Fund (component 3), its implementation helps maintain a positive rating in terms of achieving the overall Project Development Objectives. However, only moderate progress has been observed under Components 1 and 2. Under sub-component 1.1 (Development of COTVET technical capacity, strategic systems and policies) a firm with a strong technical proposal was recently hired. The firm is expected to strengthen the capacity of COTVET in order to ensure that key activities are implemented and that the envisioned outputs and outputs are achieved. This capacity building activity starts with significant delay and this makes it unlikely that all the component specific outcomes and results will be achieved. There have also been significant delays in the implementation of activities designed to strengthen science and technology (S&T) providers under Component 2. This component is also further constrained by inadequate communication and reporting between the Ministry of Science, Technology and Innovation (responsible for implementing activities under Component 2), COTVET (which has the overall responsibility for project coordination and IDA. In absence of adequate reporting, there is a also a risk that the activities pursued by MESTI are not well aligned with the original project design. A realignment is likely needed but it is held up by the reporting shortcomings. There is a continued risk that the delays under Components 1 and 2 will prevent the project from fully achieving its main development objectives. At midterm, a realignment of these two components with a more realistic agenda for each would help improve the overall project rating assuming that the implementation schedule gets back on track by June 2014. The Project Support Unit recently submitted a mid-term review report which includes an overview of progress made under each component, while also highlighting some of the key implementation challenges and recommendations to address the identified bottlenecks. Missing in this mid-term review were discussions about Component 4, details about expenditures and costs of various activities and details about the, efficacy, efficiency, and sustainability of the project. The PSU indicated that a Government position will be submitted to IDA on whether a restructuring is needed to ensure that planned activities lead to the achievement of the project development objectives. The Project Support Unit (PSU) is currently fully staffed and functional. The PSU’s M&E team has worked closely with the Bank to develop a comprehensive reporting system to track the key outputs and outcomes of the project. Baseline figures and up-to-date data on each of the project indicators are reported in this ISR. Disbursements continue to lag behind schedule and currently stand at 27%.This is largely a result of the delays under Components 1 and 2. Disbursements under Skills Development Fund (Component 3) have been increasing at a rapid pace. Locations No Location data has been entered Public Disclosure Copy Results Project Development Objective Indicators Page 2 of 13 The World Bank Report No: ISR13984 Indicator Name Core Unit of Measure Baseline Current End Target Increase in labor productivity by participating Percentage Value 0.00 75.70 60.00 firms disaggregated by economic sector and Date 31-Dec-2013 30-Jun-2016 Public Disclosure Copy size (small, medium, large) Comments Baseline: GH₵7.32; Actual: GH₵30.09 (75.7% increase from baseline) The PSU defines productivity as output per labor hour and it ismeasured in GH₵. M&E data provided in July 2013. Baseline figures provided by call and window for productivity (output/labor hour)are the following: Call 1: GH₵4.66 Call 2: GH₵7.49 Window 1: GH₵12.23 Window 2: GH₵5.96 Window 3: GH₵2.754 Window 4a: GH₵1.26 Window4b:GH₵53.83 The figures by call and window for the December collection are the following: Call 1: GH₵5.40 Call 2: GH₵33.23 Window1: GH₵57.08 Window 2: GH₵12.52 Window 3: GH₵9.65 Window 4a: GH₵28.19 Public Disclosure Copy Window 4b: GH₵70.44 Overall, productivity improved quiet substantially from GH ₵7.32 in June 2013 to GH ₵30.09 in December representing a positive change of 75.7%. This leap is highly influencebya number of outliers in Window 1: e.g. PMMC, Askn electric Ltd, Accra Brewery, Nallem Clothing, etc. Page 3 of 13 From baseline in June 2013, The World Bank Report No: ISR13984 Increase in investment by participating Percentage Value 0.00 67.00 40.00 enterprises in skills and technology Date 31-Dec-2013 30-Jun-2016 development (disaggregated by economic Comments M&E collected baseline in sectors; size; skills and technology) Public Disclosure Copy July 2013. 67 of 78 calls 1 and 2 grantees at least made some sort of investment between July and December 2013. Baseline figures provided by window and sector: Window 1: GH₵1,789,499 Window 2: GH₵103,143 Window 3: GH₵587,000 Window4a: GH₵70,000 Window 4b: GH₵12,850,000 ICT: GH₵3,784,000 Construct/Housing: GH ₵1,700 Tourism/Hospitality: GH ₵1,000 Livestock/Horticulture: GH ₵138,596 Oil and Gas: GH₵0.00 Other (Service): GH ₵11,474,346 December 2013 figures represent additional investment from July to December 2013. Investment Public Disclosure Copy was assessed based on three main variables: Investment in skills (GH₵1,736,582), investment in technology (GH ₵2,898,735.128), and contribution to the SDF project (Matching fund) (GH ₵2,584,492.69).These are also presented by windowsand sectors as follows. Window 1: GH₵2,142,069 Window 2: GH₵911,122.00 Page 4 of 13 Window 3: GH₵1,163,722.00 Window 4a GH₵1,060,098.00 The World Bank Report No: ISR13984 Satisfaction with skills by trainees Percentage Value 77.60 70.00 (disaggregated by sex, region) Date 31-Dec-2013 30-Jun-2016 Comments Will be assessed based on Based on a 5 point Likert Public Disclosure Copy accepted applications. Scale (Very Satisfied, Satisfied, Somewhat Satisfied, Not Sure, Somewhat Dissatisfied, and Very Dissatisfied). This indicator applies only to grantees that have completed all of their training activities. At the time of data collection in December 2013, a total of 20 grantees had completed their projects and 19 of them were eligible for assessment under this indicator. The results are presented by sex and region as follows: Sex: Male: 74.3% Female: 89.8% Region: 1. Ashanti: 58.8% 2. Brong Ahafo: 95.0% 3. Central: 94.4% 4. Eastern: 100.0% 5. Greater Accra: 94.6% 6. Northern: 100% 7. Upper East: 100% 8. Upper West: 66.7% Public Disclosure Copy 9. Volta: 62.5% 10. Western: 41.7% Inadequate supply of tools by the training provider was a major reason why some of the participants were not satisfied with the training. Respondents rated the training in 4 competency areas as follow: Practical: 87.3% Behavioral:92.5% Page 5 of 13 Technical: 90.0% Communicative: 94.3% The World Bank Report No: ISR13984 Satisfaction with skills by participating firms Percentage Value 87.20 70.00 disaggregated by economic sectors; region; Date 31-Dec-2013 30-Jun-2016 size Comments Will be assessed based on Based on a 5 point Likert Public Disclosure Copy accepted applications Scale (Very Satisfied, Satisfied, Somewhat Satisfied, Not Sure, Somewhat Dissatisfied, Very Dissatisfied). A rating of at least "Somewhat Satisfied" was considered a high rating from the employer (firms). Data were collected from a total of 13 grantees and covered131 staff in Window 1 only. The grantees were, at least, satisfied with the skills of 105 of the 125 staff studied. This shows a significant improvement from June assessment where the grantee were satisfied with the skills of only 49 out of 131 (representing 37.40%). All of the window one grantee fall with only 2 of the 10 regions in Ghana (Brong Ahafo and Greater Accra regions) Region: 1. Brong Ahafo: 80.0% 2. Greater Accra: 87.5% Public Disclosure Copy Sector: ICT: 90.0% Livestock and Horticulture: 66.7% Service:50.0% Manufacturing: 70.0% Garment and Textile: 82.5% Music: 60.0% Jewelry: 70.0% Direct project beneficiaries Number Value 0.00 6592.00 24000.00 Page 6 of 13 The World Bank Report No: ISR13984 Date 31-Dec-2013 30-Jun-2016 Comments (Number of Females: 1,783 representing 27.0%) Public Disclosure Copy This number does not include beneficiaries from Components 1 and 2 as the planned activities have not been rolled out yet. 1,783 of the total number trained, representing 27.0%, are female. Female beneficiaries Percentage Value 0.00 27.00 50.00 Sub Type Supplemental Intermediate Results Indicators Indicator Name Core Unit of Measure Baseline Current End Target National Skills Strategy developed and adopted Text Value 0 No Yes Date 31-Dec-2013 30-Jun-2016 Comments COTVET MIS for skills development is Text Value 0 No Yes functional Date 31-Dec-2013 30-Jun-2016 Comments The MIS is not yet functional – The design has been completed and some of the materials have been procured. A number of discussionshave taken place Kofi Annan Centre involving COTVET and a number of Public Disclosure Copy other stakeholders to understand the MIS requirements. The COTVET PSU has already incorporated the development of the MIS into the TA package planned under Component 1. RFPs for the TA package have been received and evaluation of Page 7 of 13 The World Bank Report No: ISR13984 proposals is likely to commence in early October 2013. Guidelines for quality assurance systems Text Value 0 No Yes Public Disclosure Copy including certification are developed and Date 31-Dec-2013 30-Jun-2016 adopted Comments While 21 quality assurance manuals have been developed, the QA guidelines and the system have yet to be adopted and/or operationalized. Tools for registration by TVET institutions have been developed and uploaded onto the COTVET website. Institutional development plans for training Number Value 0.00 0.00 10.00 providers developed and implemented Date 31-Dec-2013 30-Jun-2016 Comments Institutional Development Plans have not yet been developed. Thus, there is no support provided for the implementation of Institutional Development Plans. STI Directorate established with full Text Value 0 No Yes complement of staff Date 31-Dec-2013 30-Jun-2016 Comments The STI Directorate has been established with 5 professional staff seconded from the other established STI institutions. A contracthas just been awarded for an office Public Disclosure Copy space to be constructed. However, the following key expected outputs have not been achieved: 1.Capacity building has to make and coordinate STI policies, as well as monitor STI programs has not been provided. 2. Information system and Page 8 of 13 The World Bank Report No: ISR13984 data gathering mechanisms have not been developed. 3. Activities in the STI Public Disclosure Copy Development Plan are not effectively being implemented. New collaborations between supported Number Value 0.00 0.00 20.00 technology providers and private sector for Date 31-Dec-2013 30-Jun-2016 adaptation and diffusion of technology Comments Five institutions have been selected and awarded $500,000.00 to improve governance and incentives to develop, adapt, defuse technology to private sector enterprises on demand driven basis. The selection process was completed during the last quarter of 2013 and nonew collaborations with the private sector have started. Information System available for STI Text Value 0 No Yes Directorate use Date 31-Dec-2013 30-Jun-2016 Comments MIS system has yet to be developed although good progress has been made in terms of design and recruitment/contracting of consultants to undertake this task. Employers rating of competencies of trained Percentage Value 0.00 87.20 60.00 employees (Window 1 of SDF) Date 31-Dec-2013 30-Jun-2016 Comments Percentage refers to Public Disclosure Copy percentage of trained employees with high employer performance-based rating. Baseline data were collected in July/Aug 2013 using trainee-level performance assessment instrument (evaluation of competencies Page 9 of 13 The World Bank Report No: ISR13984 based on Likert scale) with 25% random sample of grantees. 37.4% of trained employees received a high Public Disclosure Copy employer performance-based rating. The rating has significantly improved from 13.40% to 87.20% during December 2013. The assessment was conducted through four main competencies: practical understanding and execution of responsibilities (Practical); attitudes and behaviours (Behavioral); technical abilities and understanding ofresponsibilities (Technical); and communicative competencies of the employee (Communicative). Employers’ rating of these competencies also saw a significant improvement between June 2013 and December 2013 Practical: 71% to 89.60% Behavioral: 45.80% to 80.00% Technical: 46.60% to 88.80% Public Disclosure Copy Communicative: 32.80% to 74.40% Number of industry/service provider Number Value 0.00 78.00 200.00 collaborations (Window 1) Date 31-Dec-2013 30-Jun-2016 Comments A total of 78 industry and service provider collaborations were established among the Page 10 of 13 The World Bank Report No: ISR13984 beneficiaries in the formal sector of the economy. Increased proportion of those trained that Percentage Value 0.00 27.32 50.00 become certified (disaggregated by gender and Public Disclosure Copy Date 31-Dec-2013 30-Jun-2016 age) Comments This indicator measures the number of certificates issued to trainees by training providers. 1,801 of 6,592 trainees (27.32%) havereceived certificates from the training providers. None of the training providers have COTVET Accreditation. New Training courses/new partnerships Number Value 0.00 34.00 20.00 established (Window 3) Date 31-Dec-2013 30-Jun-2016 Comments Number of partnerships: 25 Number of courses established through SDF: 9 (all windows) COTVET/ SDF/MEST New Technologies adopted by participating Number Value 0.00 14.00 120.00 firms (window 4) Date 31-Dec-2013 30-Jun-2016 Comments Each participating firm under Window 4 should incorporate 1 or more new technologies into its operations. Collaborations between enterprises and Number Value 0.00 10.00 60.00 Public Disclosure Copy technology centers (window 4) Date 31-Dec-2013 30-Jun-2016 Comments This indicator measures the number of collaborations between technology centers and enterprise 10 collaborations have led to the adoption of new technologies by enterprises Page 11 of 13 The World Bank Report No: ISR13984 11 other enterprises approached the technology centers to discussion their technology needs. None of Public Disclosure Copy these discussion have resulted in the sharing any technology. Grant agreements for SDF sub projects signed Number Value 0.00 247.00 440.00 (Project Management) Date 31-Dec-2013 30-Jun-2016 Comments A total of 6 were signed by the SDF Committee under Call 1 and 73 under Call 2. Under Call 3, 168 proposals were approved. Sub-projects satisfactorily completed Number Value 0.00 0.00 440.00 Date 31-Dec-2013 30-Jun-2016 Comments 26 projects had been completed at the end of December 2013 but none of them had actually been signed off as required by the SDF Manual. All of the completed projects are expected to be signed-off by a sub-committee of the SDF Grants Approval Committee before a final 10% of the fund withheld, as required by the SDF manual, is disbursed. Data on Financial Performance (as of 12-Mar-2014) Public Disclosure Copy Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P118112 IDA-48750 Effective 29-Mar-2011 15-Jun-2011 23-Nov-2011 30-Jun-2016 30-Jun-2016 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P118112 IDA-48750 Effective XDR 44.90 44.90 0.00 12.93 31.97 29.00 Disbursement Graph Page 12 of 13 The World Bank Report No: ISR13984 Public Disclosure Copy Key Decisions Regarding Implementation The Government and the Bank held a mid-term review (MTR) from December 2-12, 2013. Restructuring History There has been no restructuring to date. Related Projects There are no related projects. Public Disclosure Copy Page 13 of 13