The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Skills Development & Innovation Support (P128378) EUROPE AND CENTRAL ASIA | North Macedonia | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 11 | ARCHIVED on 12-Jun-2019 | ISR36938 | Implementing Agencies: Ministry of Finance, Ministry of Education and Science Key Dates Key Project Dates Bank Approval Date: 28-Jan-2014 Effectiveness Date: 11-Mar-2014 Planned Mid Term Review Date: 25-Sep-2017 Actual Mid-Term Review Date: 25-Sep-2017 Original Closing Date: 31-May-2019 Revised Closing Date: 30-Jun-2020 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective (PDO) is to improve transparency of resource allocation and promote accountability in higher education, enhance the relevance of secondary technical vocational education, and support innovation capacity in Macedonia. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Improving Transparency of Higher Education:(Cost $4.00 M) Modernization of Secondary Technical Vocational Education and Training:(Cost $4.50 M) Improving the innovative capacity of enterprises and collaboration with research organizations:(Cost $12.94 M) Project Management and Monitoring and Evaluation:(Cost $2.50 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions Despite significant progress in all components since the last review, the progress towards the Project Development Objective (PDO) and overall implementation progress are rated moderately satisfactory. The team believes that the recent 13-month extension of the project closing date will be sufficient for completion of key activities that will support the achievement of the PDO. There are two issues that require the team’s attention. One issue is related to the establishment of two important HE institutions, the Agency for Quality Assurance and the Higher Education Committee. They are not established yet, thought the process was initiated in December 2018. Given that these activities are key for achieving the HE related PDO outcomes, the team encouraged the government to complete both processes by the end of June 2019. The second issue is low disbursement rate. 6/12/2019 Page 1 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) The current disbursement rate is 39%. The recent mission assessed the likelihood of disbursing available loan proceeds within the remaining period. It seems that the government will be able to utilize all available funds. Namely, the implementation of many subcomponents has advanced significantly which has resulted in a total of 15,169,220 EUR (or 85,70% of loan proceeds) committed and/or disbursed. The project action plan and disbursement projections were updated. 6/12/2019 Page 2 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) 6/12/2019 Page 3 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Substantial Substantial Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and Sustainability -- Moderate Moderate Fiduciary -- Low Low Environment and Social -- Low Low Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results 6/12/2019 Page 4 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) PDO Indicators by Objectives / Outcomes Improving Transparency of Higher Education IN00699098 ►% of public universities receiving financing based on new, transparent funding model. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 28-Mar-2014 29-Oct-2018 23-May-2019 30-Jun-2020 The new Law on HE inter alia stipulates establishment of a National Council as a new independent body of experts, responsible for higher education and science and research. The National Council will have a mandate to propose a National Program for Higher Education and a Rulebook on the Measures and Comments: Criteria for the Financing of the HE. This body will be constituted by end June 2019. This Council will adopt the bylaw on financing. The reports that will underpin the by-law have been prepared. IN00699111 ►% of study programs accredited /reaccredited utilizing new quality assurance measures developed in accordance with Bologna-defined norms by the new Quality Assurance Agency (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 21-Jan-2019 29-Oct-2018 23-May-2019 30-Jun-2020 The new Law on HE inter alia stipulates establishment of an Agency for Quality Assurance, responsible for accreditation and institutional evaluation of the HE Institutions. This institution will be responsible for Comments: re-accreditation of all universities. The Agency should be established by September 2019. Modernization of Secondary Education Vocational Education and Training IN00699099 ►% of secondary TVET students benefiting from practical training in SME and large-sized firms. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 36.30 36.30 37.60 40.00 Date 18-Apr-2018 29-Oct-2018 23-May-2019 30-Jun-2020 Comments: Improving the Innovative Capacity of Enterprises and Collaboration with Research Organization IN00699100 ►Share of private funding mobilized as a percentage of FITD investments in innovation activities. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 35.10 73.20 25.00 6/12/2019 Page 5 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Date 28-Mar-2014 29-Oct-2018 07-Jun-2019 30-Jun-2020 IN00699112 ►% of beneficiaries that sign collaborative agreements between firms and academia. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 14.28 14.28 20.00 Date 28-Mar-2014 18-Apr-2018 23-May-2019 30-Jun-2020 Intermediate Results Indicators by Components Improving Transparency of Higher Education IN00699113 ►Implementation of new higher education funding model. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The possible funding models have been presented to the government and public The new funding model universities. will be determined after In accordance with the The new funding model the adoption of the draft new law for the Higher New funding model Value is not developed Law on the Higher Education a National implemented loped Education, which is Council on Higher expected by the June, Education should be 2018. established by end June 2019. This Council will adopt the bylaws on financing. Date 28-Mar-2014 29-Oct-2018 23-May-2019 30-Jun-2020 The possible funding models have been presented to the government and public universities. In accordance with the new law f or the Higher Education , a National Council on Higher Education should Comments: be established by end June 2019. This Council will adopt the bylaws on financing. IN00699117 ►Number of public universities that have completed an external evaluation utilizing new quality assurance measures developed in accordance with Bologna-defined EU norms and practices. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6.00 6.00 5.00 Date 28-Mar-2014 18-Apr-2018 18-Apr-2018 30-Apr-2019 EUA has completed evaluation of all six (6) HEIs, and has delivered 6 individual reports to the HEIs and Comments: one on system wide report to the MoES. IN00699121 ►National TTO established and operational (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence No No TTO operational 6/12/2019 Page 6 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Date 28-Mar-2014 29-Oct-2018 23-May-2019 30-Jun-2020 The Fund for Innovation and Technological Development is developing a feasibility study for a Science and Technology Park which is envisioned to include the NTTO. The Bank team discussed options for the NTTO as it is envisioned to be implemented under the SDIS project while a Science and Technology Park Comments: will take a longer time to be established. The World Bank team has been working with the FITD on development of a draft outline and timeline for the NTTO establishment. The implementation is delayed IN00699124 ►Agency for Quality Assurance and Accreditation achieves affiliate membership in ENQA (the European Association for Quality Assurance in Higher Education) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The law on Higher Education stipulates establishment of a new Agency for Quality Assurance. The new Agency will have a mandate to start implementing the quality assurance The draft law on Higher reforms toward Education envisages stabilizing the Board of Quality development of a new Agency for Quality accreditation system Assurance and Agency for Quality Assurance achieves Value support improvement Accreditation NOT a Assurance and alignment affiliate member status of the member of ENQA of its by-laws in in ENQA internal/institutional accordance with the quality assurance European standards and mechanisms. The guidelines. PMU has hired a local expert to support implementing reforms in compliance with the new Law on Higher Education. This activity is on track. Date 28-Mar-2014 29-Oct-2018 07-Jun-2019 30-Jun-2020 The law on Higher Education stipulates establishment of a new Agency for Quality Assurance. The new Agency will have a mandate to start implementing the quality assurance reforms toward stabilizing the accreditation system support improvement of the internal/institutional quality assurance mechanisms. The Comments: PMU has hired a local expert to support implementing reforms in compliance with the new Law on Higher Education.This activity is on track. Modernization of Secondary Technical Vocational Education and Training IN00699114 ►TVET action plan that promotes general and broader technical education and competence- based learning adopted (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not in existence Model adopted. Model adopted. Model adopted Date 10-Sep-2013 10-Oct-2017 10-Oct-2017 31-Jan-2016 IN00699118 ►% of developed TVET occupational standards by professional fields (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target 6/12/2019 Page 7 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Value 0.00 100.00 100.00 100.00 Date 10-Sep-2013 29-Oct-2018 29-Oct-2018 31-Jan-2019 IN00699125 ►% of updated TVET curricula in line with occupational standards (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6.00 69.00 100.00 Date 10-Sep-2013 29-Oct-2018 23-May-2019 30-Sep-2019 All curricula are developed, but only curricula for 1st, 2nd and 3rd year were adopted by the Minister. the Comments: remaining will be adopted by June 30. IN00699127 ►% Increase in number of companies providing practical training to secondary TVET students. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 20.00 21.79 30.00 Date 15-Jan-2015 29-Oct-2018 23-May-2019 30-Jun-2020 New data will be available by December 2019. This activity is on track. Comments: IN00699129 ►Manual and training materials for quality delivery of new curricula adopted (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 10-Sep-2013 10-Oct-2017 10-Oct-2017 31-May-2018 This activity is on track.. Comments: Improving the innovative capacity of enterprises and collaboration with research organizations IN00699116 ►Share of resources dedicated to Fund for Innovation and Technology Development (FITD) instruments disbursed (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 19.54 23.30 100.00 Date 10-Sep-2013 10-Oct-2017 23-May-2019 30-Jun-2020 The total amount dedicated to implementation of the innovation instrument will be fully disbursed by the current closing date of the project. Comments: IN00699120 ►Number of companies established via the FITD Accelerator program (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15.00 6/12/2019 Page 8 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Date 10-Sep-2013 29-Oct-2018 23-May-2019 30-Jun-2020 Under the call for establishing business accelerator, 3 accelerators are established. Contracts with 3 Comments: accelerators are signed. This activity is on track. IN00699123 ►Number of beneficiary firms to introduce new/improved products (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 51.00 84.00 55.00 Date 10-Sep-2013 29-Oct-2018 23-May-2019 30-Jun-2020 This is on track. Comments: IN00699126 ►% of beneficiaries receiving training and mentoring (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 70.00 Date 28-Mar-2014 29-Oct-2018 23-May-2019 30-Jun-2020 IN00699128 ►Number of beneficiary firms to introduce new processes (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 3.00 4.00 Date 10-Sep-2013 29-Oct-2018 23-May-2019 30-Jun-2020 Project Management and Monitoring and Evaluation IN00699115 ►Evaluations for Innovation grants designed, conducted and reports reported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The survey is ongoing. It is expected more Both the baseline and companies to be included follow up surveys are Evaluation reports Value Not in existence in the survey since not all ongoing. It is expected completed and results companies that were baseline to be finished disseminated included have by the end of 2019. responded. Date 10-Sep-2013 29-Oct-2018 23-May-2019 30-Jun-2020 This activity is on track. Comments: IN00699119 ►Skills Observatory established, providing information about TVET and HE performance to the public (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The activities for The info on platform The activities for Value Not in existence interconnection with being updated at least development of Skills Management Information twice per year Observatory are 6/12/2019 Page 9 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Systems of private finished. The activities universities are ongoing. for First Macedonian The activities for First Tracer study are Macedonian Tracer study finished. are finished. Date 10-Sep-2013 29-Oct-2018 23-May-2019 30-Jun-2020 The Website platform developed but it is not available for public to access info on performance of TVET and HE. The activities for interconnection with Management Information Systems of private universities Comments: are ongoing. This activity is on track. IN00699122 ►Percentage of students that participated in the Grant Program satisfied with their engagement during grant preparation (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 60.00 Date 13-Feb-2019 13-Feb-2019 13-Feb-2019 29-May-2020 The satisfaction survey will assess students’ satisfaction regarding their engagement during the grant preparation. The baseline survey should be conducted in summer 2019 and follow up in December 2019- Comments: May 2020. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P128378 IBRD-83320 Effective USD 24.00 24.00 0.00 9.45 13.01 42% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P128378 IBRD-83320 Effective 28-Jan-2014 07-Feb-2014 11-Mar-2014 31-May-2019 30-Jun-2020 Cumulative Disbursements 6/12/2019 Page 10 of 11 The World Bank Implementation Status & Results Report Skills Development & Innovation Support (P128378) Restructuring History Level 2 Approved on 01-Mar-2019 Related Project(s) There are no related projects. 6/12/2019 Page 11 of 11