The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Kosovo Education System Improvement Project (P149005) EUROPE AND CENTRAL ASIA | Kosovo | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2016 | Seq No: 7 | ARCHIVED on 08-May-2019 | ISR36613 | Implementing Agencies: Ministry of Education, Science and Technology, Republic of Kosovo Key Dates Key Project Dates Bank Approval Date: 10-Sep-2015 Effectiveness Date: 13-May-2016 Planned Mid Term Review Date: 05-Nov-2018 Actual Mid-Term Review Date: 12-Nov-2018 Original Closing Date: 31-Dec-2019 Revised Closing Date: 31-Dec-2019 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective is to strengthen selected systems that contribute to quality, accountability, and efficiency improvements in education in the Republic of Kosovo. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Enhancing strategic planning, financial management, monitoring and decision-making in the education sector:(Cost $3.13 M) Strengthening management capacity and accountability to enhance quality of education:(Cost $3.72 M) Implementation and Communications Support:(Cost $0.65 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Unsatisfactory Overall Implementation Progress (IP) Unsatisfactory Unsatisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions This ISR reflects the results of key actions taken: the Mid-Term Evaluation mission of November 12-16 and the Project Restructuring missions of February 3-8 and March 18-22, 2019. It also provides summary of next steps, including agreed action plan and WB implementation support. The mid-term evaluation for KESIP emphasized the managerial and institutional fragilities and recommended improvements. Despite the efforts by the counterparts and the Bank team to improve project implementation (after the December 2017 proactivity plan), KESIP mid-term evaluation revealed only moderate improvements in the project implementation. By the end of 2018, the learning assessment component and teacher performance evaluation had some progress, while the implementation of SDGs and EMIS remained slow. Disbursement rates increased from 6% to 16%, within one year of project closing. 5/8/2019 Page 1 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) As next steps following project restructuring, three components will be maintained which provide direct services to schools for quality accountability and efficiency: School Development Grants (promoting school management), Learning Assessment (providing indicators of the quality of learning) and the Teacher Performance Assessments and Professional Development technical assistance. Also, MEST and the World Bank agreed on immediate strengthening and monitoring of project coordination unit (PCU) and implementation support for the MEST Departments responsible for KESIP. Also, the Project Implementation Committee (PIC) has been reactivated with a Chair appointed by the Minister of Education, which will work together with the General Secretary to monitor KESIP and timely identify implementation problems and their solutions. A project extension of up to 12 months would be considered only if the project shows clear signals of progress by July 2019. Thus, two clear milestones have been agreed related to SDG disbursements and piloting of the Grade 12 (Matura) exam with new items aligned to curricular reforms and the National Student Assessment Framework. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Substantial Substantial Substantial Macroeconomic Substantial Substantial Substantial 5/8/2019 Page 2 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Moderate Low Institutional Capacity for Implementation and Sustainability Substantial High High Fiduciary Moderate Moderate Moderate Environment and Social Low Low Low Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Moderate Substantial Substantial Results PDO Indicators by Objectives / Outcomes Schools managing resources and quality investments to improve learning IN00699485 ►Beneficiary schools disseminating report on grant budget allocation and utilization (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 30.00 90.00 Date 30-Sep-2015 29-Dec-2017 12-Mar-2019 31-Dec-2019 Number of grant-recipient schools that disseminate their grant budget allocation and utilization reports, Comments: divided by the total number of grant-recipient schools. IN00699506 ►School report cards piloted at school level (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 20.00 Date 30-Sep-2015 29-Dec-2017 12-Mar-2019 31-Dec-2019 Number of schools that receive and publicly display school report cards, divided by the total number of schools. School report cards will contain information on student assessment/examination performance Comments: (Matura 12 exam), as well as other available information: enrollment, teachers and SDGs. IN00699510 ►Reforms to Standardized 12 grade Assessment Applied (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No -- No Yes Date 01-Jan-2019 -- 12-Mar-2019 31-Dec-2019 Overall Comments PDO 5/8/2019 Page 3 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) This project has been restructured and simplified. At the PDO level, two of the four original indicators have been dropped. These were related to the subcomponents targeting municipalities and higher education, which have been cancelled. One indicator related to education quality is added, focused on project investments to upgrade the 12 grade exit exam. Total, there are 3 PDO indicators after restructuring. Intermediate Results Indicators by Components Enhancing strategic planning, financial management, monitoring and decision-making in the education sector IN00699509 ►School developing plans for quality investments through school grants (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 140.00 150.00 Date 30-Sep-2015 29-Dec-2017 12-Mar-2019 31-Dec-2019 Target is met after training of school management committees (which include participation of community members/parents) and preparation of school development plans to be financed through School Comments: Development Grants (SDG). IN00699511 ►Number of schools that receive School Development Grants (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 43.00 150.00 Date 30-Sep-2015 06-Jun-2017 12-Mar-2019 31-Dec-2019 Comments: Total number of schools that receive School Development Grants financed under the Project. IN00699512 ►Number of beneficiary schools in which parents and/or community members were involved in grant planning or implementation (citizen engagement indicator) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 140.00 150.00 Date 30-Sep-2015 06-Jun-2017 12-Mar-2019 31-Dec-2019 Total number of grant-recipient schools in which parents and/or community members were involved in grant planning or implementation. This is the citizen engagement indicator. Comments: By March 2019, 140 schools have prepared school development plans, and 43 are implementing them. Strengthening management capacity and accountability to enhance quality of education IN00699484 ►Functional teacher professional development system Framework Designed (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Teacher School based teacher Value No -- Competencies professional Framework Published 5/8/2019 Page 4 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) development policy in place Date 30-Sep-2015 06-Jun-2017 31-Dec-2018 31-Dec-2019 Publishing and launching of the Teacher Professional Competencies and Development Framework. Comments: IN00699507 ►Functional teacher performance assesssment system is in place. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Pilot application Pilot application Value No -- completed completed Date 30-Sep-2015 06-Jun-2017 31-Dec-2018 31-Dec-2019 Target is met when teacher performance assessment is piloted and new system approved. Comments: IN00699508 ►Grade 12 examinations revised and piloted in line with Kosovo Curriculum Framework (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Revised Grade 12 Grade 12 exams not Grade 12 exams Pilot Value -- exams piloted and aligned with KCF preparation evaluated Date 30-Sep-2015 06-Jun-2017 12-Mar-2019 31-Dec-2019 Target is met when Grade 12 Matura student examinations are revised in line with the Kosovo Curriculum Comments: Framework and are validated through piloting and subsequent evaluation. Implementation and Communications Support IN00699483 ►Feedback from school directors on improved planning capacity (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Assessment Assessment findings Value No Assessment -- methodology being on principals' capacity revised building Date 30-Sep-2015 29-Dec-2017 12-Mar-2019 31-Dec-2019 The percent of school directors surveyed who report improvements in planning capacity on a set of specific tasks related to school development planning and implementation of SGDs, relative to the Comments: baseline. Overall Comments IR The above indicators are those agreed for the three sub-component remaining after project simplification and restructuring: SDGs, Learning Assessments and TA for Teacher Performance Assessment and Development. Data on Financial Performance 5/8/2019 Page 5 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P149005 IDA-57260 Effective USD 11.00 11.00 0.00 0.92 10.09 8.3% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P149005 IDA-57260 Effective 10-Sep-2015 20-Nov-2015 13-May-2016 31-Dec-2019 31-Dec-2019 Cumulative Disbursements Restructuring History Level 2 Approved on 25-Apr-2019 Related Project(s) There are no related projects. 5/8/2019 Page 6 of 6