Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) EUROPE AND CENTRAL ASIA | Kyrgyz Republic | Social, Urban, Rural and Resilience Global Practice Global Practice | Recipient Executed Activities | Investment Project Financing | FY 2017 | Seq No: 3 | ARCHIVED on 24-Jun-2019 | ISR36135 | Implementing Agencies: Aga Khan Foundation, Aga Khan Foundation Key Dates Key Project Dates Bank Approval Date:17-Feb-2017 Effectiveness Date:06-Jul-2017 Original Closing Date:30-Sep-2020 Revised Closing Date:30-Sep-2020 Project Development Objectives Project Development Objective (from Project Appraisal Document) The objective of the Project is to develop inclusive approaches to citizen engagement that support improvements in the accountability and responsiveness of teachers and school management in the poorest districts and contribute to enhancing student performance. Has the Project Development Objective been changed since Board Approval of the Project Objective? No PHRPDODEL Components Name Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Satisfactory  Moderately Satisfactory Overall Implementation Progress (IP)  Moderately Satisfactory  Moderately Satisfactory Implementation Status and Key Decisions The implementing partner, the Aga Khan Foundation in the Kyrgyz Republic (AKFK) has made progress in implementation of a project component supporting community engagement processes and capacity building in schools. Training of BoT members, school directors, and deputy directors has taken place; citizen engagement facilitators have been selected and trained in social contracting and community scorecards, all schools now have signed MOUs to enable better coordination and cooperation; and almost all 359 schools have held multi-stakeholder workshops to define rights and responsibilities. Clarifications are underway regarding the funding mechanism for the micro-grants component of the project, as well as the finalization of the Information subcomponent of the project through which parents are fully informed about budgets, national standards, and 6/24/2019 Page 1 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) school performance before engaging in community scorecards. Risks Overall Risk Rating Risk Category Rating at Approval Previous Rating Current Rating Overall  --  Moderate  Moderate Results Project Development Objective Indicators PHINDPDOTBL % of parents in the poorest districts who report that accountability and responsiveness of teachers and school management has improved as a result of proj-supported community engagement processes (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Zero (Aggregated benchmark +30% increase values: accountability and in average responsiveness of Not available satisfaction with Value teaches, 69.5%; -- service over accountability and baseline responsiveness of school management, 57.5%). Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments Results will be available when the end line survey is carried out in 2020. This PDO is measured through a basket of (3-5) pre-agreed characteristics of teacher performance that reflect level of accountability and responsiveness (e.g., teacher presence, better communication with parents, less informal payments), and (3-5) pre-agreed characteristics of school management that reflect level of responsiveness (e.g., openness to parent participation, school expenditures aligned to school needs, transparency of budgets). Respondents scoring on a 1-5 scale. Disaggregated by income and gender, and teacher and management results. Data source: Impact Evaluation Survey- with baseline. Survey in sites with and without project activities. Close-ended questionnaire to gauge satisfaction in areas of key expected results. Respondents in the baseline survey scored using a 1-7 Likert scale, not a 1-5 scale. PHINDPDOTBL % of students in the poorest districts who report that teacher accountability and responsiveness has improved as a result of project-supported community engagement processes (change in practice). (Text, Custom) 6/24/2019 Page 2 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) Baseline Actual (Previous) Actual (Current) End Target +30% increase Zero in average (Aggregated benchmark Not available satisfaction with Value -- value: 67.5%) service over baseline Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments Results will be available when the end-line survey takes place in 2020. This PDO is measured through a basket of (3-5) pre-agreed school management characteristics that reflect level of teacher performance in classroom that can be evaluated by students (e.g., teacher presence, teacher effort/communication, treat all students equally), with respondents The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) 8/31/2018 Page 6 of 13 scoring on a 1-5 scale. Disaggregated by gender. Data Source: Impact Evaluation Survey- with baseline. Survey in sites with and without project activities. Close- ended questionnaire to gauge satisfaction in areas of key expected results. Respondents in the baseline survey scored using a 1-7 Likert scale, not a 1-5 scale. PHINDPDOTBL % of parents in the poorest districts who report that they are more empowered to influence improvements in schools as a result of project-supported community engagement processes (empowerment). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target +40% increase in average Zero Not available perceived Value (Benchmark value: 46%) -- empowerment over baseline Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments No actual result will be available until the end-line survey takes place in 2020. Measured through a basket of (3-5) pre-agreed characteristics that reflect level of empowerment (e.g., willingness to voice needs, preferences reflected in joint action plans, willingness to contribute), with respondents scoring on a 1-5 scale Disaggregated by income and gender Data source: Impact Evaluation Survey- with baseline. Survey in sites with and without project activities. Close-ended questionnaire to gauge perceived levels of empowerment. PHINDPDOTBL Ratio of poor to non-poor households that report that engagement in their children'€€s education has improved as a result of project investments. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 6/24/2019 Page 3 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) 1.0 Poor households that Zero report (Benchmark value: 24/100) Not available Value -- increased (0.24) engagement is equal to that of non-poor households Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments Results will be available when the end-line survey takes place in 2020. Measures the level of inclusion as well as providing data on increased parent involvement. Data source: Impact Evaluation Survey- with baseline. Survey in sites with and without project activities. Close-ended questionnaire to gauge satisfaction in areas of key expected results (disaggregated by income level). PHINDPDOTBL % of target (JSDF-funded) schools that record an improvement in key student performance indicators (improved education outcomes). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Zero (Benchmark value: 65% +30% students students in targeted in target schools with good Not available schools Value -- academic performance reported about (good and excellent "5" improvements and "4" grades/marks in the official class journal)). Date 22-Jun-2017 -- 14-Jun-2019 30-Sep-2020 Comments Results will be available when the end-line survey takes place in 2020. This is measured through a basket of key student performance outcomes, to be selected with MoES. A difference of differences approach will be used to measure the improvement of JSDF-supported schools when compared with those in control districts (Which receive other capacity-building and supply-side support but do not receive demand-side/social accountability support). The methodology for IE will ensure that the controls are put in place to enable attribution of change to the project social accountability interventions. Data source: Impact Evaluation Survey- with baseline. Survey in sites with and without project activities. School-level student performance records. Overall Comments 6/24/2019 Page 4 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) Intermediate Results Indicators PHINDIRITBL % of Boards of Trustees (BoT) in target areas that demonstrate functionality and effectiveness. (organizational capacity) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 0.00 75.00 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments 0% of BoT in target areas have demonstrated functionality and effectiveness as none of them have completed the 5 criteria listed in the indicator description. Progress report on each of the 5 criteria: · % of BoTs in target areas who completed agreed training: 100%; · % of BoTs in target areas who supported formulation of social contract: 5 %; · % of BoTs in target areas who conducted an open budget hearing and performance review (of the budget): 21%; · % of BoTs in target areas who participated in community scorecard and JAP process: 0%; · % of BoTs in target areas who participated in the school-level JAP committee (disaggregated by activities): 0%. Progress on indicators (ii) to (v) will be provided to the Bank by AKFK by 31 April 2019 (submission of the next progress report). PHINDIRITBL % of schools posting budgets and holding open budget and performance review disclosing:(i) revenues&expenditures according to guidelines; and (ii) annual performance against national standards&targets (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Not available--result Value 0.00 -- available April 2019 50% Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments No (0%) schools have posted budgets and holding open budget and performance review disclosing: (i) revenues and expenditures according to guidelines; and (ii) annual performance against national standards and targets, because of billboards/posters for school data publication are still under development. AKFK will provide information on progress on this indicator by 31 April 2019 (submission of the next progress report). 6/24/2019 Page 5 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) PHINDIRITBL % of parents demonstrating enhanced understanding of school standards, performance and budgets (awareness/capacity). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Not available - Zero Result available April 50% Value (Benchmark value: 6%) -- 2019 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments The project did not observe any increase in parents' understanding of school standards, performance, and budgets. Data on this indicator will be reported to the World Bank by AKFK on 31 April 2019 (submission of the next progress report). PHINDIRITBL % of Citizen Engagement Facilitators (CEFs) (women/men) functionally active in the facilitation of citizen engagement processes. (effectiveness) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target (i) 5% (ii) 50% (iii) 50% Value Zero -- 75% (iv) 0% Result available April 2019 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments 0% of the CEF are functionally active in the facilitation of citizen engagement processes, because none of them have completed the 5 criteria listed in the indicator description. However, the project has achieved some interim results on some of the sub-criteria: · Facilitated social contract meeting: 5%; · Facilitated community scorecard meetings: 50%; · Assisted in facilitating an interface meeting: 50%; · Actively supported the implementation of at least one JAP action: 0%; • Received certification: 100%. 6/24/2019 Page 6 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) PHINDIRITBL % of beneficiaries reporting improved engagement channels in schools (voice). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Not available - results Zero Value -- available June 2019 75% Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments Data will be available when the school cycle ends in June 2019. PHINDIRITBL % of target schools demonstrating responsiveness to citizen feedback (responsiveness) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Zero Not available until Value -- 75% October 2019 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments The JAP development process has not yet started. Progress on this indicator will be provided to the World Bank by 31 October 2019 (5th progress report). PHINDIRITBL % of target schools demonstrating they are inclusive of the priorities of youth in the citizen feedback process (inclusiveness) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Not available until Value Zero -- 75% October 2019 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments The JAP development process has not yet started. Progress on this indicator will be provided to the World Bank by 31 October 2019. 6/24/2019 Page 7 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) PHINDIRITBL % of target schools that incorporate JAP actions into the SDP (institutionalization). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Zero Not available - results Value -- 75% available October 2019 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments The JAP development process has not yet started. Progress on this indicator will be provided tp the World Bank by 31 October 2019. PHINDIRITBL % of BoTs that publicly report on the timeliness, management and implementation of micro-grants (transparency). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 0% - activities Zero Value -- postponed until June 75% 2019 Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments The micro grants process has not yet been launched. AKFK is expected to report on this by 31 October 2019. PHINDIRITBL % of beneficiaries reporting that micro-grant investments met priority needs (responsiveness). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 0% - activities Zero Value -- postponed until Y3 75% Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Comments The micro grants process has not yet been launched. AKFK is expected to report on this by 31 October 2019. 6/24/2019 Page 8 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) PHINDIRITBL Stages reached in the execution of the M&E plan (qualitative). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Stage 1 & 2 are Value Zero -- complete, Stage 3 is Stage 4 & 5 expected in June 2019. Date 22-Jun-2018 -- 14-Jun-2019 30-Sep-2020 Overall Comments Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P159699 TF-A5035 Effective USD 2.73 2.73 0.00 1.02 1.71 38% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P159699 TF-A5035 Effective 21-Jun-2017 29-Jun-2017 06-Jul-2017 30-Sep-2020 30-Sep-2020 Cumulative Disbursements 6/24/2019 Page 9 of 10 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report Engaging Communities for Better Schools in the Kyrgyz Republic (P159699) Restructuring History There has been no restructuring to date. Related Project(s) There are no related projects. 6/24/2019 Page 10 of 10 Public Disclosure Copy