The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Support to Upper Secondary Reform in Brazil Operation (P163868) LATIN AMERICA AND CARIBBEAN | Brazil | Education Global Practice | Requesting Unit: LCC5C | Responsible Unit: GED04 IBRD/IDA | Program-for-Results Financing | FY 2018 | Team Leader(s): Marcelo Becerra, Andre Loureiro Seq No: 3 | ARCHIVED on 11-Jun-2019 | ISR36753 | Created by: Andre Loureiro on 17-Apr-2019 | Modified by: Marcelo Becerra on 05-Jun-2019 Program Development Objectives Program Development Objective (from Program Appraisal Document) The Program Development Objectives (PDO) are to strengthen the capacity of the state secretariats of education to implement the upper secondary reform, prioritizing vulnerable schools, and to increase the Index of Basic Education Development in targeted full-time upper secondary schools in Brazil’s territory. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Unsatisfactory Implementation Status and Key Decisions The Basic Curriculum (BNCC) was approved in December 12, 2018, a crucial milestone for upper secondary reform implementation. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P163868 IBRD-88120 Effective USD 221.00 221.00 0.00 40.55 180.45 18% P163868 IBRD-88130 Effective USD 29.00 29.00 0.00 3.07 25.93 11% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P163868 IBRD-88120 Effective 14-Dec-2017 24-May-2018 23-Jul-2018 31-Dec-2023 31-Dec-2023 P163868 IBRD-88130 Effective 14-Dec-2017 24-May-2018 23-Jul-2018 31-Dec-2023 31-Dec-2023 Program Action Plan 6/11/2019 Page 1 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Action Description Publishing of a NEM Portaria regulating the support to implement the Upper Secondary Education Reform Source DLI# Responsibility Timing Timing Value Status Technical SEB Due Date 30-May-2018 Completed Completion Portaria Published Measurement Comments Action Description 20 states signed a NEM Portaria Commitment Agreement Source DLI# Responsibility Timing Timing Value Status Technical SEB, states Due Date 30-Apr-2019 Completed Completion Agreements Signed Measurement Comments Action Description Development of models of flexible curricula (BNCC and flexible itineraries) Source DLI# Responsibility Timing Timing Value Status Technical SEB/COEM Due Date 30-Oct-2019 Not Yet Due Completion Flexible Curriculums developed Measurement Comments Action Description Strengthening of the MEC institutional capacity for design and management of the implementation of the reform Source DLI# Responsibility Timing Timing Value Status SEB/COEM Recurrent Continuous In Progress Completion Measurement Comments Action Description Training of technical staff at the MEC and the SEE responsible for the design and implementation of the reform Source DLI# Responsibility Timing Timing Value Status 6/11/2019 Page 2 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Technical SEB/COEM Due Date 31-Oct-2019 Revised Date Completion Training provided Measurement Comments Action Description Establishment of the Special Bidding Committee Source DLI# Responsibility Timing Timing Value Status SEB/CPAG Due Date 14-Nov-2017 Completed Completion Measurement Comments Action Description TOR for technical, fiduciary, and safeguard functions for the PMU Source DLI# Responsibility Timing Timing Value Status SEB/COEM/CPAG Due Date 14-Nov-2017 Completed Completion Measurement Comments Action Description Establishment of the PMU with key staff as defined in the Program Operational Manual (POM) appointed Source DLI# Responsibility Timing Timing Value Status SEB/COEM/CPAG Due Date 30-Jul-2018 In Progress Completion Measurement Comments Action Description Provision of procurement, FM, and disbursement training to the SEB and the PMU staff Source DLI# Responsibility Timing Timing Value Status World Bank Due Date 30-Aug-2018 In Progress Completion Measurement 6/11/2019 Page 3 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Comments Action Description Preparation of POM Source DLI# Responsibility Timing Timing Value Status SEB Due Date 14-Nov-2017 Completed Completion Measurement Comments Action Description TOR for the studies and consultancies to be selected during the first eight months of implementation Source DLI# Responsibility Timing Timing Value Status Technical SEB Due Date 31-Oct-2019 In Progress Completion TORs developed Measurement Comments Action Description Need to observe the World Bank ACG in a legal/binding document Source DLI# Responsibility Timing Timing Value Status SEB Due Date 14-Nov-2017 Completed Completion Measurement Comments Definition of a communication, consultation, and negotiation strategy to mitigate risks of creating or exacerbating Action Description social conflict with key stakeholders (teachers and labor unions) Source DLI# Responsibility Timing Timing Value Status SEB/PMU Due Date 30-Jul-2018 Completed Completion Measurement Comments 6/11/2019 Page 4 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Action Description Preparation of the TOR for financial audits Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems SEB Recurrent Yearly In Progress Completion Draft TORs Measurement Comments Development of a Gender Plan, based on in-depth diagnosis, including successful national and international Action Description experiences Source DLI# Responsibility Timing Timing Value Status SEB Due Date 31-Aug-2018 In Progress Completion Measurement Comments Action Description Support of activities (guidelines, awareness, technical support) to implement the Gender Plan and good practices Source DLI# Responsibility Timing Timing Value Status SEB/CPAG Recurrent Continuous In Progress Completion Measurement Comments Look for budgeting based on data that reflects the market and not just on official tables issued by various spheres of Action Description Government Source DLI# Responsibility Timing Timing Value Status SEB Recurrent Continuous In Progress Completion Measurement Comments Action Description Contract management improvement Source DLI# Responsibility Timing Timing Value Status 6/11/2019 Page 5 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) SEB Recurrent Continuous Not Yet Due Completion Measurement Comments Hire consultants to work at the state level to provide capacity building through the TA component, expedite Action Description implementation, and ensure the proper use and documentation of funds Source DLI# Responsibility Timing Timing Value Status SEB Recurrent Continuous Delayed Completion Measurement Comments Revision of complementary rules for transfer of financial resources (Resolution MEC/FNDE 07/2016), including socio Action Description environmental, health, and safety aspects of the Program's conditionality Source DLI# Responsibility Timing Timing Value Status MEC Due Date 30-Apr-2018 Completed Completion Measurement Comments Implementation of a unit in the Program with the specific mission of offering TA to the states and the Federal District Action Description regarding the implementation of socioenvironmental, health, and safety requirements Source DLI# Responsibility Timing Timing Value Status Environmental and Social MEC Due Date 30-Apr-2019 In Progress Systems Completion TA to states carried out Measurement Comments Institutional Strengthening of Implementing Agencies: Training program for engineering, environmental, management, Action Description and health and safety teams of the SEE with lower institutional capacity Source DLI# Responsibility Timing Timing Value Status 6/11/2019 Page 6 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Environmental and Social MEC Due Date 30-Apr-2019 In Progress Systems Completion Training carried out Measurement Comments Action Description Operationalization of the dedicated grievance redress mechanism Source DLI# Responsibility Timing Timing Value Status Environmental and Social MEC Due Date 30-Apr-2019 In Progress Systems Completion Mechanisms developed Measurement Comments Elaboration of an Environmental and Social Management Framework and application of the verification form, Action Description including the formulation of guidelines and manuals for several themes Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems MEC Due Date 30-Apr-2019 In Progress Completion ESMF developed Measurement Comments Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance High High High Macroeconomic Substantial Substantial Substantial Sector Strategies and Policies Substantial Substantial Substantial Technical Design of Project or Program High High High Institutional Capacity for Implementation and Sustainability High High High Fiduciary Substantial Substantial Substantial 6/11/2019 Page 7 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Environment and Social Moderate Moderate Moderate Stakeholders Substantial Substantial Substantial Other -- -- -- Overall Substantial Substantial Substantial RiskComments Comments The social risk is rated as moderate at this stage of project implementation. The project has developed strong mechanisms for engagement of key stakeholders and is developing a grievance redressing mechanism. A social safeguard specialist is being hired for the Project Management Unit. Policy changes and Program for Results activities will neither interfere with the legislation and policy of Indigenous Peoples’ education, nor require land acquisition and exacerbate conflicts. Policy changes and Program for Results activities are expected to have a positive impact on the most vulnerable social groups. Results PDO Indicators by Objectives / Outcomes Number of States where at least 40% of schools have implemented the new curriculum IN00693633 ►Number of States where at least 40% of schools have implemented the new curriculum (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 27.00 Date 08-Mar-2018 08-Mar-2018 20-May-2019 31-Dec-2023 Comments IN00693634 ►Number of States where at least 50 percent of vulnerable schools have implemented the New Curriculum (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 27.00 Date 09-Mar-2018 09-Mar-2018 20-May-2019 31-Dec-2023 Comments IN00693635 ►Percentage change in the Basic Education Development Index (IDEB) in Targeted FTS (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 18.00 Date 09-Mar-2018 09-Mar-2018 20-May-2019 31-Dec-2023 Comments Intermediate Results Indicators by Results Areas 6/11/2019 Page 8 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Area 1: Support the implementation of the new curriculum IN00693636 ►The MEC NEM Portaria regulating the support to the Upper Secondary Education Reform has been publish (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Not Published Active Published and Active Active Date 12-Mar-2018 12-Mar-2018 11-Jul-2018 31-Dec-2023 Comments IN00693639 ►Analytical Reference Tools for the implementation of NEM are developed and disseminated to SEE (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Developed and Value Not Developed No Developed Yet No Developed Yet Disseminated Date 12-Mar-2018 12-Mar-2018 20-May-2019 31-Dec-2023 Comments IN00693642 ►Number of States that formally signed a NEM Portaria Commitment Agreement (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 20.00 20.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693645 ►Number of States that achieved 75% of the key objectives included in their NEM Implementation Plans (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 22.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693648 ►Number of States that have their curricula adapted to NEM, validated and published by each State (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693650 6/11/2019 Page 9 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) ►N of States that have trained at least 40% of school principals and school coordinators in the New S (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693651 ►NEM pedagogic materials have been developed by MEC and disseminated to the schools by SEE (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Developed and Value No 2,017.00 2,018.00 disseminated Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693652 ►Number of States with schools in NEM Implementation Pilots (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 20.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693653 ►Number of States with NEM Implementation Plans with specific strategies to implement NEM in Vulnerab (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693654 ►Number of States where at least 20% of NEM Implementation Pilots have at least one technical educati (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693655 ►Number of States with a satisfactory level in a Curricular Reform Implementation and Monitoring Capa (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 6/11/2019 Page 10 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693656 ►Number of States that have trained key SEE staff in the new state curriculum (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693657 ►Number of States that have M&E systems monitoring the implementation of the reform in the accomplish (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 22.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments Area 2: Promoting the expansion of full-time schools IN00693638 ►Percentage point change in passing rates in targeted full-time schools (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 14.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693641 ►Number of States that have their revised FTS Implementation Plans approved by MEC (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 25.00 25.00 27.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693644 ►Evaluations and adjustment of the FTS program have been carried out. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target A Midterm Evaluation No FTS review is in place A pre-evaluation is is Satisfactorily Value (2017) No done yet Satisfactorily completed completed and its results Disseminated 6/11/2019 Page 11 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693647 ►IR Indicator 3.4: Percentage of agreed FTS key process targets achieved by States as included in the (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 75.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments Overall Indicators IN00693637 ►Number of states that have achieved 50% of planned activities promoting the participation of local (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 25.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693640 ►Number of SEE with school-based interventions to promote gender equality in at least 40% of their sc (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 20.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693643 ►Percentage of female students enrolled in natural sciences and math itineraries (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 45.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments IN00693646 ►States where the average absolute gender gap of enrollment in formative itineraries is less than 5% (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 27.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 6/11/2019 Page 12 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Comments IN00693649 ►Students benefiting from direct interventions to enhance learning (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 2,400,000.00 Date 12-Mar-2018 12-Mar-2018 03-Jun-2019 31-Dec-2023 Comments Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 The MEC NEM Portaria regulating the support to the Upper Secondary Education Reform has been published by MEC (Process, 30,000,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value Not Published Published Published -- Date -- 10-Jul-2018 10-Jul-2018 -- Comments ►DLI 2 Number of States that formally signed a NEM Portaria Commitment Agreement (Process, 12,500,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 20.00 20.00 -- Date -- 28-Sep-2018 28-Sep-2018 -- Comments ►DLI 3 Number of States that achieved 75% of the key objectives included in their NEM Implementation Plans (Intermediate Outcome, 32,947,500.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 0.00 0.00 -- Date -- -- -- -- Comments 6/11/2019 Page 13 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) ►DLI 4 Number of States that have their curricula adapted to NEM, validated and published by each state (Output, 25,000,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 0.00 0.00 -- Date -- -- -- -- Comments ►DLI 5 Number of States that have trained at least 40% of school principals and school coordinators in the New State Curriculum (Output, 25,000,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 0.00 0.00 -- Date -- -- -- -- Comments ►DLI 6 Number of States with schools in NEM Implementation Pilots (Output, 20,000,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 0.00 0.00 -- Date -- -- -- -- Comments ►DLI 7 Number of States that have their revised FTS Implementation Plans approved by MEC (Output, 15,000,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 25.00 25.00 -- Date -- 29-Jun-2018 29-Jun-2018 -- Comments ►DLI 8 Evaluations and adjustment of the FTS program have been carried out (Output, 32,500,000.00, 0%) 6/11/2019 Page 14 of 15 The World Bank Implementation Status & Results Report Support to Upper Secondary Reform in Brazil Operation (P163868) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value No review is in place No review is in place No review is in place -- Date -- -- -- -- Comments ►DLI 9 Percentage of agreed FTS key process targets achieved by States as included in their FTS Implementation Plans (Intermediate Outcome, 30,000,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 0.00 0.00 -- Date -- -- -- -- Comments ►DLI 10 Number of States with NEM Implementation Plans with specific strategies to implement NEM in Vulnerable Schools (Process, 12,500,000.00, 0%) Loan signing - Closing Date Baseline Actual (Previous) Actual (Current) (12/2023) Value 0.00 0.00 0.00 -- Date -- -- -- -- Comments 6/11/2019 Page 15 of 15