The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) Pacific Aviation Safety Office Reform (P145057) EAST ASIA AND PACIFIC | Pacific Islands | Transport Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 12 | ARCHIVED on 14-Jun-2019 | ISR37456 | Implementing Agencies: Pacific Aviation Safety Office, Pacific Aviation Safety Office Key Dates Key Project Dates Bank Approval Date: 30-Sep-2013 Effectiveness Date: 12-Dec-2013 Planned Mid Term Review Date: 01-Jul-2016 Actual Mid-Term Review Date: 20-Apr-2016 Original Closing Date: 31-Dec-2018 Revised Closing Date: 31-Dec-2021 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) To ensure effective regional delivery of aviation safety and security oversight in Pacific Island Countries by strengthening thePacific Aviation Safety Office’s technical and coordination capacity. Has the Project Development Objective been changed since Board Approval of the Project Objective? Yes Board Approved Revised Project Development Objective (If project is formally restructured) The project development objective is to strengthen the coordination capacity of the Pacific Aviation Safety Office to deliver regional aviation safety and security oversight, and technical and advisory services to the Pacific Island Countries. Components Table Name Component A: Transitional Management and Support:(Cost $1.75 M) Component B: Establishment of a Pool of Regional Aviation Inspectors:(Cost $0.27 M) Component C: Quality Management:(Cost $0.23 M) Component D: Safety Equipment and Infrastructure:(Cost $0.85 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions Further to the approval of an Additional Financing of US$3.55 million equivalent from the regional IDA Grant envelope on May 23, 2018 and the three-year closing date extension to 31 December 2021, PASO is continuing its reform activities. 6/14/2019 Page 1 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) Its Management Team (comprised of a General Manager, an Operations Manager, and a Corporate Services Manager) is now operational; the PASO Council has endorsed the recommendation of the Financial Management and Sustainability Analysis to implementing a new 'total cost model'; PASO services (support from its pool of inspectors who provide expert advice to regulatory authorities, with the technical specialists on the registry implementing State’s agreed annual work plans; level of oversight days conducted; expansion of advisory services related to addressing gaps in States’ regulatory frameworks) are increasingly requested, reflecting the improved level of confidence in PASO inspectorate knowledge and skills. Further details (including the adoption of new business materials by the PASO Council) will be provided after the implementation support mission scheduled in end July, 2019. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Substantial Substantial Sector Strategies and Policies -- Substantial Substantial Technical Design of Project or Program -- Substantial Substantial Institutional Capacity for Implementation and Sustainability -- Substantial Substantial Fiduciary -- Substantial Substantial Environment and Social -- Low Low Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results PDO Indicators by Objectives / Outcomes strengthen PASO coordination capacity IN00712071 ►Indicator One: Successful recruitment of General Manager, Operations Manager, Corporate Services Manager (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target General Manager General Manager appointed in October appointed in October 2016. Operations General Manager, 2016. Operations Manager appointed in Operations Manager, Value No positions filled Manager appointed in April 2018. Corporate Corporate Services April 2018. Corporate Services Manager Manager in place Services Manager appointed in May appointed in May 2018. 2018. Date 01-Nov-2013 06-Nov-2018 06-Nov-2018 31-Dec-2019 6/14/2019 Page 2 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) The reform project originally envisaged recruiting three technical staff to coordinate oversight areas (airworthiness, flight operations, and aerodromes/security). PASO Council endorsed a new organizational framework that was recommended as part of the “PASO Governance and Management” Comments: assignment, which sought to have a General Manager, Operations Manager, and a Corporate Services Manager rather than appointing technical experts as fulltime inspectorate staff. The indicator has been revised as part of a restructuring under the Second Additional Finance. IN00712073 ►International Civil Aviation Organiziation evaluation of PASO's function within the Global Aviation Safety Oversight System (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Level 1 TBD TBD Level 2 Date 01-Jun-2018 06-Nov-2018 06-Nov-2018 31-Dec-2021 Indicator 4: Based on an International Civil Aviation Organization proposal to evaluate Regional Safety and Security Oversight Organizations (RSOO) through a tiered Global Aviation Safety Oversight System Comments: approach based on service classification, a new indicator would reflect an expansion of PASO’s likely classification as a Level 1 provider to achieve a Level 2 outcome at the end of the project. deliver regional aviation safety & security oversight, and technical and advisory services to PICs IN00712072 ►Indicator Two: Establishment of a Register of Inspectors (ROI) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Target Met. Updated Target Met. Updated ROI ROI in place. The in place. The register of register of inspectors Value No ROI inspectors was Updated ROI in place was established in established in June 2014 June 2014 and and endorsed by Council. endorsed by Council. Date 01-Nov-2013 06-Nov-2018 06-Nov-2018 31-Dec-2018 Indicator Two: The Establishment of a Pool of Regional Aviation Inspectors was achieved early in the project cycle (2014). The registry comprises qualified technical experts from Australia, New Zealand, Fiji, and Tonga across the following specializations; aerodromes, airworthiness, air navigation services, and flight operations. There are currently nine persons within the pool, including: two airworthiness inspectors; Comments: two flight operations inspectors; one aerodrome inspector; two air traffic inspectors; and two security inspectors. Additional personnel that are used based on the needs of the States and timing can vary, but have been as many as 10 other individuals. IN00712074 ►Indicator Three: Recommended Annual Work Program Implemented by PASO Members (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 12.50 80.10 80.10 80.00 Date 01-Nov-2013 06-Nov-2018 06-Nov-2018 31-Dec-2021 Indicator Three: Target achieved in 2017, but will be continually monitored over the project life cycle. The figure represents the average ‘planned versus actual’ scheduled minimum annual work program performed for all 10 PASO Member States. The calculation is determined as follows: (a) if the number of days performed for a Member State exceeds the planned work days due to additional, ad-hoc Comments: activity requests, a value of 100% is recorded for that State; and (b) If zero days were planned for a Member State, the country’s contribution is excluded from the average calculation, rather than accounting zero. This method avoids a misleading deflation or inflation of the average. With a target for undertaking 80 percent of the recommended Annual Work Programs implemented by PASO member states, implementation rates average 68.7% (2014); 49.9% (2015); 61.7% (2016), and 6/14/2019 Page 3 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) 80.1% (2017), respectively, over the project period. More critical is the level of oversight days conducted, which has generally seen an increase from 272 days in 2014 to 426 days in 2017. Beyond the minimum scheduled oversight regimes, 2016 and 2017 witnessed additional expansion of advisory services related to addressing gaps in States’ regulatory frameworks undertaken by PASO through funding provided by New Zealand Ministry of Foreign Affairs and Trade (MFAT). Intermediate Results Indicators by Components Component A: Transitional Management and Support IN00712075 ►Component A: Intermediate Results Indicator One: Revised governance structure (technical and financial committee composition), as per PASO Constitution (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Current PASO Constitution. Legal Current PASO Advisor has completed Constitution. Legal new draft Hosting Advisor has completed Agreement; new draft Hosting Institutional Specialist Agreement; Institutional has reviewed and Specialist has reviewed updated: (i) PASO and updated: (i) PASO Employment Policy Employment Policy and and Procedures Procedures Manual; (ii) Manual; (ii) PASO's PASO's Finance Policies Updated PASO Value PASO Constitution Finance Policies and and Procedures manual; Constitution Procedures manual; (iii) PASO Governance (iii) PASO Governance and Restructuring and Restructuring Finding and Finding and Recommendations/ Recommendations/ Governance and Governance and Procedures Manual; and Procedures Manual; (iv) Skills development and (iv) Skills and Training policy - development and Adopted by Council Training policy - Adopted by Council Date 01-Aug-2013 06-Nov-2018 06-Nov-2018 31-Dec-2019 IN00712079 ►Component A: Intermediate Results Indicator Two: Revised financing mechanism for sustainability (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Partially Achieved. The Partially Achieved. The Final Report for the Final Report for the Financial Sustainability Financial Sustainability Analysis accepted and Existing funding Analysis accepted and Sustainable Financing Value PASO Council, and a mechanism inadequate PASO Council, and a Mechansim in place new 'total cost model' new 'total cost model' is t is t be made effective be made effective beginning January beginning January 2020. 2020. Date 01-Aug-2013 06-Nov-2018 06-Nov-2018 01-Jan-2020 Component B: Establishment of a Pool of Regional Aviation Inspectors IN00712076 6/14/2019 Page 4 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) ►Component B: Intermediate Results Indicator One: Adherence to Agreed Annual Work Plans (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 0.00 Date 01-Jan-2013 06-Nov-2018 06-Nov-2018 31-Dec-2021 Sub-indicators below reflect each Member States' engagement of PASO in the planned annual work program. The average percentage across PASO is captured in PDO-level indicator three above. The indicator Comments: * Note: Solomon Islands opted not to engage PASO services between 2015-2017, but is expected to re- engage in 2018. IN00712081 Annual Work Plan Implemented - Kiribati (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 130.00 82.00 82.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712083 Annual Work Plan Implemented - Cook Islands (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712084 Annual Work Plan Implemented - Nauru (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712085 Annual Work Plan Implemented - Niue (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712086 Annual Work Plan Implemented - Papua New Guinea (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 42.00 42.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712087 Annual Work Plan Implemented - Samoa (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 54.00 100.00 100.00 80.00 6/14/2019 Page 5 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712088 Annual Work Plan Implemented - Solomon Islands (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 24.00 0.00 0.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712089 Annual Work Plan Implemented - Tonga (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 62.00 100.00 100.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712090 Annual Work Plan Implemented - Tuvalu (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 54.00 54.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712091 Annual Work Plan Implemented - Vanuatu (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 27.00 100.00 100.00 80.00 Date 01-Jan-2013 01-Jan-2018 01-Jan-2018 31-Dec-2021 IN00712092 ►Beneficiaries of job-focused interventions (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 10.00 Date 01-Jun-2018 01-May-2018 01-May-2018 31-Dec-2021 The project will aim to expand the register of inspectors to include at least two female candidate Comments: inspectors for requisite training programs under PASO’s Pacific Inspector Development Program. IN00712093 Beneficiaries of job-focused interventions - Female (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 2.00 Component C: Quality Management IN00712077 ►Component C: Intermediate Results Indicator One: Establishment of Quality Assurance System (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 6/14/2019 Page 6 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) Achieved: The QA Achieved: The QA system has been system has been No Quality Assurance Quality Assurance Value completed, and endorsed completed, and System System in Use by PASO Council in Nov endorsed by PASO 2017. Council in Nov 2017. Date 01-Aug-2013 06-Nov-2018 06-Nov-2018 31-Dec-2018 IN00712080 ►Component C: Intermediate Results Indicator Two: Modernization of communication technology (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Internet bandwidth Internet bandwidth upgraded. IT Strategy upgraded. IT Strategy and Implementation and Implementation Plan Plan completed. New Inadequate ICT system completed. New website Upgraded ICT System Value website is under in use is under development. in use development. Rollout Rollout of IT System to of IT System to be be funded by Additional funded by Additional Financing. Financing. Date 01-Aug-2013 06-Nov-2018 06-Nov-2018 31-Dec-2020 IN00712082 ►Project-supported organization(s) publish reports on effect of collaboration on project/program/policies (Yes/No) (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 01-Jun-2018 06-Nov-2018 06-Nov-2018 31-Dec-2021 PASO has made a commitment to improve public access to information through on-line publication of relevant organizational documents and records (such as the Strategic Plan, the Annual Business Plan, Comments: Annual Reports, Quarterly Reports, etc.) as part of a planned website update. Component D: Safety Equipment and Infrastructure IN00712078 ►Component D: Supporting Regional Aviation Infrastructure (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Selection of Design Selection of Design services completed/ services completed/ Value No VSAT VSAT operating goods acquisition under goods acquisition procurement under procurement Date 02-Jan-2017 06-Nov-2018 06-Nov-2018 01-Jul-2019 Regional aeronautical data and communication network through the acquisition and installation of very Comments: small aperture terminal (VSAT) equipment for the Cook Islands and Niue Data on Financial Performance Disbursements (by loan) 6/14/2019 Page 7 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P145057 IDA-D3190 Effective USD 3.55 3.55 0.00 0.40 3.08 12% P145057 IDA-H8830 Effective USD 2.15 2.15 0.00 2.17 0.00 100% P145057 TF-A3687 Effective USD 0.95 0.95 0.00 0.34 0.61 36% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P145057 IDA-D3190 Effective 23-May-2018 09-Jul-2018 03-Sep-2018 31-Dec-2021 31-Dec-2021 P145057 IDA-H8830 Effective 30-Sep-2013 01-Nov-2013 12-Dec-2013 31-Dec-2018 31-Dec-2021 P145057 TF-A3687 Effective 02-Feb-2017 02-Feb-2017 13-Feb-2017 31-Dec-2018 31-Dec-2019 Cumulative Disbursements Restructuring History Level 2 Approved on 18-Dec-2018 Related Project(s) 6/14/2019 Page 8 of 9 The World Bank Implementation Status & Results Report Pacific Aviation Safety Office Reform (P145057) P157635- Pacific Aviation Safety Office Reform Project Additional Financing ,P164468-Pacific Aviation Safety Office Reform Project Additional Financing II 6/14/2019 Page 9 of 9