The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) Research and Innovation in Science and Technology Project (P121842) EAST ASIA AND PACIFIC | Indonesia | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2013 | Seq No: 13 | ARCHIVED on 24-Dec-2019 | ISR39928 | Implementing Agencies: Ministry of Finance, Ministry of Research Technology and Higher Education Key Dates Key Project Dates Bank Approval Date: 29-Mar-2013 Effectiveness Date: 12-Jun-2013 Planned Mid Term Review Date: 13-Jun-2016 Actual Mid-Term Review Date: 09-Feb-2016 Original Closing Date: 31-Dec-2020 Revised Closing Date: 31-Dec-2020 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) To create an enabling policy environment for research and development in science and technology, to improve thepublicresearchanddevelopment institutes’ performance, and to improve science, technology and innovation human resource capacity. Has the Project Development Objective been changed since Board Approval of the Project Objective? Yes Board Approved Revised Project Development Objective (If project is formally restructured) To support the government in: (1) improving STI human resource capacity; and (2) strengthening technology transfer, institutional functioning, and data management of public research agencies (LPNKs). Components Table Name Strengthening the Innovation System and Technology Transfer at Public Research Agencies:(Cost $2.50 M) Strengthening Public Research Funding:(Cost $2.50 M) Developing Science and Technology Human Resources Capacity:(Cost $68.00 M) Project Management:(Cost $7.00 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions 12/24/2019 Page 1 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) The overall implementation progress of the RISET Project towards the achievement of its Project Development Objective (PDO) has witnessed sound progress during this reporting period and the results have positively impacted the achievement of the PDO. Significant progress has been seen in Component 1 by implementing reforms in five Science and Technology Parks (STPs) supported by three LPNKs (Polewali Mandar in West Sulawesi (BATAN), Pelalawan in Riau (BPPT), Cibinong in West Java (LIPI), Jakarta (BATAN), and Cimahi (LIPI) and by improving their services and networking with industry. Support has also been provided to reform four Technology Transfer Offices (TTOs) in four LPNKs (BATAN, BPPT, LAPAN, LIPI) to institutionalize TTO management guidelines, including preparing Standard Operating Procedures (SOP) for technology valuation, developing an incentive system for intellectual property, and strengthening their human resources system. This is laying the ground for potentially strong uptake and adoption of these reforms by 7 public universities in Indonesia. Progress has also been seen in Component 2 with the continued facilitation of the International Research Funder Forum (IRFF) as well as the development of the Monevrisbang (Research and Development Monitoring and Evaluation system) which is already being used by LPNKs, such as LIPI, and by the MoF’s Palm Oil Research Funding Agency. Going forward, the plan is to increase usage of this system and link it to various data sources, such as the SATU DATA system of Bappenas, the LPDP research scholarship/program, and the Ministry of Home Affairs/local government research data, as well as to increase efforts to support the inclusion of Kemristek/BRIN and MoEC data on STI indicators into OECD’s Main S&T Indicators (MSTI). Component 3 also continues to make progress. Of the 457 scholars that are supported by the project, the number of graduates has increased from 123 in May 2019 to 222 (48.6 percent) to date in FY 2019. On the Non-Degree Program (NDP), the number of participants has increased slightly from 1,657 to 1,670 participants to date; however, an additional 251 participants will depart by December 31, 2019, for a total 1,921 NDP participants in FY 2019 (exceeding the target of 1,907 for FY 2019). On Component 4, the Project Management Office (PMO) has supported Component 1, 2 and 3 teams to conduct workshops, especially for the Degree and NDP alumni, thereby strengthening the research network and alumni knowledge sharing, also through IASPro (the RISET project’s alumni association). In order to expedite implementation, the PMO has conducted several internal meetings with project component teams and other relevant parties. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Moderate Moderate Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Substantial Substantial Institutional Capacity for Implementation and Sustainability -- Moderate Moderate Fiduciary -- Substantial Substantial Environment and Social -- Low Low Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Substantial Results 12/24/2019 Page 2 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) PDO Indicators by Objectives / Outcomes To support the government in improving STI human resources capacity IN00783498 ►3. Increased % of Master's and Ph.D. degree holders in LPNK and MoRTHE supported by the RISET Project (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 27.00 48.00 100.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 The number of RISET scholarship graduates has increased from 123 in May 2019 to 222 to date in 2019. Of these 222 graduates, 174 have returned to work at their LPNKs while the remaining 48 are still in transition (returning home and yet to be officially active in their work). Of these 174 graduates, 136 Comments: Master’s degree holders (78 percent) and 38 Ph.Ds (22 percent). While this is noteworthy, progress needs to be expedited to achieve the expected target (60 percent) set for 2019. IN00783501 ►4. Master’s degree holders who participate in applied science research programs (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 95.00 99.00 90.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 Of the 174 graduates, 134 (of 136 Master’s degree holders or nearly 99 percent) have been assigned to work upon their return that is related to their study programs. This indicator is thus on track and is likely to Comments: be achieved. IN00783502 ►5. Ph.D. degree holders who manage or coordinate applied science research programs (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 97.00 100.00 90.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 Of the 174 graduates, 38 Ph.Ds (out of 38 or 100 percent) have returned to work and are active as researchers in their respective LPNKs. Although to date, only 20 of these Ph.D. graduates (53 percent) Comments: are currently leading or coordinating research teams at their institutions, all of these Ph. D holders are playing significant role in their research teams and activities in their LPNKs. 2. To support the government in strengthening technology transfer IN00783499 ►1. LPNK research agency reforms are institutionalized (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Reforms are Value NA In progress In progress institutionalized Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 Progress has been seen in terms of reforms that are being implemented in five STPs supported by three Comments: LPNKs in Polewali Mandar in West Sulawesi (BATAN), Pelalawan in Riau (BPPT), Cibinong in West Java (LIPI), Jakarta (BATAN), and Cimahi (LIPI). The four TTOs in the four LPNKs are in process of endorsing 12/24/2019 Page 3 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) TTO management guidelines to be used formally in their daily operations, including preparing SOPs for technology valuation, developing an incentive system for intellectual property, and strengthening their human resources systems. 3. To support the government in strengthening institutional functioning and data management of LPNKs IN00783500 ►2. Improved regulation on the output-based cost standard for the STI research funding system issued on an annual basis (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Refined regulation is issued based on Value NA In progress In progress annual review covering research priorities Date 13-May-2011 15-May-2019 11-Dec-2019 31-Dec-2019 Facilitation of the International Research Funder Forum (IRFF) is continued as well as the development of the Monevrisbang (Research and Development Monitoring and Evaluation system) is already being used Comments: by LIPI and a MoF’s Agency and link to various research data sources in other ministries. Overall Comments PDO The work that is being implemented under the different components of the project are helping to achieve the PDO. To date, four of the five PDO indicators and 9 out of the 10 Intermediate Result Indicators (IRIs) have been achieved. The PMO needs to now expedite implementation to achieve PDO indicator 3, as well as IRI 5 by the time of the project’s closing date in December 2020. Intermediate Results Indicators by Components Strengthening the Innovation System and Technology Transfer at Public Research Agencies IN00783504 ►1. National innovation strategy is developed (Component 1) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Strategy action plans Strategy action plans Strategy action plans are submitted for have been submitted in have been submitted consideration to the Value NA the form of a technocratic in the form of a new national research paper for RPJMN 2020- technocratic paper for and innovation master 2024. RPJMN 2020-2024. plan Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2019 IN00783508 ►2. National Information System for STI is established and integrated into ministry’s database system (Component 1) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target STI data is continuously STI data is being collected, and the continuously being database is being collected, and the STI data is collected Value Not started expanded to include database is being and reported national, local expanded to include government, and national, local university STI data. 12/24/2019 Page 4 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) government, and university STI data. Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 The Directorate General of the Ministry of Research, Technology and Higher Education (MoRTHE) uses the Monevrisbang tool for monitoring the implementation and results of research programs funded by MoRTHE, including those in LPNKs and universities. The data in Monevrisbang is also used as the basis for the planning and budgeting of research programs that support national priorities undertaken by LPNKs, Comments: universities and MoRTHE. The link is: http://monevris.azurewebsites.net. The data is being used by LPNKs, such as LIPI, and by the MoF’s Palm Oil Research Funding Agency for their budgeting and decision-making purposes. IN00783512 ►3. Existing regulations in the STI legal framework are reviewed and modifications proposed (Component 1) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Reforms in five Science and Technology Parks (STPs) have been Final modifications are Modifications are institutionalized. Four proposed and discussed and validated Value NA Technology Transfer submitted for with relevant ministries Office (TTOs) involved consideration to and institutions. in the pilot are in the relevant ministries. process of endorsing TTO management guidelines. Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 Strengthening Public Research Funding IN00783505 ►1. Increased number of research programs in LPNKs and MoRTHE focused on higher ranks of the Technology Readiness Level (TRL) (Component 2) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Number of research Number of research Increased number of Value NA programs of higher TRL programs of higher research programs of are being identified. TRL is increasing. higher TRL Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2019 IN00783509 ►2. Strengthened R&D monitoring & evaluation capacity (Component 2) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6.00 10.00 12.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 Ten independent evaluations of multi-year research activities -- selected from the health, medicine, food/Agriculture, and energy research fields, advanced materials -- were conducted and lessons were Comments: drawn. Developing Science and Technology Human Resources Capacity IN00783503 ►1. Number of LPNK, MoRTHE, Research Agency staff who have studied overseas as supported by RISET-Project (Component 3) (Number, Custom) 12/24/2019 Page 5 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 457.00 457.00 422.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 IN00783507 ►2. Number of participants in RISET-Project’s Non-Degree professional courses and training (Component 3) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 1,670.00 1,921.00 1,907.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2018 IN00783511 ►Direct project beneficiaries (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 2,127.00 2,387.00 2,387.00 Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2019 IN00783513 Female beneficiaries (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 31.00 33.00 28.00 Project Management IN00783506 ►1. Project implementation and monitoring reports (include financial reports) are completed (Component 4) (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 For project implementation in FY 2019 (January to December 2019), the report will be issued in February Comments: 2020. Financial reports have been received in a timely manner. IN00783510 ►2. Computerized project monitoring database is established, updated, and key information is placed on MoRTHE project website (Component 4) (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 30-Sep-2013 15-May-2019 11-Dec-2019 31-Dec-2020 The link of the website is: http://risetpro.ristekdikti.go.id. The website has been steadily improved since 2014, including ensuring that the web-based complaint handling system is working properly. Between 2014 and 2016, complaints and inputs were mainly related Comments: to the lateness of scholarship payments that were received through emails from the scholarship recipients, as well as through scholar’s reports, messages/texts (WhatsApp), phone, and face to face meetings. The complaints were handled through the same means. From 2017 (after the project’s restructuring) to the present time, the project team has been receiving fewer complaints on the scholarship program and these 12/24/2019 Page 6 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) are also being dealt with in a more timely fashion. The website is also being updated to intensively include updated information on activities under Components 1 to 4 and impact to date. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P121842 IBRD-82450 Effective USD 95.00 80.00 15.00 66.45 13.55 83% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P121842 IBRD-82450 Effective 29-Mar-2013 12-Apr-2013 12-Jun-2013 31-Dec-2020 31-Dec-2020 Cumulative Disbursements 12/24/2019 Page 7 of 8 The World Bank Implementation Status & Results Report Research and Innovation in Science and Technology Project (P121842) Restructuring History Level 1 Approved on 30-Jan-2017 Related Project(s) There are no related projects. 12/24/2019 Page 8 of 8