The World Bank Report No: ISR12551 Implementation Status & Results Colombia Science, Technology and Innovation (P117590) Public Disclosure Copy Operation Name: Science, Technology and Innovation (P117590) Project Stage: Implementation Seq.No: 6 Status: ARCHIVED Archive Date: 09-Dec-2013 Country: Colombia Approval FY: 2011 Product Line: IBRD/IDA Region: LATIN AMERICA AND CARIBBEAN Lending Instrument: Adaptable Program Loan Implementing Agency(ies): Colciencias Key Dates Board Approval Date 15-Jul-2010 Original Closing Date 31-Dec-2013 Planned Mid Term Review Date 30-Jul-2012 Last Archived ISR Date 16-May-2013 Effectiveness Date 20-Oct-2010 Revised Closing Date 31-Aug-2015 Actual Mid Term Review Date 03-Aug-2012 Project Development Objectives Project Development Objective (from Project Appraisal Document) The objectives of the Project are to: (i.) strengthen COLCIENCIAS’ ability to promote human capital for the knowledge economy, R&D and innovation; and (ii) raise awareness of science, technology, and innovation in Colombian society. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Strengthening COLCIENCIAS' operational and policy making capacity; institutional strengthening of 5.80 the Science, Technology and Innova tion National System Strengthening COLCIENCIAS' capacity to promote development of human capital for science and 7.20 technology Strengthening COLCIENCIAS' capacity to promote research and innovation; investment for research 8.50 and innovation Promoting Social Dissemination of Science, Technology and Innovation and Institutional 3.50 Public Disclosure Copy Communication Overall Ratings Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Moderate Implementation Status Overview Page 1 of 6 The World Bank Report No: ISR12551 Positive progress has been made on one of the three Project Development Objectives (PDOs) indicators. As a measure of Colciencias' ability to promote human capital for the knowledge economy, R&D and innovation , the percentage of budget resources committed from the budget appropriation was at 66% which exceeds the project target of 60% by end of second quarter (end June, 2013) and shows increased efficiency in executing programs. The number of new ideas or innovations developed by the labor insertion, diaspora research, innovation management, open innovation, and priority area program activities, the second measure of Colciencias' ability to promote human capital for the knowledge Public Disclosure Copy economy, R&D and innovation is expected to be measured through the evaluations of each of these pilot programs beginning in 2014. Preliminary results, however, show positive progress towards the PDO. The third indicator, the percentage of the population that agrees that Colciencias creates science and technology, as a measure of raised awareness of STI in Colombian society, is expected to be available in 2014. Locations No Location data has been entered Results Project Development Objective Indicators Indicator Name Core Unit of Measure Baseline Current End Target Number of new ideas or innovations developed Number Value 0.00 0.00 30.00 by labor insertion, diaspora research, Date 30-Sep-2013 31-Aug-2015 31-Aug-2015 innovation management, open innovation and Comments Not yet due. priority area program activities reflected in components 2, 3, and 4. Percent of population that agrees that Percentage Value 75.00 75.00 76.00 Colombia creates Science Date 30-Sep-2012 30-Sep-2013 31-Aug-2015 Comments Percent of population that agrees that Percentage Value 72.00 72.00 73.00 Colombia creates Technology. Date 30-Sep-2012 30-Sep-2013 31-Aug-2015 Comments COLCIENCIAS# operational efficiency Percentage Value 4.80 66.00 60.00 (Percentage of COLCIENCIAS# annual Date 31-Dec-2009 30-Sep-2013 31-Dec-2013 investment budget committed by the end of the Comments Corresponds to the second quarterof the calendar year) Public Disclosure Copy percentage of resources from the budget appropriation committed as of September 30, 2013. Exceeds target. Intermediate Results Indicators Page 2 of 6 The World Bank Report No: ISR12551 Indicator Name Core Unit of Measure Baseline Current End Target Revised COLCIENCIAS' convocatoria Text Value 0 Yes Yes processes, from call-for-proposals to Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 Public Disclosure Copy subproject monitoring, developed and Comments approved by COLCIENCIAS Board of Directors Direct project beneficiaries Number Value 0.00 0.00 1230126.00 Date 30-Sep-2013 31-Aug-2015 Comments Will be collected at the end of 2013, with an expected number of total beneficiaries at 1,230,126 Female beneficiaries Percentage Value 0.00 0.00 10.00 Sub Type Supplemental Number of R&D and innovation subprojects in Number Value 0.00 2.00 2.00 priority areas (biofuels and renewable energy). Date 30-Sep-2013 30-Sep-2013 31-Aug-2015 Comments Development of social innovation policy Text Value 0 No Yes document Date 30-Sep-2013 30-Sep-2013 31-Aug-2015 Comments Number of beneficiaries who have completed Number Value 0.00 0.00 420.00 short course(s). Date 30-Jun-2013 30-Sep-2013 31-Aug-2015 Comments Short Courses in progress and will end in Dec. 2013. Total number of staff trained according to an Number Value 0.00 0.00 80.00 adopted competencies model Date 30-Sep-2013 30-Sep-2013 31-Aug-2015 Comments Development of competencies model in Public Disclosure Copy progress. Annual number of unique visitors of the Number Value 0.00 147218.00 429000.00 COLCIENCIAS website Date 30-Sep-2013 30-Sep-2013 31-Aug-2015 Comments First collection of data on this indicator will take place in Dec. 2013. Page 3 of 6 The World Bank Report No: ISR12551 Number of citizens participating in citizen Number Value 0.00 15782.00 8500.00 participation activities financed by the Projects Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 (excluding Ondas and mass media) Comments Actual number represents Public Disclosure Copy online citizen votes from the Ciencias Cierta Convocatoria. Monitoring and evaluation framework for social Text Value No No Yes dissemination of STI established Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 Comments Number of evaluations for the convocatorias Number Value 0.00 0.00 3.00 corresponding to the R&D and innovation pilots Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 (innovation management, priority areas,and Comments open innovation) completed Number of proposals financed for innovation- Number Value 0.00 17.00 100.00 management capacity building subprojects Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 Comments Number of evaluations for the convocatorias Number Value 0.00 0.00 2.00 corresponding to the labor insertion and Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 diaspora pilots completed Comments Number of subprojects involving researchers Number Value 0.00 37.00 37.00 residing abroad participating in collaborative Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 research projects. Comments Number of doctoral graduates participating in Number Value 0.00 27.00 29.00 the labor insertion programs financed by Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 COLCIENCIAS under the Project (cumulative) Comments Monitoring and evaluation framework for Text Value No Yes Yes Ondas established Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 Comments Framework established. Public Disclosure Copy Number of management units using the Number Value 0.00 0.00 10.00 Balanced Scorecard Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 Comments Balanced Scorecard design completed. Number of research, policy and/or technical Number Value 0.00 0.00 8.00 papers completed by the internal policy Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 analysis unit Comments Page 4 of 6 The World Bank Report No: ISR12551 Total number of students covered yearly by Number Value 0.00 1746925.00 1200000.00 Ondas program (cumulative from 2011 to 2013) Date 10-Jun-2010 30-Sep-2013 31-Aug-2015 Comments Public Disclosure Copy Data on Financial Performance (as of 31-Oct-2013) Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P117590 IBRD-79440 Effective 15-Jul-2010 02-Aug-2010 20-Oct-2010 31-Dec-2013 31-Aug-2015 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P117590 IBRD-79440 Effective USD 25.00 25.00 0.00 11.21 13.79 45.00 Disbursement Graph Public Disclosure Copy Key Decisions Regarding Implementation A Project restructuring paper dated September 5, 2013 was approved by the World Bank and sent to the Government for review and approval. The restructuring includes the following changes to components, indicators, triggers, disbursement arrangements, reallocation of resources, Project costs and financing plan, closing date and legal issues. First, changes to Project components include: a change in three of the four Project components to reflect a new priority on capacity building in the regions, open innovation, social innovation and to account for delayed implementation of the evaluation of current financing instruments; a pilot to expand the Ondas Program – a program to develop basic scientific Page 5 of 6 The World Bank Report No: ISR12551 skills in primary and secondary school students – into the pre-school level was included; and finally, an activity supporting mobile classrooms was eliminated. For results and indicators, the changes include: the revision of two Project Development Objective (PDO) indicators and the elimination of one PDO indicator to better reflect progress toward Project objectives; changes to five intermediate indicators, the addition of three new intermediate indicators and the elimination of one existing intermediate indicator to reflect Public Disclosure Copy changes in COLCIENCIAS’ products and activities as well as appropriateness of indicators in measuring expected results. For triggers, the Project has set forth two conditions as triggers for entering into Phase II of the Program. While triggers are no longer required under Bank guidelines for entering the second phase of a series of projects, clarifications on end of Project expectations for these conditions have been made -- one based on a clarification of the types of new instruments that are being developed through the Project and another based on a change in the intermediate indicator on staff training in the new competencies model. For disbursement arrangements, the disbursement arrangement to beneficiaries of sub-projects has been altered to simplify the process and provide beneficiaries with continued cash flow to execute activities. For reallocations, a reallocation of funds from Disbursement Category 3 to Disbursement Category 2, which covers the Ondas, is included to allow for the pilot expansion of the Ondas program to pre-school students. Under Project costs and financing plan, the Project costs decreased slightly from US$41.5 million to US$40.95 million. These changes reflect decreases in expected counterpart funding from universities, firms, and other private entities through the matching grants and an increased contribution from fiscal resources. On the closing date, a twenty (20) month extension of the Project closing date from December 31, 2013 to August 31, 2015 has been included. The extension was necessary to finance COLCIENCIAS’ continued institutional strengthening, investment pilots, commitments to small grant beneficiaries, research and development (R&D) sub-projects and planned evaluations of Project activities that will contribute to the development of the second phase of the APL. Finally, on legal issues, the restructuring includes the removal of the legal covenant that stipulates “a Management Information System satisfactory to the Bank shall have been established by COLCIENCIAS no later than December 31, 2012.” This system is being developed in conjunction with financing from the Inter-American Development Bank and has experienced delays in implementation. Also, the definition of Ondas as set forth in the Loan Agreement now includes pre-school students and teachers. Restructuring History Level two Approved on 20-Sep-2013 Related Projects There are no related projects. Public Disclosure Copy Page 6 of 6