The World Bank Report No: ISR15747 Implementation Status & Results Indonesia Health Professional Education Quality Project (P113341) Public Disclosure Copy Operation Name: Health Professional Education Quality Project (P113341) Project Stage: Implementation Seq.No: 8 Status: ARCHIVED Archive Date: 08-Sep-2014 Country: Indonesia Approval FY: 2010 Product Line: IBRD/IDA Region: EAST ASIA AND PACIFIC Lending Instrument: Specific Investment Loan Implementing Agency(ies): Directorate General of Higher Education Ministry of Education and Culture Key Dates Board Approval Date 24-Sep-2009 Original Closing Date 31-Dec-2014 Planned Mid Term Review Date 29-Oct-2012 Last Archived ISR Date 21-Feb-2014 Effectiveness Date 09-Dec-2009 Revised Closing Date 31-Dec-2014 Actual Mid Term Review Date 29-Oct-2012 Project Development Objectives Project Development Objective (from Project Appraisal Document) The specific Project Development Objectives are to strengthen quality assurance policies governing the education of health professionals in Indonesia. This will be achieved by: 1) rationalizing and assuring competency-focused accreditation of public and private health professional training institutions; 2) developing national competency standards and testing procedures for certification and licensing of health professionals; and 3) building institutional capacity to employ results-based grants for encouraging the use of accreditation and certification standards in the development of medical school quality. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Component 1 Strengthening Policies and Procedures for School Accreditation 7.18 Component 2 Certification of graduates using a national competency-based examination 12.90 Component 3 Results-based FAP for Medical Schools 61.40 Project Management 5.24 Public Disclosure Copy Overall Ratings Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Satisfactory Overall Risk Rating Substantial Moderate Implementation Status Overview LAM-PTKes (Independent Accreditation Agency for Higher Education in Health) and LPUK-NAKES (Independent Competency Examination Agency for the Health Workforce) have become legal entities after the Ministry of Justice and Human Rights released the decree recognizing the two institutions. The process for recognition of LAM-PTKes by the Ministry of Page 1 of 7 The World Bank Report No: ISR15747 Education and Culture is ongoing. LAM-PTKes under the umbrella of the BAN-PT (National Accreditation Agency for Higher Education) has started the accreditation process of 57 higher education institutions. LPUK-NAKES continues to support professional associations and associations of higher education institutions in introducing competency examination methodology, building the capacity to manage competency examinations, and managing the item bank. The national competency examination for medicine and dentistry continues to take place routinely on schedule, while nursing and midwifery had the second national competency examination right at the end of the implementation support mission. LAM-PTKes Public Disclosure Copy will run an accreditation try out for pharmacy, nutrition and public health later this year, while around the same time, LPUK-NAKES in collaboration with the professional associations and the association of higher education institutions of the same three groups will run the competency examination try out. Implementation of the Funding Allocation Package (FAP) in 31 medical schools have finished in June 30, 2014, while there will be a few month implementation extension in 10 schools mainly to complete ongoing procurement processes. Project disbursement is 84 percent. the government will request project reallocation across categories to improve project efficiency and effectiveness. Locations No Location data has been entered Results Project Development Objective Indicators Indicator Name Core Unit of Measure Baseline Current End Target The readiness of competency examination for Yes/No Value No No Yes pharmacy, nutrition and public health Date 07-Mar-2013 30-Jun-2014 31-Dec-2013 Comments The methodology used is Standards of competencies KBT implementation and non-standardized knowledge were done for the three health OSCE preparation for based test (KBT) disciplines. pharmacy, KBT try out for nutrition and for public health The implementation of a nationally Yes/No Value No No Yes standardized competency examination for Date 07-Mar-2013 30-Jun-2014 31-Dec-2014 pharmacy, nutrition and public health Comments Examination is not Examination blue print for Each discipline has standardized and is each discipline is available completed a national conducted by individual and being reviewed by LPUk- formative competency education institution NAKES, examination Establishment of an accreditation system for Yes/No Value No No Yes pharmacy, nutrition, and public health study Date 07-Mar-2013 30-Jun-2014 31-Dec-2014 programs Public Disclosure Copy Comments The existing accreditation Accreditation instrument is Completion of a trial system is for institutional available and is waiting for accreditation process by the accreditation by the BAN-PT BAN-PT endorsement. LAMPS-Kes (National Accreditation Agency for Higher Education), not specific for the study program Page 2 of 7 The World Bank Report No: ISR15747 Mean Test Score of Graduates from FAP Percentage Value 60.88 64.25 Recipient Schools who take the National Date 31-Dec-2010 30-Jun-2014 31-Dec-2014 Competency Testing Comments Average from 41 FAP Mean test score of FAP Mean Test Score (MTS) of Public Disclosure Copy recipient Medical Schools recipients is around 4 FAP recipients is at least percentage points above the equal to the national MTS national average Graduates of health professional schools Percentage Value passing the national competency testing at first Date 31-Dec-2009 30-Jun-2014 31-Dec-2014 attempt Comments Medical 71.67%, Dental Will report 2014 results Medical 84%, Dental 86%, 81.69% (average of 4 medical and Nursing 50%, Midwifery 50% dentistry examination, and average of two nursing and midwifery examination) in December 2014. Graduates of Medical Schools passing the Percentage Value 71.67 0.00 84.00 national competency test at the first attempt Sub Type Supplemental Graduates of Dental Schools passing national Percentage Value 81.69 0.00 86.00 competency test at the first attempt Sub Type Supplemental Graduates of Nursing school (ners) passing the Percentage Value 0.00 0.00 50.00 national competency test at the first attempt Sub Type Supplemental Graduates of Midwifery Schools passing the Percentage Value 0.00 50.00 national competency test at first attempt Sub Type Supplemental Graduates of nursing schools (D3) passing the Percentage Value 0.00 50.00 national competency test at the first attempt Sub Type Public Disclosure Copy Supplemental Health Professional Schools (medical, dental, Percentage Value 0.00 0.00 282.00 nursing, and midwifery) that have gone through Date 30-Jun-2014 31-Dec-2014 the accreditation process and publicize the Comments Accreditation process for 57 results schools (20%) is ongoing, 115 schools (41%) will start in July, and 110 schools (39%) in Sept Page 3 of 7 The World Bank Report No: ISR15747 Nursing schools that have gone through Percentage Value 0.00 0.00 137.00 accreditation process and publicize results Sub Type Supplemental Public Disclosure Copy Midwifery schools that have gone through Percentage Value 0.00 0.00 104.00 accreditation process and Sub Type Supplemental Medical Schools that have gone through Percentage Value 0.00 0.00 31.00 accreditation process and publicize the results Sub Type Supplemental Dental schools that have gone through Percentage Value 0.00 0.00 10.00 accreditation process and publicize the results Sub Type Date 30-Jun-2014 31-Dec-2014 Breakdown Comments Establishment of the National Agency for Yes/No Value No Yes Yes Competence Examination of Health Date 31-Dec-2009 30-Jun-2014 31-Dec-2014 Professionals (NACE HealthPro) Comments Consortium of College of Target was achieved on 20 The Charter of NACE Indonesian Doctors (KDI) and Dec 2013. HealthPro i/LPUK is Association of Medical established in 2013 Education Institutions (AIPKI) is the current engagement Establishment of the independent National Yes/No Value No Yes Yes Accreditation Agency (NAA) Date 09-Dec-2009 31-Dec-2013 31-Dec-2014 Comments The Joint Commission of Ministry of Justice and Human Charter of the NAA is National Accreditation Board Rights Decree no AHU established in 2013 for Higher Education (BAN- 30/2014 to establish LAM-PT PT) and Indonesian Medical Kes was released on 3 Feb Council (KKI) 2014. MOEC regulations toendorse the function of LAM-PTKes is still pending. Public Disclosure Copy Intermediate Results Indicators Page 4 of 7 The World Bank Report No: ISR15747 Indicator Name Core Unit of Measure Baseline Current End Target The National Accreditation Agency NAA has Number Value 0.00 128.00 300.00 access to adequate numbers of suitably trained Date 30-Jun-2014 31-Dec-2014 Public Disclosure Copy assessors Comments Number assessors trained by Numbers of trained assessors LAM-PTKes on new for each profession: Medical : accreditation system and 60 Dental : 30 Nursing : 105 instrument; medicine: 24, Midwifery : 105 dentistry: 14, nursing: 55, midwifery: 45 Number or percentage of medical schools Number Value 0.00 43.00 43.00 receiving finance support to strengthen the Date 30-Jun-2014 31-Dec-2014 program Comments 31 schools have completed FAP implementation, the remaining 13 is still ongoing. A charter supporting the establishment of the Yes/No Value No Yes Yes NACEHealth Pro (National Agency for Date 31-Dec-2009 30-Jun-2014 31-Dec-2014 Competency Examination of health Comments Current arrangement for Ministry of Justice and Human The charter has been Professionals) including its tasks and responsibilitis, and working arrangements competency testing: Rights Decree no AHU established by the end of Consortium of College of 291/2013 was released on 20 2011 Indonesian Doctors (KDI) and Dec 2013 establishing the the Association of Medical LPUK-NAKES as a non Schools (AIPKI) government entity. The National Accreditation Agency (NAA) has Yes/No Value No Yes Yes independent and adequate budget to conduct Date 31-Dec-2009 31-Dec-2013 31-Dec-2014 accreditation Comments A Joint Commission between Ministry of Justice and Human An independent NAA has the National Accreditation Rights Decree no AHU adequate budget to conduct Agency for Higher Education 30/2014 was released on Feb accreditation and Indonesian Medical 3 establishing LAM-PTkes as Council is the current a non government entity.LAM- arrangement PTKes is awaiting MOEC recognition. Public Disclosure Copy Education and competency standards are Yes/No Value No Yes Yes agreed by all stakeholders and published Date 31-Dec-2009 30-Jun-2014 31-Dec-2014 Comments Medical and Dental: The Standards of Standards of Competencies Standards of Competencies competencies and standards and Standards of Education and Standards of Education of education for the four for four professions are released by Indonesian professions are approved agreed by all stakeholders Medical Council (KKI) in 2006 and used. and published Nursing: Drafts of both standards are available Page 5 of 7 The World Bank Report No: ISR15747 Midwifery : Standards of Competencies released by MOH in 2007 and Draft standard of education Public Disclosure Copy available Responsibility for policies on prefessional Yes/No Value No No Yes accreditation, certification, and school licensure Date 31-Dec-2009 30-Jun-2014 31-Dec-2014 are clear and accepted by key stakeholders for Comments Medical and Dental : The draft law to establish the GoI has established a formal each of four health professions Indonesian Medical Council nursing council and the health entity with responsibility for (KKI) established in 2006 workforce council is being oversight of accreditation Nursing and Midwifery : a debated in the parliament and standards, competency-based formal entity with expected to be rectified examination of each nursing responsibility for oversight of before the new parliament is and midwifery profession accreditation standards, on board, competency-based examination for each profession, nursing and midwifery is not yet established Data on Financial Performance (as of 26-Jun-2014) Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P113341 IBRD-77370 Effective 24-Sep-2009 01-Oct-2009 09-Dec-2009 31-Dec-2014 31-Dec-2014 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P113341 IBRD-77370 Effective USD 77.82 77.82 0.00 65.16 12.66 84.00 Disbursement Graph Public Disclosure Copy Page 6 of 7 The World Bank Report No: ISR15747 Public Disclosure Copy Key Decisions Regarding Implementation 1) MOF to send a request for project re-allocation to the Bank by the end of July 2014. Restructuring History Level two Approved on 07-Mar-2013 Related Projects There are no related projects. Public Disclosure Copy Page 7 of 7