The use of evidence-informed deliberative processes (EDPs) by research group Global health economics

EDPs in Ghana

In Ghana, Gavin Surgey provides on-going support (through Access and Delivery Partnership/PATH) to the Ministry of Health on the institutionalisation of HTA in the country. Recent achievements include the development and approval of the country’s HTA process.

EDPs in Indonesia

Together with researchers from Padjajaran University in Bandung, we have implemented EDPs to improve priority setting of HIV/AIDS health services to support the AIDS Commission in West Java province, Indonesia, in the development of its strategic plan for 2014-2018.

Under the responsibility of the provincial AIDS Commission, an EDP was implemented to select priority interventions using six steps: (i) situational analysis; (ii) formation of a multistakeholder Consultation Panel; (iii) selection of criteria; (iv) identification and assessment of interventions' performance; (v) deliberation; and (vi) selection of funding and implementing institutions. An independent researcher conducted in-depth interviews (n = 21) with panel members to evaluate the process.

The Consultation Panel included 23 stakeholders. They identified 50 interventions and these were evaluated against four criteria: impact on the epidemic, stigma reduction, cost-effectiveness and universal coverage. After a deliberative discussion, the Consultation Panel prioritised a combination of several treatment, prevention and mitigation interventions.

The EDP improved both stakeholder involvement and the evidence base for the strategic planning process. EDPs fill an important gap which international guidelines and current tools for strategic planning in HIV control leave unaddressed.

Publications:

• Tromp N, Prawiranegara R, Siregar A, Wisaksana R, Pinxten L, Pinxten J, Lesmana Putra A, Kurnia Sunjaya D, Jansen M, Hontelez J, Maurits S, Maharani F, Bijlmakers L, Baltussen R. Translating international HIV treatment guidelines into local priorities in Indonesia. Trop Med Int Health. 2018 Mar;23(3):279-294

EDPs in Iran

With the support of the WHO country office in Tehran we are currently supporting the implementation of EDPs in Iran, in close collaboration with the High Council for Health Insurance (HCHI) of the Ministry of Health and Medical Education, to define the country’s Health Insurance Benefit Package, targeting some 30 conditions across six disease areas.

Our activities include:

• Support for the implementation of evidence-informed deliberative processes in the form of remote consultations with a local team of analysts;
• Provide guidance on the application of decision criteria for periodic health benefits package revisions in Iran;
• Provide guidance for the presentation of available evidence on interventions targeting specific diseases/conditions to local technical working groups for deliberation and appraisal;
• Assist in developing and implementing an M&E framework for health insurance benefit package revision;
• Provide guidance to institutionalise EDPs as part of periodic HIBP revision in Iran.

Publication:

Nouhi M, Baltussen R, Razavi SS, Bijlmakers L, Sahraian MA, Goudarzi Z, Farokhian P, Khedmati J, Jahangiri R, Olyaeemanesh A. The Use of Evidence-Informed Deliberative Processes for Health Insurance Benefit Package Revision in Iran. Int J Health Policy Manag. 2022;11(11):2719–26

EDPs in Kazakhstan

In Kazakhstan we have been working with the Ministry of Health on employing EDPs to determine the State Guaranteed Benefit Package (SGBP) and the package of the Mandatory Social Health Insurance (MSHI), using HTA. The activities involved:

• Undertaking a situational analysis based on desk research and surveying key stakeholders, including the Ministry of Health, Republican Center for Health Development and the Social Health Insurance Fund;
• Formation of an advisory committee under the leadership of the Ministry of Health;
• Definition of a relevant set of criteria for priority setting based on surveying of and a workshop with the advisory committee;
• Selection and assessment of 25 interventions according to international standards;
• Appraisal of the 25 interventions using quantitative MCDA and decision rules; and
• Development of an implementation plan and M&E framework.

Publication:

Oortwijn W, Surgey G, Novakovic T, Baltussen R, Kosherbayeva L. The Use of Evidence-Informed Deliberative Processes for Health Benefit Package Design in Kazakhstan. Int J Environ Res Public Health. 2022;19(18):11412

EDPs in Lebanon

We supported the National Social Security Fund (NSSF) to develop their HTA framework in the shape of a guidebook for HTA practitioners and health stakeholders who seek the reimbursement of their health technology by the NSSF. The initiative reflects the solid commitment of the NSSF to institutionalize HTA, and it constitutes a “stepping stone” for a longer journey.

The practical guide explains the framework that will be adopted by the NSSF to assess the health technologies in question. It provides an overview of the HTA process based on the principles of EDPs, falling in line with the NSSF’s aspiration of optimizing the efficiency of the use of its limited resources, while ensuring equitable investment decisions.

EDPs in Liberia

The Disease Control Priorities 3 (DCP3) Country Translation project is supporting selected low- and middle-income countries in setting priorities for essential packages of health services (EPHS), on the pathway to universal health coverage (UHC). In 2021, DCP3 initiated collaboration with the Liberia Ministry of Health (MoH) to provide technical assistance in revising the national EPHS. Radboudumc took responsibility for organising the prioritisation process of these revisions.

The UHC EPHS prioritisation process, involving a wide array of stakeholders, led to the shortlisting of >100 high-priority interventions, using decision criteria that included cost-effectiveness of interventions, disease burden targeted, disability-adjusted life years (DALYs) averted, budget impact, financial risk protection, equity (targeting vulnerable population groups), and feasibility of implementation.

The MoH now has the data, technical capacity, and the tools to adjust this package to fit any future policy and fiscal changes or address additional considerations that may emerge during implementation.

EDPs in Moldova

Commissioned by the World Bank, Radboudumc support the government of Moldova to plan and implement the most suitable system for HTA, using EDPs as the guiding framework.

This study falls under the Toward Universal Health Coverage Project which is a joint project implemented by the World Bank and financed by the Swiss Agency for Development and Cooperation (SDC). Our study run between November 2019 and December 2021 and had three main tasks: conducting a needs assessment in terms of stakeholders to involve in HTA development, identifying HTA capacity and skills, mapping HTA systems in European countries to draw lessons for Moldova, and then developing an implementation plan, including a roadmap for short- and long-term implementation.

EDPs in Pakistan

In Pakistan we supported the implementation process of the Disease Control Priorities 3 (DCP3) project using an evidence-informed deliberative process. DCP3 responds to the increasing need of low- and lower-middle-income countries for technical guidance and support in benefit package design and in accelerating progress towards UHC.

The EDP process was embedded in a broader institutional effort around health benefit packages in Pakistan, initiated by a joint WHO-EMRO and DCP3 secretariat mission visit to Pakistan in Jan 2019. The six steps of evidence-informed deliberative processes were operationalized for health service prioritization and UHC benefit package design, by supporting Pakistan’s Ministry of National Health Services, Regulation and Coordination with the necessary templates and guidance for the presentation of available evidence, stakeholder deliberation, appraisal and formulation of recommendations. A journal article describing the prioritization process will be published soon along with other papers that describe the defined service packages.

Publications: under peer-review.

EDPs in Rwanda

In Rwanda, we provide support to the Ministry of Health to revise the community-based health insurance (CBHI) benefit package. The project is implemented by iDSI in close collaboration with the School of Public Health of the University of Rwanda, the Rwanda Social Security Board, the World Health Organization, and Radboudumc. The project started in 2021 and evaluates cancer control strategies as a first cluster of conditions, with the aim to provide recommendations to the MoH on inclusion of cancer services in the CBHI cancer package. The evaluation of other clusters is planned afterwards. 

The role of Radboudumc is to develop the decision-making process for benefit package design following the principles of EDPs. This involves leading on and contributing, through a series of online and onsite training activities, to the development of an appropriate governance structure, the establishment of an advisory committee, the selection of decision criteria and the organisation of appraisal meetings.

EDPs in Tanzania

In Tanzania, Gavin Surgey provides on-going support (through ADP/PATH) to the Ministry of Health on the institutionalisation of HTA in the country and capacity building.

Recent achievements include the development of their HTA process guidance EDPs as the guiding framework and, an analysis of selected medicines reimbursed by the National Health Insurance Service and ongoing capacity building for policy makers on HTA.

Publication:

• Surgey G, Mori AT, Baltussen R. Health technology assessment in Tanzania: capacity and experience of HTA committee members. Journal of Global Health Economics and Policy. 2022;2:e2022004. Doi: 10.52872/001c.33116

EDPs in Ukraine

HTA is included in the Ukrainian Health Law fundamentals and became mandatory by 2020. SAFEMed has been supporting the Ministry of Health to integrate HTA into the decision-making ecosystem and continuous capacity development in HTA. We are collaborating with SAFEMed during 2022-2023 to:

• create a model curriculum for an HTA master’s program, including EDPs, to be implemented in Ukraine;
• review the capacity and requirements of the existing academic centres globally;
• develop a list of minimum criteria for academic centres to deliver a successful HTA program;
• perform a training needs assessment of users and doers of HTA via an online survey that captured level of experience and knowledge gaps;
• develop a 20-weeks training program for users, doers and trainers based on the needs assessment; and
• conduct and evaluate the online HTA training program for about 65 users, doers and trainers in Ukraine.

EDPs in United Arab Emirates

We support Abu Dhabi’s Department of Health in the development and implementation of a roadmap for HTA, using EDPs. This roadmap, which was based on a situational analysis and developed in consultation with local policymakers, healthcare providers, payers, product makers and research institutions, was formally adopted at the end of 2022. It pays particular attention to creating appropriate structures and processes and to strengthening local capacity for improved and timely decision making regarding health insurance coverage. Financial support is being provided by Roche.

Making explicit choices on the path to UHC: the JLN health benefits package revision guide

In recent decades, many LMICs have adopted a Health Benefits Package (HBP), which defines the coverage of services, the proportion of the costs that are covered, and who can receive these services under Universal Health Coverage. Once developed and implemented, a HBP should not be static as revisions ensure that the package is up-to-date and is delivered appropriately, and that available resources are used efficiently and wisely.

The JLN Guide for Health Benefits Package Revision aims to support practitioners in low- and middle-income countries (LMICs) to revise their HBPs, while responding to changing disease burdens, fluctuating budgets, and the emergence of new services and health technologies, and to correct for implementation challenges.

Co-produced by the JLN’s Efficiency collaborative, this Guide packages the experiences and expertise from 14 JLN member countries, including Bangladesh, Ethiopia, Ghana, India, Indonesia, Kenya, Laos, Malaysia, Mongolia, Nigeria, the Philippines, South Africa, Sudan and Vietnam.

The guide can be downloaded here.

A distinct framework

The EDP framework has a number of particular features, which distinguish it from other HTA frameworks:

• EDPs consider HTA as a political and intrinsically complex undertaking, and has a strong emphasis on deliberation among relevant stakeholders. We have developed approaches that stimulate debate and deepen the argumentation. This is different from many other HTA frameworks which are often limited to evidence collection and synthesis.
• The EDP framework combines existing theories and best HTA practices around the world – it is not proposing anything new. In terms of theory, EDPs are based on rational decision-making (as in multi-criteria decision analyses – MCDA) and fair decision-making (as in accountability for reasonableness – A4R).
• The framework provides a practical stepwise approach that covers the whole HTA process (see Figure below). Other HTA frameworks typically concentrate on selected steps only, e.g. assessment.
• EDPs take the decision-making context as the starting point, and offers specific advice depending on the level of HTA development. The EDP framework is also relevant for countries that have not (yet) established an HTA organization.  
• EDPs can be considered as a practical application of the WHO ‘Fair choices’ framework by Norheim et al., in terms of the stepwise approach to achieve Universal Health Coverage (UHC).
• WHO Headquarters recommends the use of EDPs for HTA organizations. See for example this document.
• Our EDP guide is also recommended by other agencies; for example the International Decision Support Initiative (iDSI), a global network of health, policy and economic expertise, working to achieve Universal Health Coverage and the health Sustainable Development Goal (SDG 3). Our GHP group is part of the iDSI network.

See the six steps of Evidence Informed Deliberative Processes in the Figure below.