1819CHAPTER 2
Analyzing Economic Outcomes in Advanced Practice Nursing
Kevin D. Frick, Catherine C. Cohen, and Patricia W. Stone
Chapter Objectives
1. Present an overview of five different types of economic evaluations that an advanced practice registered nurse (APRN) may encounter
2. Contrast economic evaluation methodology with that of comparative-effectiveness studies and business case studies
3. Outline appropriate outcome measures for each type of analysis
4. Summarize and critique published examples of each type of economic evaluation
5. Discuss methodological issues of importance to economic evaluations
Chapter Discussion Questions
1. How does comparative-effectiveness research compare with cost-effectiveness research and business case studies?
2. In what scenario would a cost–utility methodology be appropriate? Provide an example.
3. If studying three interventions with no single standard outcome measure (or validated means of clinical outcome aggregation), which methodology may be most appropriate?
4. What is a key assumption required for a successful cost–benefit analysis (CBA)? How are the outcomes of CBAs presented?
5. Use a “two-step” approach to determine cost of a new antibiotic formulation that requires 4 minutes of reconstitution preparation by the RN immediately prior to intravenous infusion.
20Cost-effectiveness of health care practice is an increasingly important topic in the delivery of care and consequently in nursing research. The growing proportion of older adults in the U.S. population, various improvements in health care technology, direct-to-consumer advertising for a long list of pharmaceuticals, increasing costs of doing business in other sectors besides health care, and international competitive pressures on wages and benefits have drawn greater attention to the costs of health care over time. U.S. health care spending in 2014 grew 5.3%, which was faster than the rate of inflation and accounted for 17.5% of gross domestic product (Centers for Medicare & Medicaid Services, 2016; Chernew, 2015). Concerns over unsustainable increases in health care spending led to passage of the Affordable Care Act (U.S. national health reform), which within the first 2 years of implementation (2013–2015), contributed to a decline in the number of uninsured Americans at 12.8 million (Rovner, 2016). While U.S. legislation prohibits use of cost thresholds in health care policy decisions, the proportion of the gross domestic product being spent on health care forces policy makers to at least consider the costs as well as the effectiveness of new treatments, devices, or interventions (Neumann, Cohen, & Weinstein, 2014). Health policy makers increasingly request analyses, including projected economic outcomes prior to the approval of funding for or reimbursement of these new activities.
At the same time that the focus on cost has increased, other factors have also raised the importance of studying and contemplating the cost-effectiveness of health care in the United States. These include (a) the scientific recommendations related to the conduct of cost-effectiveness analyses that have been issued in the United States, (b) a format for formulary submissions offered by the Academy of Managed Care Pharmacy, (c) recognition by parties in the United States of other recommendations around the globe, (d) conferences related to cost-effectiveness sponsored by the National Institute of Nursing Research, and (e) authorization of a new organization, the Patient-Centered Outcomes Research Institute (PCORI), by the U.S. Congress in 2010 that emphasizes use of comparative-effectiveness methodology to improve the quality of evidence available to inform health care decision making (PCORI, 2014).
Therefore, in the current economic and health care environment, APRNs need to be knowledgeable about the interpretation of cost, and effectiveness data in particular, when they are combined in a cost-effectiveness study. The increased demand for economic information has resulted in a number of economic evaluations in the literature specific to nursing and a plethora of cost-effectiveness studies (e.g., Bryant-Lukosius et al., 2015; Cohen, Choi, & Stone, 2016; Martin-Misener et al., 2015; Twigg, Myers, Duffield, Giles, & Evans, 2015). Not only are APRNs and other clinicians now expected to review publications containing economic outcomes related to their services, but they must also participate in these analyses and interpret others for appropriateness of implementing findings into practice.
To accomplish these goals, APRNs must understand how to distinguish comparative-effectiveness research from cost-effectiveness analysis (CEA) research and business case analyses. Comparative-effectiveness research has been defined as the conduct and synthesis of research comparing the benefits and harms of different interventions and strategies to prevent, diagnose, treat, and monitor health conditions in “real-world” settings; its purpose is to improve health outcomes by developing and disseminating evidence-based information about the everyday effectiveness of interventions (Federal Coordinating 21Council for Comparative Effectiveness Research, 2009; Iglehart, 2009; Volpp & Das, 2009). This is in contrast to efficacy research, such as a randomized controlled trial, where the question is typically whether the treatment can work under a controlled environment. Because comparative-effectiveness research is aimed to inform actual patient situations, it is very much patient-centered and thus is also called patient-centered outcome research. This methodology not only highlights the everyday needs of the patients, but it may also incorporate many different types of patient outcomes. Cost-effectiveness research is one type of patient-centered outcome research that focuses on economic outcomes of two or more comparable health care interventions and is well suited to be conducted alongside a comprehensive comparative-effectiveness assessment (Garber, 2011; Jacobson, 2007; Stone, 2001a, 2001b). In contrast to both of these, a business case analysis is generally from the more narrow perspective of a single organization that may choose to implement an intervention or not. This focuses on the costs and revenue generated for a single organization (and describes data on any health outcomes that are relevant to the organization) and uses an organization’s view of the future to compare costs and revenue now with costs and revenue later to calculate return on investment and make an inference about whether to implement.
A number of different methods are employed to address economic outcomes of health care to inform policy or recommendations for adoption. The purposes of this chapter are (a) to present an overview of five different types of economic evaluations an APRN may encounter, (b) discuss appropriate outcome measures for each type of analysis, (c) present and critique published examples of each type of economic evaluation, and (d) discuss methodological issues of importance to economic evaluations.
TYPES OF ECONOMIC EVALUATIONS
Five different methods of economic evaluations are commonly used in assessing the economic impact of new health care interventions and technology. Table 2.1 presents a brief overview of these methods (Drummond, Sculpher, Claxton, Stoddart, & Torrance, 2015). In all of these economic outcome evaluations, alternative strategies are compared and the incremental cost of the competing strategies is computed according to the following formula:
Incremental costs = C1 − C2
where C1 represents the cost of the new intervention and C2 represents the cost of the comparator (e.g., the next-best strategy). There is more variation between methods regarding how effectiveness is measured, although the focus remains on incremental changes in effectiveness (e.g., comparing the outcome of one intervention with that of another).
Cost-Minimization Analysis
In a true cost-minimization analysis (CMA), only the costs are evaluated and the alternatives are assumed or have been found to offer equivalent outcomes. Many of these studies begin as cost-effectiveness studies, in which the investigators expected one intervention to be both more effective and more expensive. As a result, in most published economic evaluations labeled as CMAs, clinical outcomes of the strategies being compared are measured (e.g., Beaver et al., 2009; Schuurman et al., 2009). For example, after establishing similar efficacy of traditional hospital visits and nursing telephone consultations following breast cancer in a randomized control trial, Beaver et al. (2009) then used data from the trial to conduct a CMA. They determined that, from the perspective of the United Kingdom (UK) National Health Service, the telephone consultation arm had higher costs. In the Schuurman et al. (2009) study, comparison of costs for technological versus human approaches to preventing pressure ulcers was performed in conjunction with a prospective cohort study regarding incidence and risk factors for the clinical outcome. While incidence was similar between the two approaches, the technological approach was cost-saving.
22TABLE 2.1 Types of Economic Evaluations
Type of Study | Definition | Effect Measurement |
CMA | An analysis that computes the incremental costs of alternatives that achieve the same outcome | Assumed or shown to be the same |
CCA | An analysis in which incremental costs and multiple effects are computed, without any attempt to aggregate them | Natural occurring units* |
CEA | An analysis in which incremental costs and one type of effects are presented in a ratio | Natural occurring units* |
CUA | A special type of CEA, in which quality of life is considered and a metric is used that combines quality and quantity of life | Quality-adjusted life years |
CBA | An analysis in which incremental costs and effects are computed, and all benefits and costs are measured in a single currency such as 2016 U.S. dollars | Monetary |
*Examples of natural occurring units are life years gained, disability days saved, or cases avoided.
CBA, cost–benefit analysis; CCA, cost–consequence analysis; CEA, cost-effectiveness analysis; CMA, cost-minimization analysis; CUA, cost–utility analysis.
Cost–Consequence Analysis
A cost–consequence analysis (CCA) is a study in which the costs and the consequences of two or more alternatives are measured, but costs and consequences are listed separately. This methodology is often chosen when there is no obvious summary measure for the outcomes applicable to the interventions being studied. In a CCA, the analyst expects the decision makers to form their own opinions about the relative importance of the findings. To facilitate decision making, the analysts provide an array of consequences applicable to each strategy. Two studies serve as examples of this methodology being used in the nursing literature. Schoonhoven et al. (2015) compared the consequences of using bed baths or traditional soap and water baths for nursing home residents in a cluster randomized trial that assessed resident skin integrity, resident behavioral problems, costs, and resident and nurse satisfaction. Campbell et al. (2014) determined the costs and consequences of increasing primary care access (operationalized as the number of patient contacts) comparing usual care to (a) general practitioner telephone consultation or (b) nurse telephone consultation.
23 Cost-Effectiveness Analysis
CEA also measures incremental costs. In CEA, incremental consequences are measured in a single common natural unit, such as life years gained or cases avoided. In addition, costs and effects are summarized in an incremental cost-effectiveness ratio (ICER), which is calculated using the following formula:
Cost-effectiveness ratio = (C1 − C2)/(E1 − E2)
where C1 represents the cost of the new intervention, C2 represents the cost of the comparator, E1 represents the effect of the new intervention, and E2 represents the effect of the comparator. For CEA, analysts often attach the resource utilization data-collection process to a randomized trial, usually powered on something other than the cost-effectiveness result (e.g., Joen [2015] examined nurse work environment and outcomes in older adults), or employ a decision-analytical approach and model the problem through the use of a decision tree (e.g., Kang, Mandsager, Biddle, & Weber [2012] examined different methods of monitoring for methicillin-resistant Staphylococcus aureus in academic hospitals; Fatoye & Haigh [2016] compared ankle brace use vs. taping on patients returning to work after an acute ankle sprain).
The decision is between choosing alternative 1 or alternative 2. Both alternatives have associated probabilities of positive (good) and negative (bad) outcomes. In addition, there are the associated costs of each strategy. The use of decision analysis and decision trees is a defined mathematical modeling technique. “A sample decision tree is diagrammed in Figure 2.1.” It is suggested that anyone interested in using this technique seek training opportunities. There are a number of highly readable texts available to the APRN wishing to understand this approach better (Drummond et al., 2015; Haddix, Teutsch, & Corso, 2002; Petitti, 2000).
A number of examples of CEA can be found in the recent nursing literature (Hunter, 2015; Jeon et al., 2015; Kang et al., 2012). Jeon et al. (2015) provide an excellent example of deriving a CEA from a cluster randomized controlled trial. The study sought to improve care of older adults through a year-long intervention among nurse managers to improve management skills to improve work environment, measured by the Work Environment Scale-R (WES-R) score and the Multifactor Leadership Questionnaire (MLQ)–Rater form. The cost of the intervention was monitored as a secondary outcome, the results of which were expressed as a mean ICER. The intervention resulted in a one-point increased mean score in transformational leadership per $1,584 AUD (Australian dollars) spent and a one-point increased mean score in overall leadership per $1,343 AUD spent. Although these are acceptable health outcomes, use of the WES-R score and MLQ–Rater form only facilitate comparison with other studies that also focus on interventions for work environment. In contrast, Hunter (2015) used a Markov model (i.e., simulating what happens to a cohort of individuals over multiple periods through time) to estimate the cost-effectiveness of three alternatives to promote antibiotic stewardship for respiratory illness in primary care: standard practice, c-reactive protein point of care testing, and this testing with added communication training. For each option, the author calculated the probability of antibiotic prescribing and the number of respiratory illnesses.
24 Cost–Utility Analysis
Cost–utility analysis (CUA) considers the effectiveness of the interventions on both the quantity and the quality of life in a single measure, the quality-adjusted life year (QALY). The QALY is a measure of the quantity of life gained weighted by the quality of that life. Quality of life is measured by a utility, which is a measure of preference for a given health state rated on a scale of 0 (death) to 1 (perfect health). Because dollars spent to gain a QALY are not disease specific, the measure is useful for informing health policy decisions and is recommended for such use by the U.S. Public Health Service’s Panel on Cost-Effectiveness in Health and Medicine (Neumann, Sanders, Russell, Siegel, & Ganiats, 2016). The QALY is a common outcome unit at this point in time, as it has been recommended by a number of organizations around the world and facilitates comparisons among different studies.
However, variance in the interpretation of what QALYs are actually measuring (“Determinants of health economic decisions in actual practice: The role of behavioral economics,” 2006) and estimates for the value of a QALY have ranged from $20,000 to $200,000 (Neumann et al., 2014). In fact, a 2016 meeting of the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) devoted a session to whether more evidence is needed for cost-effectiveness thresholds and if so, how to generate this evidence (ISPOR, 2016). While lack of universal agreement as to what society should be willing to pay to gain a QALY persists, and despite specific U.S. legislation against use of a cost-per-QALY threshold, the figure of $50,000/QALY threshold is still often cited in the United States (Neumann et al., 2014).
Numerous examples exist in the nursing literature of cost–utility analyses. For example, Blakely et al. (2015) examined the cost–utility of a hospital-based nurse cancer care coordinator (vs. having no dedicated coordination service) for stage III colon cancer patients. They determined that the cost per QALY of this program was $15,600 USD, with increased coverage of chemotherapy and reduced time to treatment. In another CUA, Marsden et al. (2015) evaluated different repositioning strategies for the prevention of pressure ulcers from the perspective of the UK National Health Service and determined that while repositioning every 2 to 4 hours is slightly more effective, it is not more cost-effective than repositioning every 4 hours.
Cost–Benefit Analysis
CBA is a form of economic evaluation in which consequences are summarized in monetary units. In CBA, a single monetary figure representing benefits minus costs is calculated. As 25long as the decision maker agrees with the methods used to place a dollar value on outcomes, this provides the decision maker with a direct indication of whether the value of the benefits is greater than the cost. Wang et al. (2014) used a CBA to help policy makers evaluate the value of the Massachusetts Essential School Health Services program, which employs and maintains an onsite, full-time, baccalaureate-prepared RN in every public school. By including costs of nurse staffing and medical supplies, and the savings (benefits) from reducing medical procedures and protecting teacher and parent productivity, the authors determined that the program yielded a net benefit of $98.1 million during the 2009–2010 school year ($2.20 gained for every $1 invested). Another study used CBA to determine if a safe patient-handling program in an outpatient rehabilitation center would prevent work-related injuries during patient transfers among nurses and other therapy staff. Implementing the program gained $3.71 in benefit for every dollar invested in the program, although the injury reduction rates were not sustained (Theis & Finkelstein, 2014).
COMMON ISSUES IN ALL ECONOMIC EVALUATIONS
The basic steps in conducting economic evaluations are illustrated in Figure 2.2. In addition, because this is essentially a new language to many APRNs, Table 2.2 defines some of the concepts and common terminology used in these analyses.
Selecting the Type of Economic Evaluation
The first step is to select the appropriate type of analysis to conduct. Considerations should include (a) the goal of the analysis (e.g., whether to compare only interventions affecting a single disease with a well-defined most important symptom or to compare interventions for different diseases or interventions for a condition with a complex set of symptoms), (b) whether the effectiveness of the interventions is equivalent (and, if so, this suggests a CMA), (c) the effectiveness measures available (e.g., can QALYs be generated), (d) the potential impact of the interventions on either quality or quantity of life (if both, then a CUA is most appropriate), (e) the availability of data, (f) the expertise available, and (g) ethical issues.
Framing the Analysis
Once the economic method has been selected, the researcher frames the analysis. This includes selecting the appropriate comparator(s) to analyze. For example, when testing the cost-effectiveness of a new educational program, the researcher might consider implementation in a hospital setting, initiation in an outpatient clinic, and a lack of teaching altogether as comparators given that outcomes may be different among them. At the least, the comparison of new interventions should be to the current practice, or status quo. Benchmarking to an established standard of care emphasizes the fact that analyses do not compare an intervention with “doing nothing.” In addition, often more than one comparator is appropriate to include in the analysis. This is especially true when multiple alternatives have been found to offer similar clinical outcomes or if there are potentially multiple levels of intensity of the interventions (e.g., increasing home health visits from twice a week to daily).
26
CBA, cost–benefit analysis; CCA, cost–consequence analysis; CEA, cost-effectiveness analysis; CMA, cost-minimization analysis; CUA, cost–utility analysis.
27TABLE 2.2 Common Terminology in Economic Evaluations
Term | Definition |
Boundaries of the study | The scope of the study |
Comparator(s) | The alternative(s) to which the new intervention is compared |
CPI | A measure of average change in price over time. This is used to adjust costs that are estimated in different past years to the present |
Discounting | The process of converting future costs and effects to the present value |
Incremental cost-effectiveness ratio | The ratio of the difference of the costs of two alternatives to the difference in effectiveness between the same two alternatives. Used in cost-effectiveness and cost–utility analyses |
Perspective | The viewpoint from which the analysis is conducted |
Sensitivity analysis | Calculations in which an input to the calculation (either measured or assumed) is varied and indicates the degree of influence it has on the analysis. Often used when a parameter is uncertain |
Time horizon | The period of time for which the costs and effects are measured |
CPI, consumer price index.
Boundaries (i.e., the scope) of the study delimit the costs and effects that are included in the analysis. Many interventions have spillover effects that must be considered. The question becomes how far to follow such effects to adequately assess the economic impact of the intervention. For example, if the aim of an educational program for mothers of infants admitted to a neonatal intensive care unit is to decrease the mothers’ levels of anxiety and improve the physiologic outcomes of the infants, then it logically follows that the boundaries would include both the mothers and the infants. This intervention may affect the overall parenting skills of the mother, however, and may have additional positive effects on other children in the family. In theory, all these effects are relevant, but in framing the study it is important to draw practical and feasible limits around the analysis.
In all types of economic evaluations, the perspective or viewpoint taken in the analysis also drives the set of costs and benefits included. Studies may be motivated by policy decisions relevant to specific institutions or individuals. In this case, the perspective of primary interest may be that of a managed care organization, hospital, employer, state health department, or another party. An economic evaluation conducted from the perspective of the hospital (e.g., providing a result most relevant to a hospital decision maker) should not consider costs (or savings) associated with family caregiving in the home. If the goal of the analysis is to affect broad resource allocation and health policy issues, however, then the societal perspective is appropriate and recommended (Neumann et al., 2016). This perspective incorporates all costs and all health effects regardless of who incurs them. This is advantageous because, if a systematic analysis is performed to compare the results of multiple studies and all have used the societal perspective, it makes comparison easier. Gathering data for the societal perspective also allows any other perspective to be calculated as a subset of the societal perspective. Indeed, the Second Panel on Cost-Effectiveness in Health and Medicine recommend that two reference cases should be reported: one from the health care perspective and one from the societal perspective (Neumann et al., 2016).
28The time horizon refers to the period of time for which the costs and benefits are measured in the analysis. The time horizon may vary from less than 1 year to the patient’s entire life span. The appropriate time horizon to consider will depend on the probable length of effect of the interventions being compared. Once the framing of the analysis is complete, the analyst is ready to estimate costs. The distinction between the time of the intervention and the time horizon for the analysis must be kept in mind. An intervention that lasts less than 1 year (e.g., nurses providing counseling to adolescents on high-risk behaviors) may have effects that last a lifetime.
Costs
Terminology pertaining to costs of resources has traditionally been divided into “direct” and “indirect” costs (Gold et al., 1996), with other labels like “friction costs” sometimes being applied to the cost of hiring a new employee and sometimes being applied to an entire method of valuing productivity (Brouwer & Koopmanschap, 2005; Gold et al., 1996). However, because economists and accountants do not use the same definitions and sometimes even economists have not been able to agree on a universal set of definitions, the terminology has become complicated. In health economics, direct costs have been defined as changes in resource use directly attributable to the provision of care, whereas indirect costs have referred to costs associated with the loss of productivity from morbidity and/or mortality (Liljas, 1998). Accountants, on the other hand, refer to direct costs as variable costs (e.g., supplies) and indirect costs as fixed costs (e.g., rent; Young, 2012). In light of these past inconsistencies in defining and measuring costs, the APRN conducting an economic evaluation should be sure to clarify and clearly communicate how the cost terms are defined. The trend in the CEA literature is to avoid the term “indirect.” Given this trend and the potential for confusion, we urge APRNs to likewise avoid using this term.
Economists and analysts often use a “two-step” approach to determine the costs attributable to an intervention. The first step in the estimation is determining the amount of resources attributable or consumed. Once the attributable resources have been determined, the “money” valuation or costs of the resources may be estimated. Using a two-step approach increases the clarity and transparency of the analysis and allows readers of the analysis to understand how the costs of attributable resources may be similar or different in their own setting.
The resources and associated costs can be categorized as in Exhibit 2.1, which is an adaptation of a grouping that appeared earlier in the literature (Luce, Manning, Siegel, & Lipscomb, 1996). In CEA, financial health care costs are directly related to the intervention itself and associated costs or savings of future health care, which the intervention may impact. For example, financial health care costs associated with a hepatitis B virus (HBV) immunization program should include the costs of obtaining and administering the immunization. In addition, they should include “downstream” costs (as well as savings), such as hospitalizations, outpatient visits, and other treatment costs associated with the diagnosis of HBV itself. Financial costs associated with other related diseases, such as cirrhosis or cancer, should also be included. Similarly, the value of the time a patient spends either seeking care or participating in an intervention constitutes a real use of resources for the individual and society. Thus, relevant patient time costs may include both the time involved in receiving the treatment and the time spent waiting to receive care.
29EXHIBIT 2.1 Cost Components to Consider for Inclusion
Direct health care costs* Intervention Hospitalization Outpatient visits Long-term care Other health care |
Direct non-health care |
Transportation |
Family/caregiver time Social services |
Productivity costs* |
Other |
*Not recommended for inclusion in cost–utility analyses by the Second Panel on Cost-Effectiveness in Health and Medicine.
Source: Neumann et al. (2016).
Consumption of resources other than those associated with the provision of health care also should be considered in economic evaluations conducted from the societal perspective. Examples of financial non-health care costs may include child care costs for a parent attending a smoking cessation program, increase in a family’s food expenditure as a result of a dietary prescription, the cost of transportation to and from a clinic, and the like.
Historically, patient time and other non–health care resources have not been consistently included in analyses (Jacobs & Fassbender, 1998; Stone, Chapman, Sandberg, Liljas, & Neumann, 2000). Nonetheless, if an analysis is conducted from the societal perspective, inclusion of such factors is recommended (Neumann et al., 2016). In addition, because health care is becoming more community based, nursing interventions may directly influence these costs. For example, a home visit by an APRN case manager may not only increase the ability of the APRN to conduct a holistic assessment, but may also save resources related to patient time, transportation, and family caregiving. Bhandari (2011) included patient transportation costs of an iron supplementation therapy in a cost-minimization study and found that new iron preparations reduced these costs compared to standard of care.
Productivity costs are the costs associated with morbidity or mortality. Morbidity costs are those associated with lost or impaired ability to work or to engage in leisure activities (e.g., loss of income due to time for recuperation or convalescence after coronary bypass surgery). Mortality costs are related to loss of life and are usually measured according to what the individual would have been capable of earning. Two issues are important to note concerning productivity costs.
First, the U.S. Public Health Service’s Panel on Cost-Effectiveness in Health and Medicine recommended that productivity costs be excluded from CUAs (Gold et al., 1996). The authors expressed concern that including both productivity costs and QALYs would represent a double counting because people may be considering productivity and 30earning potential when responding to trade-offs involving health and quality of life. Thus, when QALYs are used, productivity is already included in the denominator of the cost-effectiveness ratio.
Second, the assumption that productivity costs should be excluded from CUAs is controversial and has been debated by experts in the field (Krol, Brouwer, & Rutten, 2013). In light of this controversy, some analysts have presented results both with and without the inclusion of productivity costs (Krahn, Guasparini, Sherman, & Detsky, 1998; Moradi-Lakeh, Shakerian, & Esteghamati, 2012). APRNs conducting CUAs may also wish to present results both with and without the inclusion of productivity costs as well as continue to monitor recommendations made in the United States and elsewhere.
Some interventions (e.g., a successful smoking cessation program) extend life. Costs related to resource consumption in “added life years” are recommended for inclusion in economic evaluations. Added life-year costs are related to the consumption of health care resources (financial health care costs) and other types of consumption (all other cost categories). Because not all analyses increase life expectancy (e.g., use of cochlear implants or an educational intervention program aimed at decreasing parental anxiety), resource consumption in added life years is not always applicable. Sometimes, living longer and healthier can cost less annually but sum to more over a lifetime (van Baal et al., 2008). Generally, only the added health care costs and not added general consumption are included in the analysis.
Finally, income transfers, such as Social Security payments, are redistributions of money and are therefore not real costs to society. Consequently, although these “transfer costs” may be tracked and may be important for analyses from the government’s perspective, they should not be included with other societal costs. What should be included in a societal cost analysis are the costs of administering an income transfer program.
When trying to determine which costs to include, the process should begin with an outline of the categories of costs included, using the list in Exhibit 2.1. Once this is complete, a researcher should consider the cost “ingredients” that the intervention impacts under each category (Drummond et al., 2015). After the ingredients are identified, discussions about which costs are most relevant and which are important to measure can take place. Moreover, the perspective of the analysis will drive the decisions about which cost component to include. The treatment of the cost component (e.g., productivity costs captured in quality of life adjustments) is determined by the specific economic-analytical method chosen.
Once the consumption of resources has been estimated, the resource must be assigned a dollar value. Economists use the term “opportunity costs,” which reflects the value of the next-best alternative use of the resources. Determining the actual opportunity cost of a resource is difficult. Following are some general guidelines for assigning a dollar value to a resource.
In many markets, market prices (or charges) equate to opportunity costs. This does not apply in health care as often as in other fields. This incongruence is particularly notable for charges associated with hospitalizations. Although health care institutions bill for standard amounts, some payers are able to successfully negotiate lower charges for care. However, payers who are willing to pay higher levels of reimbursement or unable to negotiate lower levels of reimbursement will ultimately pay more for the same care. The practice of obtaining higher payments from some patrons is termed “cost shifting.” 31Therefore, for these institutional categories, an adjustment to prices is necessary to accurately represent exchange of funds, the cost. In fact, many customers, such as large insurance organizations, pay only a fraction of these charges. Large payers negotiate payment rates for services rendered based on the cost of the service and allowed profit margins (or excess revenues for not-for-profit institutions). Payers with the least market power (e.g., uninsured individuals) are the only ones who are likely to pay anything near the actual cost. If a hospital were just to break even based on the negotiated rates, then it is clear that the actual amount charged does not represent anything close to the actual cost.
Instead of using charges, a common source of valuation for hospital costs is the hospital’s own cost-accounting system. For researchers internal to the institution, these will often be easy to access. These cost-accounting systems are developed by finance departments to help administrative decision making and are based on past accounting studies and algorithms. Although the market price of medical care often does not represent actual costs, the market prices of the goods in the cost-accounting system are expected to represent the relevant costs of inputs to care. If a cost-accounting system is available, the APRN can usually determine the specific monetary health care cost components, such as variable costs (e.g., staffing and supplies) and fixed overhead costs (e.g., rent and percentage of administration costs).
Another alternative is to use hospital cost-to-charge ratios, which are calculated by dividing the total costs in a cost center by the total charges for the same resource. Cost-to-charge ratios are recognized as a gross adjustment to charges. This type of adjustment is better than using charges alone, but is not preferable to cost-accounting systems when they are available. Published sources also are often used as the source of valuation of the resource (Stone et al., 2000). Governmental fee schedules are also often used to represent costs of particular procedures (Armstrong, Malone, & Erder, 2008).
When cost estimates come from various sources, it is important to standardize all costs to the same currency and year. For example, non-U.S. currency figures may be converted into U.S. dollars using the appropriate foreign exchange factor for that time period (Board of Governors of the Federal Reserve System, www.federalreserve.gov/releases/g5a/current/default.htm). A recent review article in the nursing literature demonstrates the concept of applying exchange rates to cost estimates to compare across geographic regions (Cohen et al., 2016). The concept of purchasing-power parity, which not only accounts for the exchange rate but also attempts to yield the capacity to purchase the same quantity of goods, is also commonly used (Penz et al., 2014). In addition, because $1 in 1988 does not have the same purchasing power as $1 in the year 2008, the costs from different years must be adjusted into a standard year format by the use of the consumer price index (CPI), for which U.S. data are available from the Bureau of Labor Statistics (BLS) website (www.bls.gov), and a single year-to-year calculation can be done using the inflation calculator provided at that website (data.bls.gov/cgi-bin/cpicalc.pl). This inflation calculator is based on general market goods inflation. An example of such adjustment is a recent review examining costs of infection prevention activities in long-term care facilities in which the authors converted reported costs into 2013 U.S. dollars so that costs from different studies could be compared more effectively (Cohen et al., 2016). The BLS also calculates a medical inflation rate (www.bls.gov/cpi/cpifact4.htm). Because the costs of health care are rising more rapidly than costs in most other markets, analysts often use the medical inflation rate to inflate costs that pertain 32only to health care resources. Finally, there is discussion as to whether to use the CPI or the producer price index for inflation adjustment in general. Again, this largely depends on perspective. True opportunity costs are likely to be reflected in the producer price index. However, if the perspective is a payer perspective, then the CPI is likely to be more appropriate.
Discounting
Once all costs and benefits have been calculated, future costs and benefits are discounted to present value. Discounting reflects the principle that suggests people place greater value on something they have today than on something they will have in the future. Interest rates are an example of this principle. Future costs and benefits are discounted to present value using the following formula:
F/(1 + r)n
where F is the future value (usually measured in dollars at today’s value), r is the discount rate, and n is the number of years in the future (Stone, 1998). Currently, in the United States, experts recommend using the same discount rate to discount both costs and effects (Neumann et al., 2016). However, because prevention interventions are aimed at improving future health, by discounting future benefits, the intervention may not seem as beneficial. Therefore, some analysts are uncomfortable discounting future health benefits and only discount costs (Stone et al., 2000). Thus, to increase the comparability of analyses, APRNs in the United States should discount both costs and effects at 3% and, if desired, the results without discounting may also be presented. Moreover, the discount rate for a business case analysis is likely to be higher and represent the expected return on alternative uses of resources.
Analysis
In conducting economic evaluations, data gathered may include resource utilization, value of resources, effectiveness of treatment, and preferences regarding health outcomes. Based on the data gathered, the “base-case” analysis is computed. A best practice when presenting results is to include a table listing all parameters, the value assigned to each parameter, and the source of the value.
Sensitivity Analysis
Many of the data points gathered include some assumptions or uncertainty in the inputs. For clarification, the analysis based only on the best point estimates is referred to as the “base case,” regardless of whether the recommendations of the panel are followed. Thus, any CEA includes a base case, but not all base-case analyses are reference-case analyses.
The assumptions that are made in the base case should be clearly stated before the results are presented to increase the transparency of the analysis. In addition, sensitivity analyses should be conducted to explore the implications of alternative assumptions. Sensitivity analysis is an important element of a sound economic evaluation (Drummond et al., 2015; Gold et al., 1996).
33Sensitivity analyses are calculations in which a parameter is varied. These analyses indicate the degree of influence the particular value has on the analysis. The range used for a parameter should be specified along with the point estimate in Table 2.2.
A univariate sensitivity analysis examines the degree to which changing a single assumption changes the outcome of the entire analysis. By varying the value of the variable over a reasonable set of parameters, the investigator is able to determine how that variable may impact the results under different assumptions. The impact on the results has multiple interpretations. One is how the magnitude of the cost-effectiveness ratio changes; in other words, whether the ratio changes from spending $10,000/QALY gained to $30,000/QALY gained. However, a second level of interpretation is whether the decision to implement or not implement a new intervention changes. If a decision maker believes that any program costing less than $50,000 is a candidate for implementation, then the change from $10,000/QALY to $30,000/QALY will not change the decision about whether to consider a new intervention for implementation. Ryan, Revill, Devane, and Normand (2013) used a series of univariate sensitivity analyses to explore the extent of cost minimization between midwife-led maternity care and midwife care for only low-risk cases across the UK. Taking parameter estimates from three different clinical studies, the authors generated and evaluated eight different possible scenarios and determined that the cost difference between the alternatives ranged from −£253.38 to £108.12 per case.
Although univariate sensitivity analyses are insightful, looking at one source of uncertainty by itself is usually inadequate. The alternative is multivariate sensitivity analysis. A multivariate sensitivity analysis examines multiple sources of uncertainty at one time and may generate a more accurate understanding of the uncertainty of the cost-effectiveness results. This can be done by changing all parameters to their most or least favorable levels—but still working with predetermined levels of the values for each variable. A second approach makes use of the fact that variables can sometimes be expected to change together; in such cases, the analyst might explore how the cost-effectiveness ratio changes as the two variables are varied over their ranges. Finally, an analyst can conduct what is referred to as a probabilistic sensitivity analysis.
In this case, the analyst must define distributions from which the values for parameters may be drawn. A random draw is then taken from each distribution and the results of the analysis are calculated. The results of the first analysis are recorded and the process is repeated—at least thousands and sometimes tens of thousands of times. The analyst must then describe the range of results by describing the distribution of ratios. Fatoye and Haigh (2016) use this technique to describe the distribution of cost-effectiveness results in a study to compare the use of semirigid ankle brace versus taping to prevent recurrent acute ankle sprains. In this study, the estimated mean costs were assumed to have normative distributions, thereby identifying a range of possible cost values to be included in the Monte Carlo simulation model. The authors found that although taping was less expensive, the ICER for the brace versus taping was £263/QALY (well below the recommended ICER). However, due to skewed willingness to pay, there was a 46% probability of cost-effectiveness. A decision maker faced with this information would have to determine whether being 46% certain of a favorable economic result is sufficient to move forward with a policy change.
34 SUMMARY
The checklist in Exhibit 2.2 may be useful when communicating the results of an economic evaluation. This checklist draws on criteria for high-quality cost-effectiveness studies and draws on a number of sets of criteria that have been specified in related literature (Drummond et al., 2015; Eldessouki, 2012; Gold et al., 1996).
A second checklist for economic evaluations is the Consolidated Health Economic Evaluation Reporting Standards (CHEERS). This checklist, shown in Exhibit 2.3, may be particularly useful when reading and evaluating reported economic analyses, as well as designing and publishing these analyses (Husereau et al., 2013).
With the continuing development of new treatments, technologies, and models of care delivery, health-economic evaluations have become increasingly important. The demand for economic outcome research is growing, as is the number of published analyses. In this chapter, we have introduced various methods used in economic evaluation and have described the concepts and terminology used in these analyses.
EXHIBIT 2.2 CEA Checklist for Journal Report
1. Framework Background of the problem General framing and design of the problem Target population for the intervention Other program descriptors Description of comparator programs Boundaries of the analysis Time horizon Statement of the perspective of the analysis |
2. Data and methods Description of event pathway Identification of outcomes of interest in the analysis Description of model used Modeling assumptions Diagram of event pathway/model Software used Complete information about the sources of effectiveness data, cost data, and preference weights Methods for obtaining estimates of effectiveness, costs, and preferences Critique of data quality Statement of year costs Statement of method used to adjust costs for inflation Statement of type of currency Sources and methods for obtaining expert judgment Statement of discount rates |
353. Results Results of model validation Reference case results (discounted and undiscounted): total costs and effectiveness, incremental costs and effectiveness, and incremental cost-effectiveness ratios Results of sensitivity analyses Other estimates of uncertainty, if available Graphical representation of cost-effectiveness results Aggregate cost and effectiveness information Disaggregated results, as relevant Secondary analyses using 5% discount rate Other secondary analyses, as relevant |
4. Discussion Summary of reference case results Summary of sensitivity analysis assumptions having important ethical implications Limitations of the study Relevance of the study results for specific policy questions or decisions Results of related CEAs Distributive implications of the intervention |
5. Technical report available upon request |
CEA, cost-effectiveness analysis.
Source: Adapted from Gold et al. (1996).
EXHIBIT 2.3 CHEERS Checklist for Journal Report
36
37
CHEERS, Consolidated Health Economic Evaluation Reporting Standards.
Source: Adapted from Husereau et al. (2013).
38The quality of studies has been variable and not necessarily improving. As more studies are conducted and submitted for peer-reviewed publication, editors are not always able to find reviewers with the appropriate expertise; hence, studies that are poorly conducted in general or for which specific elements are poor can make their way into print. APRNs who plan to read these analyses need to understand methodology enough to recognize what makes a good study and what makes a study that is barely acceptable or even fails the test of acceptability.
APRNs interested in exploring this type of outcome evaluation are encouraged to seek additional training in these methods.
If APRNs participate in and conduct economic evaluations concerning the care they provide, the cost-effectiveness of APRN care may be demonstrated. When the analysis uses a standard methodology and the assumptions are transparent, the results are more easily interpreted. If the outcome measure is a standard ratio, such as dollars per QALY gained, the results may furnish a strong argument to health policy decision makers concerning the funding and continued recognition of APRNs as cost-effective health care providers.