Systematic reviews and clinical practice guidelines

CHAPTER 11


Systematic reviews and clinical practice guidelines


Geri LoBiondo-Wood




image


Go to Evolve at http://evolve.elsevier.com/LoBiondo/ for review questions, critiquing exercises, and additional research articles for practice in reviewing and critiquing.


The breadth and depth of clinical research has grown. As the number of research studies focused on similar content conducted by multiple researchers has grown, it has become important to have a means of organizing and assessing the quality, quantity, and consistency among the findings of a group of like studies. The previous chapters have introduced the types of qualitative and quantitative designs and how to critique these studies for quality and applicability to practice. The purpose of this chapter is to acquaint you with systematic reviews and clinical guidelines that assess multiple studies focused on the same clinical question, and how these reviews and guidelines can support evidence-based practice. Terminology used to define systematic reviews and clinical guidelines has changed as this area of research and literature assessment has grown. The definitions used in this textbook are consistent with the definitions from the Cochrane Collaboration and the PRISMA Group (Higgins & Green, 2011; Moher et al, 2009). Systematic reviews and clinical guidelines are critical and meaningful for the development of quality improvement practices.




Systematic review types


As defined in Chapter 1, a systematic review is a summation and assessment of research studies found in the literature based on a clearly focused question that uses systematic and explicit methods to identify, select, critically appraise, and analyze relevant data from the selected studies to summarize the findings in a focused area (Liberati et al., 2009; Moher et al., 2009). Statistical methods may or may not be used to analyze the studies reviewed. Multiple terms and methods are used to systematically review the literature, depending on the review’s purpose. See Box 11-1 for the components of a systematic review. At times, some of these terms are used interchangeably. The terms systematic review and meta-analysis are often used interchangeably or together. The only review type that can be labeled a meta-analysis is one that reviewed studies using statistical methods. An important concept to remember when reading a systematic review is how well the studies reviewed minimized bias or maintained the concept of control (see Chapters 8 and 9).



You will also find reviews of an area of research or theory synthesis termed integrative reviews. Integrative reviews critically appraise the literature in an area but without a statistical analysis and are the broadest category of review (Whittemore, 2005; Whittemore & Knafl, 2005). Systematic and integrative reviews are not designs per se, but methods for searching, and integrating the literature related to a specific clinical issue. These methods take the results of many studies in a specific area; assesses the studies critically for reliability and validity (quality, quantity, and consistency) (see Chapters 1, 7, 17, and 18); and synthesize findings to inform practice. Meta-analysis provides Level I evidence; the highest level of evidence as it statistically analyzes and integrates the results of many studies. Systematic reviews and meta-analyses also grade the level of design or evidence of the studies reviewed (see Chapters 1 and 17). Of all the review types, a meta-analysis provides the strongest summary support because it summarizes studies using data analysis. The Critical Thinking Decision Path outlines the path for completing a systematic review.




Systematic review


A systematic review is a summary of the quantitative research literature that used similar designs based on a focused clinical question. The goal is to bring together all of the studies concerning a focused clinical question and, using rigorous inclusion and exclusion criteria, assess the strength and quality of the evidence provided by the chosen studies in relation to:



The purpose is to report, in a consolidated fashion, the most current and valid research on intervention effectiveness and clinical knowledge, which will ultimately inform evidence-based decision making about the applicability of findings to clinical practice.


Once the studies in a systematic review are gathered from a comprehensive literature search (see Chapter 3), they are assessed for quality and synthesized according to quality or focus; then practice recommendations are made and presented in an article. More than one person independently evaluates the studies to be included or excluded in the review. Generally, the articles critically appraised are discussed in the article and presented in a table format within the article, which helps you to easily identify the specific studies gathered for the review and their quality. The most important principle to assess when reading a systematic review is how the author(s) of the review identified the studies to evaluate and how they systematically reviewed and appraised the literature that leads to the reviewers’ conclusions.


The components of a systematic review are the same as a meta-analysis (see Box 11-1) except for the analysis of the studies. An example of a systematic review was completed by Fowles and colleagues (2012) on the effectiveness of maternal health promoting interventions. In this review, the authors



Each study in this review was considered individually, not collectively, for its sample size, effect size, and its contribution to knowledge in the area based on a set of criteria.


Although systematic reviews are highly useful, they also have to be reviewed for potential bias. Thus the studies in a review need to be carefully critiqued for scientific rigor in each step of the research process.



Meta-analysis


A meta-analysis is a systematic summary using statistical techniques to assess and combine studies of the same design to obtain a precise estimate of effect (impact of an intervention on the dependent variable/outcomes or association between variables). The terms meta-analysis and systematic review are often used interchangeably. The main difference is only a meta-analysis includes a statistical assessment of the studies reviewed. A meta-analysis statistically analyzes the data from each of the studies, treating all the studies reviewed as one large data set in order to obtain a precise estimate of the effect (impact) of the results (outcomes) of the studies in the review.


Meta-analysis uses a rigorous process of summary and determining the impact of a number of studies rather than the impact derived from a single study alone (see Chapter 10). After the clinical question is identified and the search of the review of published and unpublished literature is completed, a meta-analysis is conducted in two phases:



Effect sizes are calculated using the difference in the average scores between the intervention and control groups from each study (Cochrane Handbook of Systematic Reviews for Interventions, 2011). Each study is considered a unit of analysis. A meta-analysis takes the effect size (see Chapter 12) from each of the studies reviewed to obtain an estimate of the population (or the whole) to create a single effect size of all the studies. Thus the effect size is an estimate of how large of a difference there is between intervention and control groups in the summarized studies. For example, the meta-analysis in Appendix E studied the question “Does counseling follow-up of women who had a miscarriage improve psychological well-being?” (Murphy et al., 2012). The studies that assessed this question were reviewed and each weighted for its impact or effect on improving psychological well-being. This estimate helps health care providers decide which intervention, if any, was more useful for improving well-being after a miscarriage. Detailed components of a systematic review with or without meta-analysis (Moher et al., 2009) are listed in Box 11-1.


In addition to calculating effect sizes, meta-analyses use multiple statistical methods to present and depict the data from studies reviewed (see Chapters 19 and 20). One of these methods is a forest plot, sometimes called a blobbogram. A forest plot graphically depicts the results of analyzing a number of studies. Figure 11-1 is an example of a forest plot from Murphy and colleagues (Cochrane Review, 2012; see Appendix E). This review identified whether follow-up by health care professionals or lay organizations at any time affects the psychological well-being of women following miscarriage.


Stay updated, free articles. Join our Telegram channel

Feb 15, 2017 | Posted by in NURSING | Comments Off on Systematic reviews and clinical practice guidelines

Full access? Get Clinical Tree

Get Clinical Tree app for offline access