Appraising qualitative research

CHAPTER 7


Appraising qualitative research


Helen J. Streubert




image


Go to Evolve at http://evolve.elsevier.com/LoBiondo/ for review questions, critiquing exercises, and additional research articles for practice in reviewing and critiquing.


Nurses contribute significantly to the growing body of health care research. Specifically, the influence of their work can be found in nursing, medical, health care, and business journals. Nurse researchers continue to partner with other health care professionals to develop, implement, and evaluate a variety of evidence-based interventions to improve client outcomes. The methods used to develop evidence-based practice include quantitative, qualitative, and mixed research approaches. In addition to the increase in the number of research studies and publications, there is also a significant record of externally funded research by nurses adding to the credibility of the work. The willingness of private and publicly funded organizations to invest in nursing research attests to its quality and potential for affecting health care outcomes of individuals, families, groups, and communities. Quantitative, qualitative, and mixed research methods are all important to the ongoing development of a sound evidence-based practice. As a result of this increased focus, this chapter will help the reader to understand how to assess the quality of qualitative research studies.


Qualitative and quantitative research methods are derived from strong traditions in the physical and social sciences. The two types of research are different in their purpose, approach, analysis, and conclusions. Therefore the use of each requires an understanding of the traditions on which the methods are based. The historical development of the methods identified as qualitative or quantitative can be discovered in this and other texts. This chapter aims to demonstrate a set of criteria that can be used to determine the quality of a qualitative research report. Nurses must fully understand how to assess the value of qualitative research, particularly in light of the requirement that nursing practice be evidence-based. According to Straus and Sackett (2005), evidence-based practice requires that patient values, clinical expertise, and the best evidence from published research be used in combination.


Leeman and Sandelowski (2012) attest to the value of patient outcomes-based qualitative research, but also challenge qualitative researchers to consider the value of these methods by learning about the evidence base that supports the adoption of evidence-based practice in the clinical setting. They contend that it is important to study the “culture and networks of social systems” (p. 172) in which evidence-based practice exists in order to better understand the context which empowers the adoption of particular practices. Mantzoukas (2007) argues that it is the reflection by practitioners that leads to an appropriate contextual application of evidence-based interventions. This supports the ideas posited by Leeman and Sandelowski. Qualitative methodology provides nurses an opportunity to study the processes and relationships that lead to the acceptance of evidence-based practice, an understanding of which can be used as a foundation to provide improved patient care.


As a framework for understanding how the appraisal of qualitative research can support evidence-based practice, a published research report and critiquing criteria will be presented. The critiquing criteria will be used to demonstrate the process of appraising a qualitative research report.




Stylistic considerations


Qualitative research differs from quantitative research in some very fundamental ways. Qualitative researchers represent a basic level of inquiry that seeks to discover and understand concepts, phenomena, or cultures. Jackson and colleagues (2007) state the primary focus of qualitative research is to understand human beings’ experiences in a humanistic and interpretive way (p. 21). In a qualitative study you should not expect to find hypotheses; theoretical frameworks; dependent and independent variables; large, random samples; complex statistical procedures; scaled instruments; or definitive conclusions about how to use the findings. Because the intent of qualitative research is to describe, explain, or understand phenomena or cultures, the report is generally written in a narrative that is meant to convey the full meaning and richness of the phenomena or cultures being studied. This narrative includes subjective comments that are intended to provide the depth and richness of the phenomena under study.


The goal of a qualitative research report is to describe in as much detail as possible the “insider’s” or emic view of the phenomenon being studied. The emic view is the view of the person experiencing the phenomenon reflective of his or her culture, values, beliefs, and experiences. What the qualitative researcher hopes to produce in the report is an understanding of what it is like to experience a particular phenomenon or be part of a specific culture.


One of the most effective ways to help the reader understand the emic view is to use quotes reflecting the phenomenon as experienced. For this reason the qualitative research report has a more conversational tone than a quantitative report. In addition, data are frequently reported using concepts or phrases that are called themes (see Chapters 5 and 6). A theme is a label. Themes represent a way of describing large quantities of data in a condensed format. To illustrate the application of a theme and how it helps the reader understand the emic view, the following is offered from a report published by Seiler and Moss (2012, Appendix C). The authors’ purpose is to “gain insights into the unique experiences of nurse practitioners (NPs) who provide health care to the homeless.” The following quote is used by Seiler and Moss to demonstrate the theme of “making a difference.” Using the informant’s words, the researchers share how working with the homeless makes a difference:



The richness of the narrative provided in a qualitative research study cannot be shared in its entirety in a journal publication. Page limitations imposed by journals frequently limit research reports to 15 pages. Despite this limitation, it is the qualitative researcher’s responsibility to illustrate the richness of the data and to convey to the audience the relationship between the themes identified and the quotes shared. This is essential in order to document the rigor of the research, which is called trustworthiness in a qualitative research study. It is challenging to convey the depth and richness of the findings of a qualitative study in a published research report. A perusal of the nursing and health care literature will demonstrate a commitment by qualitative researchers and journal editors to publish qualitative research findings. Regardless of the page limit, Jackson and colleagues (2007) offer that it is the researcher’s responsibility to ensure objectivity, ethical diligence, and rigor regardless of the method selected to conduct the study. Fully sharing the depth and richness of the data will also help practitioners to decide on the appropriateness of applying the findings to their practice.


There are some journals that by virtue of their readership are committed to publication of more lengthy reports. Qualitative Health Research is an example of a journal that provides the opportunity for longer research reports. Guidelines for publication of research reports are generally listed in each nursing journal or are available from the journal editor. It is important to note that criteria for publication of research reports are not based on a specific type of research method (i.e., quantitative or qualitative). The primary goal of journal editors is to provide their readers with high quality, informative, timely, and interesting articles. To meet this goal, regardless of the type of research report, editors prefer to publish manuscripts that have scientific merit, present new knowledge, support the current state of the science, and engage their readership. The challenge for the qualitative researcher is to meet these editorial requirements within the page limit imposed by the journal of interest.


Nursing journals do not generally offer their reviewers specific guidelines for evaluating qualitative and quantitative research reports. The editors make every attempt to see that reviewers are knowledgeable in the method and subject matter of the study. This determination is often made, however, based on the reviewer’s self-identified area of interest. Research reports are often evaluated based on the ideas or philosophical viewpoints held by the reviewer. The reviewer may have strong feelings about particular types of qualitative or quantitative research methods. Therefore it is important to clearly state the qualitative approach used and, where appropriate, its philosophical base.


Fundamentally, principles for evaluating research are the same. Reviewers are concerned with the plausibility and trustworthiness of the researcher’s account of the research and its potential and/or actual relevance to current or future theory and practice (Horsburgh, 2003, p. 308). The Critiquing Criteria: Qualitative Research box below provides general guidelines for reviewing qualitative research. For information on specific guidelines for appraisal of phenomenology, ethnography, grounded theory, historical, and action research, see Streubert and Carpenter (2011). If you are interested in additional information on the specifics of qualitative research design, see Chapters 5 and 6.



CRITIQUING CRITERIA


Qualitative Research












Application of qualitative research findings in practice


The purpose of qualitative research is to describe, understand, or explain phenomena or cultures. Phenomena are those things that are perceived by our senses. For example, pain and losing a loved one are considered phenomena. Unlike quantitative research, prediction and control of phenomena are not the aim of the qualitative inquiry. Therefore, qualitative results are applied differently than more traditional quantitative research findings. Barbour and Barbour (2003, p. 185) state that



Further, Barbour and Barbour (2003) offer that qualitative research can provide the opportunity to give voice to those who have been disenfranchised and have no history. Therefore the application of qualitative findings will necessarily be context-bound (Russell & Gregory, 2003). This means that if a qualitative researcher studies, for example, professional dignity in nursing, the application of these findings is confined to individuals who are similar to those who informed the research.


Qualitative research findings can be used to create solutions to practical problems (Glesne, 1999). Qualitative research also has the ability to contribute to the evidenced-based practice literature (Cesario et al., 2002; Gibson & Martin, 2003; Walsh & Downe, 2005). For instance, in the development of a grounded theory study of the emotional process of stroke recovery, Gallagher (2011) shares how critical it is for care providers to let their patients set goals despite practitioners’ level of knowledge and experience. As the author in this research report points out, those recovering from stroke at times feel a dissonance from their provider. Once stroke victims have their basic needs met, they report an incongruity between the goals they set for themselves and what their therapists see as priorities.


It is important to view research findings within context, whether quantitative or qualitative. For instance, a quantitative study of survivorship in female breast cancer survivors (Meneses et al., 2007) should not be viewed as applicable to survivors of another “survivor” situation such as an epidemic or mass casualty. The findings must be used within context, or additional studies must be conducted to validate the applicability of the findings across situations and patient populations. This is true in qualitative research, as well. Nurses who wish to use the findings of qualitative research in their practice must validate them, through thorough examination and synthesis of the literature on the topic, through their own observations, or through interaction with groups similar to the study participants, to determine whether the findings accurately reflect the experience.


Morse and colleages (2000) offer “qualitative outcome analysis (QOA) [as a] systematic means to confirm the applicability of clinical strategies developed from a single qualitative project, to extend the repertoire of clinical interventions, and evaluate clinical outcomes” (p. 125). Using this process, the researcher employs the findings of a qualitative study to develop interventions and then to test those selected. Qualitative outcome analysis allows the researcher/clinician to implement interventions based on the client’s expressed experience of a particular clinical phenomenon. Further, Morse and colleagues (2000) state, “QOA may be considered a form of participant action research” (p. 129). Application of knowledge discovered during qualitative data collection adds to our understanding of clinical phenomena by using interventions that are based on the client’s experience. QOA is considered a form of evaluation research and as such has the potential to add to evidence-based practice literature either at Level V or at Level VI depending on how the study is designed.


Another use of qualitative research findings is to initiate examination of important concepts in nursing practice, education, or administration. For example, surgical consent as a concept has been studied using both qualitative and quantitative methods. It is considered a significant responsibility in nursing. Therefore studying its multiple dimensions is important. In a study by Cole (2012), the author examined implied consent as it relates to patient autonomy. The informants were nurses in a one day surgical unit. The outcome of her research was a richer understanding of how nurses view implied consent and the dimensions of the relationship necessary for the patient to exercise his or her autonomy. The study adds to the existing body of knowledge on patient consent and extends the current state of the science by examining a specific area of nursing practice and the experience of practicing nurses. This type of study is at Level V or VI, which includes either systematic reviews or single studies that are descriptive or qualitative in their design (see Chapter 1).


Meta-synthesis is also a widely accepted method of synthesizing findings from a number of qualitative research studies in an attempt to further validate the conceptualizations found among individual qualitative studies. According to Finfgeld-Connett (2010) meta-synthesis is a way of integrating findings from a number of disparate investigations to increase their utilization in practice and in policy formation. Further, when these evidentiary-based generalizations are made, they add to the generalizability and transferability of the research (p. 252).


Finally, qualitative research can be used to discover evidence about phenomena of interest that can lead to instrument development. When qualitative methods are used to direct the development of structured measurement instruments, it is usually part of a larger empirical research project. Instrument development from qualitative research studies is useful to practicing nurses because it is grounded in the reality of human experience with a particular phenomenon and informs item development. A study completed by Richards (2008) illustrates the use of both qualitative and quantitative methods to develop, revise, and test a pain assessment instrument.



Critique of a qualitative research study




The research study


The study “Becoming Normal: A Grounded Theory Study on the Emotional Process of Stroke Recovery” by Patti Gallagher (2011), published in Canadian Journal of Neuroscience Nursing, is critiqued. The article is presented in its entirety and followed by the critique on p. 153.



Becoming normal: A grounded theory study on the emotional process of stroke recovery

By Patti Gallagher, RN, MN, CNS



Abstract



The purpose of this grounded theory study was to examine the emotional process of stroke recovery, personally experienced by stroke survivors. Nine stroke survivors living in Atlantic Canada participated in this study. Data collection came from formal unstructured interviews and one group interview.


The central problem experienced by these stroke survivors was being less than 100%. The basic social process used to address this problem was becoming normal, which is composed of three stages: recognizing stroke will not go away, choosing to work on recovery, and working on being normal. Each stage has several phases.


Being less than 100% is the emotional result of being unable to do certain things that serve to form individuals’ identities. A critical finding was that physical and emotional recovery is inseparable, and recovery is directed towards regaining the ability to perform these certain things. Becoming normal was influenced both positively and negatively by the following conditions: personal strengths and attributes, past history, family support, professional support, faith and comparing self to peers.


The results of this study have implications for nursing practice, nursing education and nursing research. It adds to nursing knowledge by illuminating the close relationship between physical and emotional recovery, the duration of the stroke recovery process, and the necessity for survivors to make a deliberate choice to recover.



Introduction


Stroke, a sudden and catastrophic event, can instantly change the life of the affected individuals and those close to them. Considerable investigation has focused on the physical effects of stroke and functional recovery patterns. Unfortunately, the same is not true about the emotional effects of stroke. Indeed, very little is written about emotional recovery from acute stroke. At the same time, what is written is often not supported by the use of scientific tools or sound research methods, which could enhance the significance of the findings (Kelly-Hayes, et al., 1998; Kirkevold, 1997; Roberts & Counsell, 1998). Understanding emotional effects and, more specifically, the process of emotional recovery after a stroke can be important to enhancing stroke recovery work. This includes work performed by health care professionals who interact with people who experience stroke, as well as with their families.


Often, health care professionals who care for stroke survivors note that many people work hard to recover from stroke and regain their life. However, there are others who do not seem to be able to motivate themselves to undergo similar work (Doolittle, 1991; 1992; MacLean, Pound, Wolfe, & Rudd, 2002). As a clinician who works with stroke survivors, I wanted to examine stroke survival work from the perspective of persons who considered themselves stroke survivors. I hoped to gain an understanding of what drives a stroke survivor to work on recovery.


The purpose of this grounded theory study was to examine the process of emotional recovery after stroke from the perspective of stroke survivors. The resulting substantive theory of “becoming normal” adds to nursing knowledge with a new framework of stroke recovery that is grounded in the stroke survivors’ experiences. Some of these theoretical findings are supported by previous research by others. “Becoming normal” illuminates the close relationship between physical and emotional recovery, the duration of the stroke recovery process, and the necessity of making a deliberate choice to recover.



Literature review


When using grounded theory, the initial literature review is conducted to sensitize the researcher to the phenomenon of interest without biasing or blinding the researcher to emerging concepts. Upon analysis of the research data and the emergence of relevant concepts, a more in-depth literature review is conducted. This process facilitates researcher openness to emerging concepts, as revealed by the participants (Chenitz & Swanson, 1986; Glaser, 1978; Morse & Field, 1995; Streubert & Carpenter, 1999). Others may argue that an initial literature review may bias the researchers and blind them to emerging concepts (Glaser, 1978).


For the purpose of this research, an initial sampling of the literature related to the topic of emotional issues in stroke was undertaken to provide an overview of the current state of the knowledge. The following concepts were identified as being of particular concern in the examination of emotional recovery following stroke: post-stroke depression, self-worth, hope, crisis and chronic illness. Indeed, there has been research conducted that examined the importance of depression, self-worth, hope and crisis on the emotional recovery from chronic illness. However, emotional recovery post-stroke is still not clearly understood, although feelings that were identified as important, such as depression (Robinson & Price, 1982; Robinson, Starr, Kubos, & Price, 1983; Robinson & Bolla-Wilson, 1986), self-esteem (Chang & Mackenzie, 1998; Doolittle, 1991; 1992; Hafsteinsdottir & Grypdonck, 1997), hope (Hafsteinsdottir & Grypdonck, 1997; Popovich, 1991), and crisis (Backe, Larrson, & Fridlund, 1996; Nilsson, Jannson, & Norberg, 1997), were examined individually within separate studies. There was no evidence of inter-relationship, or of their essential significance in emotional stroke recovery (Bennet, 1996; Kelly-Hayes, et al., 1998). There was sparse literature available concerning the process of emotional recovery from the stroke-survivor’s perspective (Doolittle, 1991), although many authors noted that the perspective of the stroke survivor was critical to nurses’ understanding of and aiding emotional recovery from stroke (Bays, 2001; Bennett, 1996; Hafsteinsdottir & Grypdonck, 1997; Kirkevold, 1997). It is also evident that stroke is multifaceted and can be viewed from different lenses, such as stroke as a crisis or stroke within a chronic illness trajectory. However, no evidence of substantial work from these perspectives was found.


The process of emotional recovery from stroke is poorly understood and under-researched. As such, it would be premature to force the information gained from a study of emotional recovery into an existing theoretical framework. The potential to lose important information related to stroke recovery while trying to fit research findings within an inappropriate framework could be significant (Glaser, 1978).



Ethics approval


Ethics approval was obtained from the local university, as well as the provincial branch of the Heart and Stroke Foundation of Canada. Research did not begin until written approval was received. The executive director of the Heart and Stroke Foundation received a copy of the research proposal for their board to review as the initial sample for this study was a convenience sample of stroke survivors recruited from a list of participants in a stroke recovery program. The facilitators for the program sent letters of invitation to past participants of the program. Those who agreed to be interviewed mailed a letter of intent, they were contacted and, following a full explanation of the study with an opportunity for questions, arrangements were made to meet in person and obtain consent.



Study participants


Nine stroke survivors ranging in age from 42 to 82 years and living in Atlantic Canada participated in this study, conducted in 2004, and were representative of a variety of stroke types, ages, marital and family circumstances. One had been locked in, three aphasic, four had right-sided weakness and four left side. All were highly motivated people who were eager to do whatever it took to recover from their stroke, as well as to share their experiences.


Data collection came from individual formal unstructured interviews and one focus group session where the emerging theory was presented for discussion and confirmation. All participants were invited to attend a group session when the analysis was approaching completion and the substantive grounded theory developed. The focus group interview was held in order to provide a test of credibility (did the emerging theory resonate with the group and explain their response to stroke). Five stroke survivors and their families attended the focus group, which was held six months after the final interview.


Each person was interviewed at least once. Subsequent interviews to clarify content obtained in the first interview occurred. Participants were informed of this prior to obtaining consent, and the formal consent contained a statement that indicated the researcher might wish to speak with the participant more than once. Participants were encouraged to contact the researcher in the event they had something further to ask or had questions or concerns. In addition, provisions were in place to provide participants with an opportunity to receive support if they had concerns or problems at any time during the project. The researcher agreed to contact each participant following the interview to ensure there were no problems or issues.


Four participants contacted the researcher following their interviews, as they felt they had something further to contribute and gave information that added to clarification of the process of “becoming normal.” Participants were informed that the aim was to hear the story from their perspective and that the interview should preferably take place in a quiet, private setting. Four participants had family present during their interviews. At times family members interjected but, for the most part, were silent observers.


Stroke survivors who participated in the study sustained a stroke that left them with a level of physical impairment that required admission to a rehabilitation unit following admission to an acute stroke unit. Each was living at home at the time of the interview. The period of time from their stroke event to interview ranged from as recent as six months to four years for one participant. The median time was one year post stroke.


Half of the participants had some degree of aphasia during their initial acute stroke period, but all were able to communicate during the time of the interview. It was interesting to note that participants who experienced aphasia reported significant events and turning points unique to their stroke recovery where they recognized their inability to communicate, but were fully present and aware. They shared their reactions and impact on recovery.

Stay updated, free articles. Join our Telegram channel

Feb 15, 2017 | Posted by in NURSING | Comments Off on Appraising qualitative research

Full access? Get Clinical Tree

Get Clinical Tree app for offline access