The evidence base for children’s nursing practice

Chapter 14. The evidence base for children’s nursing practice

Peter Callery and Sarah Neill



LEARNING OUTCOMES



• Describe the sources of evidence that can contribute to development of interventions in children’s nursing.


• Describe a hierarchy of evidence for interventions in children’s nursing.


• Describe evidence required in implementation of interventions.


• Describe critical appraisal issues specific to research with children.


• Describe emerging themes in children’s nursing research.



Introduction


The volume of research publications is daunting. Asthma, as the most common illness of childhood and involving children’s nurses in community and hospital settings, can illustrate the volume and types of evidence used in children’s nursing practice. Ovid Medline lists 7091 papers in English indexed under ‘Asthma’ ‘limited to child (0–18 years)’ in the period 1996 to July 2003. A systematic approach is therefore required if research is to be used to inform decisions about care. The evidence-based medicine movement has developed principles and procedures for searching and assessing research literature. Nurses can use the approach to base their own practice on evidence provided that there is recognition of the special features of children’s nursing.


Formulating questions


It is important to define the question that evidence is required to answer. The more clearly focused the question, the more likely that it will be possible to identify the most appropriate evidence available for the answer. Questions can be expressed in terms of four elements, using the PICO framework:

P = patient

I = intervention

C = comparison


Craig (2002) illustrated how this framework can be used to identify and answer questions arising from practice in nursing. Her first example was a child who had developed a pressure ulcer on the back of her head when recovering from open heart surgery (Craig 2002). The question about the individual child: ‘How can I prevent further pressure ulcers from developing in this child?’ can be developed into a question to be answered by systematic review of randomised, controlled trials: ‘In critically ill children, are constant low-pressure beds more effective than high specification foam mattresses in preventing pressure ulcers (defined here as constant discolouration of the skin, or partial or full thickness skin loss)?’ (Craig 2002). This type of question is well suited to the PICO framework because it is concerned with a nursing action (the choice between a constant low-pressure bed and a foam mattress) that can be clearly associated with one consequence, formation of pressure ulcers. The direct link between cause and effect makes possible the use of experimental designs, including the randomised, controlled trial.

Evidence-based principles might suggest that all practice should be based on experimental research. However, even though experimental methods are well suited to pharmaceutical therapy, many drugs are not tested and therefore not specifically licensed for use in children (Conroy et al 2000). The limitations of the evidence base for treatment of children and young people is highlighted by the few studies that provide the basis for treating 40,000 people under the age of 18 years with major depressive disorder (Ramchandani 2004). Experiments to compare different treatments have not been conducted in children for various reasons. Some treatments are given to small numbers of children, which makes large-scale trials difficult to arrange or expensive. Ethical considerations can present difficulties in establishing trials to compare different treatments, particularly when alternative treatments are not available.

Not everything that nurses do can be tested by an experiment. Limitations of the PICO framework are illustrated by another of Craig’s examples: a health visitor wants to understand why mothers feed infants with formula milk rather than breast feeding. The question is concerned with identifying information that could lead to an intervention to promote breast feeding. Craig (2002) suggested the question be formulated using the Patient and Outcome elements of the framework, excluding the Intervention and Comparison elements: ‘What are the factors identified by mothers who live in deprived inner city areas that influence them to breast feed or to bottle feed using infant milk formula?’; a qualitative design would be required.

‘Why?’ questions such as this can be answered by understanding the world from the viewpoint of the people concerned. It is therefore best to take an open-ended approach, avoiding assumptions that may not be shared by the people who are to be studied. The types of question that are most appropriately asked would therefore be concerned with how mothers make decisions about feeding their infants. There is a risk that the prior definition of patient (or, in this case, population) and outcome is based on assumptions about common characteristics of mothers and the definition of breast feeding as an outcome. The formulation of the question therefore requires reference to a theory of why mothers in deprived areas will have similar concerns about breast feeding.

The application of the PICO framework in children’s nursing can be complicated by tensions between children’s and parents’ perspectives and interests. Children and parents may have different understandings of health problems and different goals for care. Questions about care may need to reflect differences between parents’ and children’s concerns and goals.

B9780702031830100141/activity.jpg is missing Activity


Think about your day-to-day practice and identify a problem that you need evidence to solve (e.g. ‘What will prevent development of pressure ulcers in critically ill children?’):


• Try to turn your identified problem into a question that follows the PICO framework.


• What sort of evidence could provide the answer that you need?


• Is there a clear link between cause and effect and could an experiment be performed?


Complex interventions


Nursing interventions in children’s health care are often ‘complex interventions’:

Complex interventions in health care, whether therapeutic or preventative, comprise a number of separate elements which seem essential to the proper functioning of the intervention although the ‘active ingredient’ of the intervention that is effective is difficult to specify. If we were to consider a randomised controlled trial of a drug vs. a placebo as being at the simplest end of the spectrum, then we might see a comparison of a stroke unit to traditional care as being at the most complex end of the spectrum. The greater the difficulty in defining precisely what, exactly, are the ‘active ingredients’ of an intervention and how they relate to each other, the greater the likelihood that you are dealing with a complex intervention



B9780702031830100141/www.jpg is missing www


The full MRC document can be downloaded from the web as (you will need to download the free Acrobat Reader software to read it):

Health visitors wishing to promote breast feeding will develop complex interventions. They might devise educational programmes whose ‘active ingredients’ include the quality of continuing relationships with mothers, information about the benefits of breast feeding and the method of communication, whether in groups or through individual contact.

Similar complexity can be seen in many nursing interventions. In hospital, nurses help children to cooperate with delivery of drug therapy by nebuliser, which requires the child to wear a mask. Community nurses explain how to use medication to control asthma at home. In each case the ‘active ingredient’ is difficult to identify: the manner in which the nurse forms a relationship with child and family, the content of the nurse’s explanations, and the time and place at which the information is provided could all have important effects.

Identification and measurement of outcomes presents particular difficulties in children’s nursing. Some outcomes are clear-cut, e.g. the formation of pressure ulcers, whereas others can be assessed only in relation to children’s development, e.g. satisfactory growth, or require assessment by children themselves, e.g. assessment of quality of life.

B9780702031830100141/activity.jpg is missing Activity


Identify a complex intervention from your area of practice. List the possible ‘active ingredients’.


Types of evidence


Once the question has been identified, the next task is to identify the best evidence that will contribute to the answer. A systematic approach to literature searching is required to ensure that important evidence is not missed. A hierarchy of the different forms of evidence available can be used to identify the best evidence that is available. For example, studies can be organised in order of the strength of their design (Muir Gray 1997):


• I. Strong evidence from at least one systematic review of multiple, well-designed, randomised controlled trials.


• II. Strong evidence from at least one properly designed randomised, controlled trial of appropriate size.


• III. Strong evidence from well-designed trials without randomisation, single group, cohort, time series or matched case-control studies.


• IV. Evidence from well-designed, non-experimental studies from more than one centre or research group.


• V. Opinions of respected authorities based on clinical evidence, descriptive studies or reports of expert committees.

Categorisation of evidence usually follows the principle that the best evidence is to be found in studies that have minimised bias through design, for example by randomly allocating subjects to intervention and control groups to enable comparison of the effects of treatments. However, the design of a study does not guarantee the quality of the evidence (Wilson et al 1995).

B9780702031830100141/www.jpg is missing www


More detailed categorisation of studies is presented and explained at the website of the Centre for Evidence-based Medicine:

Nursing interventions in asthma illustrate the use of evidence from studies of various designs and the contribution of qualitative research to the evidence base for children’s nursing practice.


Systematic reviews


A systematic review of randomised, controlled trials of education in asthma concluded that:

Educational programmes for the self management of asthma in children and adolescents improve lung function and feelings of self control, reduce absenteeism from school, number of days with restricted activity, number of visits to an emergency department, and possibly number of disturbed nights. Educational programmes should be considered a part of the routine care of young people with asthma


The review used a systematic method of searching the literature. The search terms used for Medline (1966–98), Embase (1980–98), and CINAHL (1982–98) were:

asthma OR wheez

AND education OR self management OR self-management

AND placebo OR trial OR random OR double-blind OR double blind OR single-blind OR single blind OR controlled study OR comparative study.

Other databases and journals were also searched and 318 studies were identified. The quality of studies was assessed on the basis of the design, including whether allocation to the intervention or to the control group was known before each subject was included in the study. This criterion for quality was therefore concerned with potential bias: whether all the children in the population to be studied had an equal chance of being included in the sample. Once these criteria were applied, 45 of 318 identified studies were potentially eligible. However, 13 were excluded when other quality criteria were applied, leaving 32 trials totalling 3706 children and adolescents with asthma.

The stricter the criteria used for selecting studies eligible for inclusion in a systematic review, the fewer studies that will be included, so judgements about the criteria to be applied are important in designing such reviews. Guevara et al (2003) summarised the studies they reviewed:

Most were relatively small randomised controlled trials and enrolled children with severe asthma. Fifteen trials enrolled adolescents aged 13 to 18 years, and 12 enrolled children aged 2 to 5 years; no study stratified data on age. The educational programmes were diverse and targeted children, parents, or both. Most had programmes with multiple sessions and symptom based strategies.

The conclusions that could be reached by the review were therefore limited by the characteristics of the studies that were included. Guevara et al’s review could make limited comments about: non-severe asthma, interventions at different ages, the types of education that is most effective and whether education should be directed at children, parents or both. The conclusion that education should be incorporated into the routine care of children with asthma is welcome but somewhat limited.

Guevara et al recommend further research, and here they are more specific. They suggest that:

Future studies should test alternative components directly to determine their relative effectiveness, for example, studies should focus on morbidity measurements and quality of life and directly compare strategies based on peak flow with those based on symptoms and compare strategies aimed at the individual with those aimed at the group.

These suggestions highlight the importance of understanding the intervention thoroughly. Guevara et al are essentially asking what might be the ‘active ingredient’ of education: is it directed at preventing the occurrence of acute episodes of illness or at improving quality of life? Is the active ingredient individualised education or education provided for groups? Their other question, ‘Should education be based on symptoms or on peak flow measurement?’ can be answered by another study from lower in the hierarchy of study designs. Forty asthmatic children (5–16 years) were asked to:

… perform peak flow measurements twice daily for 4 weeks by means of an electronic peak flow meter and to record values in a written diary. Patients and parents were unaware that the device stored the peak flow values on a microchip. Data in the written diary (reported data) were compared with those from the electronic diary (actual data)


The authors reported that children’s peak flow results were so unreliable that they should not be trusted:

The percentage of correct peak flow entries decreased from 56% to <50% from the first to the last study week ( p < 0.04), mainly as a result of an increase in self-invented peak flow entries … Peak flow diaries kept by asthmatic children are unreliable. Electronic peak flow meters should be used if peak flow monitoring is required in children with asthma


This illustrates how descriptive studies that add to understanding of how people behave in health care can make important contributions to developing evidence-based practice. (The ‘ p’ value reported by Kamps refers to the probability that the difference was caused by chance, in most studies it is accepted that a result is statistically significant if there was a less than 5% (1 in 20) likelihood that the differences between two values could have been caused by chance.)


Randomised controlled trials


Randomised controlled trials (RCTs) have shown that nurses can make important differences to the health of children with asthma by educating them about self-management of their condition:

A prospective randomised control study of an asthma home management training programme was performed in children aged two years or over admitted with acute asthma. Two hundred and one children were randomised at admission to either an intervention group ( n = 96), which received the teaching programme, or a control group ( n = 105). A nurse-led teaching programme used the current attack as a model for the management of future attacks and included discussion, written information, subsequent follow up and telephone advice aimed at developing and reinforcing individualised asthma management plans. Parents were also provided with a course of oral steroids and guidance on when to start them … Subsequent readmissions were significantly reduced in the intervention group from 25% to 8% in individual follow up periods that ranged from two to 14 months


Madge et al’s study demonstrated both the value and limitations of RCTs. The study showed that children educated by a nurse fared better, with less need for readmission and reduction in asthma symptoms. However, the problem of deciding what the ‘active ingredient’ is evident. One nurse delivered the education – would other nurses have been as effective? The education was delivered as children were discharged from hospital. The authors followed-up children to assess the duration of the effect of education but this analysis was limited by the variation in the period of follow-up from 2–14 months. There is evidence that asthma attacks affect receptiveness to information in adults with asthma:

strong cognitive/affective responses to attacks may motivate improved self-care and this represents a window of opportunity for self-care interventions


Was the education effective in Madge et al’s study because it was delivered while the children were being discharged from hospital? In a qualitative study of parents’ and children’s perspectives on asthma it was reported that parents gave more emphasis to acute attacks than children and that they accepted some symptoms as tolerable provided that they did not result in an acute attack (Callery et al 2003). Could education at the time of an attack reinforce parental focus on acute attacks and hospitalisations rather than drawing parents’ attention to controlling low-level symptoms that might affect children’s quality of life? In addition to the educational intervention, the authors reported that parents were given oral steroids and instructions about their use. Were oral steroids one of the ‘active ingredients’ that resulted in improved outcomes for the intervention group? These questions arise because of the difficulty of separating different effects, or confounding variables, on the outcomes. The questions also indicate the importance of a thorough understanding of interventions and how they are seen by those involved, including children as well as parents and health professionals. Therefore descriptive studies, including qualitative studies, are required to complement experimental studies in the development and evaluation of complex interventions.

B9780702031830100141/activity.jpg is missing Activity


Find research paper(s) that explore a problem relevant to your nursing practice:


• What type of evidence has been used to study the problem?


• What other types of design could be used to study this problem?


Researching complex interventions


Phases of development may be required to test complex interventions (MRC Health Services and Public Health Research Board 2000).

The first phase is preclinical and is concerned with developing the underlying theory for the intervention. Studies of educational interventions in asthma have been criticised for neglecting this phase, so that educational programmes have been developed without first identifying the theory that will guide practice (Clark & Gong 2000).


• Phase I – in which the components of the intervention are identified and assessed – commences once the theoretical framework has been identified. This phase is concerned with identifying the active ingredients.


• Phase II is an exploratory trial, or pilot study, that checks that an experimental study can be conducted.


• Phase III is the full trial.


• The final phase, IV, is concerned with long-term implementation: can others produce similar results with the intervention and maintain them over time?

The need for detailed developmental work before trialling interventions was highlighted in a report on diabetes education in childhood:

This review recommends that a phase of programme development be undertaken involving a consultation process with adolescents with type 1 diabetes, their families, doctors, nurses, health economists and health psychologists. This consultation exercise would enable the establishment of possible interventions that are seen as plausible and potentially effective by patients and their parents, feasible and practical in the context of the NHS diabetes services and understood and accepted by doctors and nurses as key and integral parts of diabetes care. The interventions would also need to have the potential to be cost-effective and be based on sound behavioural principles. Such interventions, if subsequently demonstrated by commissioned research to be effective, would he much more likely to be implemented than ones developed without such a process

Only gold members can continue reading. Log In or Register to continue

Stay updated, free articles. Join our Telegram channel

Jun 15, 2016 | Posted by in NURSING | Comments Off on The evidence base for children’s nursing practice

Full access? Get Clinical Tree

Get Clinical Tree app for offline access