August, 2016 - SUPPORT Summary of a systematic review | print this article | download PDF

Do continuing education meetings and workshops for healthcare professionals improve professional practice and healthcare outcomes?

An important aim of continuing education for healthcare professionals is to improve professional practice so that patients can receive improved healthcare. Educational meetings and printed educational materials are the most common types of continuing education for health professionals. Educational meetings include lectures, workshops and courses. The meetings can be highly variable in terms of content, number of participants, the degree and type of interaction, length and frequency.

 

Key messages

  • Educational meetings alone or combined with other interventions probably improve professional practice and healthcare outcomes for patients.
  • Educational meetings may be more effective with higher attendance at the educational meetings, mixed interactive and didactic educational meetings compared to only interactive or only didactic educational meetings.
  • Educational meetings may not be effective for complex behaviours and they may be less effective for less serious outcomes.

Background

Health professionals need continuing education to be updated and improve practice. In many countries continuing medical education is mandated by professional or regulatory bodies or stimulated by incentives. Each year billions of dollars worldwide are spent on continuing medical education activities. Nearly all health professionals in high-income countries attend educational meetings, such as lectures and workshops. The amount of continuing education time spent at educational meetings is second only to the amount of time spent reading, by self-report.



About the systematic review underlying this summary

Review objectives: To address the following questions:

1) Do educational meetings and workshops improve professional practice and healthcare outcomes?

2) What are the effects of educational meetings compared with the effects of other interventions?

3) Can changes in how educational meetings are done increase the effects?

Type of What the review authors searched for What the review authors found
Study designs & interventions The following types of educational meetings: conferences, lectures, workshops, seminars, symposia and courses. Only randomized trials were included.
81 trials (74 cluster-randomized trials, 7 randomized by providers). Targeted behaviours were preventive care (11), test ordering (3), screening (6), prescribing (13), general management of a wide array of problems (41) and other (7). The interventions were multifaceted in 32 studies.
Participants Studies involving qualified health professionals or health professionals in post-graduate training were included. Studies involving only undergraduate students were excluded.
The health professionals were physicians in most trials, nurses (2 studies), pharmacists (3), prescribers (1), or mixed providers (18).
Settings All healthcare settings (primary care and hospital care).
General practice (43 studies), community-based care (16), hospital-based care (17) and 'other type of settings’ (5). Studies were from USA (28), UK (14), Netherlands (10), Canada (4), Australia (3), Norway (3), France (2), Indonesia (2), South-Africa (2); Sweden, Denmark, Belgium, Spain, Scotland, Mali, Thailand, Peru, Mexico, Zambia, Sri Lanka, New Zealand and Brazil (1 each).
Outcomes All objectively measured health professional practice behaviours or patient outcomes.
There was wide variation in the outcome measures and number of outcomes measured. Median follow-up was 6 months (range 14 days to 2 years).
Date of most recent search: March 2006
Limitations:This is a well-conducted systematic review with only minor limitations.

Forsetlund L, Bjørndal A, Rashidian A, et al. Continuing education meetings and workshops. Cochrane Database of Systematic Reviews, 2009 Apr 15;(2):CD003030

Summary of findings

This review included 81 studies. Most studies were from Europe (34) and North America (32). Eleven studies were from low- and middle-income countries. There was substantial variation in the complexity of the targeted behaviours, baseline compliance, characteristics of the inverventions and results.

 

1) Educational meetings compared to no intervention

The authors categorised the studies according to whether the educational meetings were interactive or didactic, the intensity of the educational meetings, attendance at the meetings, the complexity of the targeted behaviour, the seriousness of the outcome, and the level of baseline compliance. The effect appeared to be larger with higher attendance at the educational meetings. Educational meetings did not appear to be effective for complex behaviours and they appeared to be less effective for less serious outcomes.

  • Educational meetings with or without other interventions probably improve compliance with desired practice and patient outcomes. The certainty of this evidence is moderate.

Certainty of the evidence

(GRADE)

Educational meetings with or without other interventions* compared to no intervention

People: Healthcare providers

Settings:  Primary and secondary care

Intervention: Educational meetings with or without other interventions

Comparison: No intervention

Outcomes

Adjusted absolute improvement (risk difference)† Median (Interquartile range)

Certainty of the evidence
(GRADE)

Compliance with desired practice

 Median 6% (1.8% to 15.9%)

Moderate

Patient outcomes

 Median 3% (0.1% to 4.0%)

Moderate

GRADE: GRADE Working Group grades of evidence (see above and last page)

*Several studies tested multifaceted interventions. The most commonly used co-interventions were reminders, patient education material, supportive services, feedback reports and educational outreach.

†The post intervention risk differences are adjusted for pre-intervention differences between the comparison groups.

 

2) Educational meetings alone compared to no intervention

  • Educational meetings alone probably improve compliance with desired practice and probably improve patient outcomes. The certainty of this evidence is moderate.

Educational meetings alone compared to no intervention

People:  Healthcare providers

Settings:  Primary and secondary care

Intervention: Educational meetings without other interventions

Comparison: No intervention

Outcomes

Adjusted absolute improvement (risk difference)*

Median (Interquartile range)

Certainty of the evidence
(GRADE)

Compliance with desired practice

 Median 6% (2.9 to 15.3)

Moderate

Patient outcomes

 Median 3% (-0.9% to 4.0%)

Moderate

GRADE: GRADE Working Group grades of evidence (see above and last page)

*The post intervention risk differences are adjusted for pre-intervention differences between the comparison groups.

 

 

3) Interactive educational meetings compared to didactic (lecture based) educational meetings

One trial that compared interactive educational meetings to didactic educational meetings was found that provided data. The aim of this study from Indonesia was to improve appropriate drug use in acute diarrhoea to prevent dehydration and death. Locally arranged interactive educational meetings were compared to didactic educational meetings arranged for all prescribers in a health district. A slightly larger improvement was reported for the group receiving interactive education (adjusted risk difference 1.4%).

The authors of the review categorised all the included studies according to whether the educational meetings were interactive or didactic and analysed the results to find out if this could explain the variations in effect among the studies. They found that interactive educational meetings alone were not consistently more effective than didactic educational meetings alone, but that interventions that they had categorised as mixed interactive and didactic educational meetings were more effective than either one alone.

  • Interactive educational meetings may be slightly more effective than lecture-based meetings.
  • Mixed interactive and didactic educational meetings may be more effective than only interactive or only didactic educational meetings. 

Relevance of the review for low-income countries

Findings Interpretation*
APPLICABILITY

The 81 included studies covered an extensive range of settings, targeted behaviours and interventions. Eleven of the trials were conducted in low- and middle-income countries.

Educational meetings alone or combined with other interventions generally result in small to moderate improvements. The findings of this review are likely applicable to low-income countries.

EQUITY

Overall, the included studies provided little data regarding differential effects of the interventions for disadvantaged populations.

Resources needed for educational meetings may be less available in disadvantaged settings. Thus, additional resources may be needed to deliver effective educational meetings in disadvantaged settings to reduce inequities.

ECONOMIC CONSIDERATIONS

The findings summarised here are based on randomized trials in which the levels of organization and support were potentially greater than those available outside of research settings.

The cost of educational meetings is likely to be highly variable and must be estimated based on specific local conditions outside research settings.

MONITORING & EVALUATION

There is evidence that educational meetings are effective in resource poor settings, but there is little evidence regarding the cost-effectiveness of educational meetings.

The impact and cost-effectiveness of educational meetings in resource-poor settings, with or without additional interventions, should be monitored using objective measures of professional practice when they are used as a means of improving the quality of care, to ensure that intended improvements in practice are achieved.

*Judgements made by the authors of this summary, not necessarily those of the review authors, based on the findings of the review and consultation with researchers and policymakers in low-income countries. For additional details about how these judgements were made see: http://www.support-collaboration.org/summaries/methods.htm

Additional information

Related literature

O'Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J. Continuing education meetings and workshops: effects on professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews 2001, Issue 1.

 

Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L et al. Changing provider behavior: An overview of systematic reviews of interventions. Medical Care 2001; 39:Supplement 2, II-2 - II-45.

 

Getting evidence into practice. Effective Health Care 1999; 5:(1). http://www.york.ac.uk/inst/crd/pdf/ehc51.pdf

 

Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay C, Vale L et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004; 8:(6). http://www.hta.nhs.uk/fullmono/mon806.pdf

 

NorthStar - how to design and evaluate quality improvement interventions in healthcare: NorthStar is a tool that provides a range of information, checklists, examples and tools based on current research on how to best design and evaluate quality improvement interventions. http://www.rebeqi.org/?pageID=36&ItemID=18

 

This summary was prepared by

Signe Flottorp, Norwegian Institute of Public Health, Oslo, Norway

Conflict of interest

None declared. For details, see: www.supportsummaries.org/coi

Acknowledgements

This summary has been peer reviewed by: Louise Forsetlund, Merrick Zwarenstein, Metin Gulmezoglu, Rukhsana Ghazi, and Hanna Bergman

This review should be cited as

Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, Davis DA, Odgaard-Jensen J, Oxman AD. Continuing education meetings and workshops. Cochrane Database of Systematic Reviews, 2009 Apr 15;(2):CD003030.

The summary should be cited as

Flottorp S. Do continuing education meetings and workshops for healthcare professionals improve professional practice and healthcare outcomes? A SUPPORT Summary of a systematic review. August 2016.  www.supportsummaries.org



Comments