Information de reference pour ce titreAccession Number: | 00005407-200709050-00021.
|
Author: | Baernstein, Amy MD; Liss, Hillary K. MD; Carney, Patricia A. PhD; Elmore, Joann G. MD, MPH
|
Institution: | Division of General Internal Medicine (Drs Baernstein, Liss, and Elmore) and Department of Obstetrics and Gynecology (Dr Liss), University of Washington School of Medicine, and Department of Epidemiology, University of Washington School of Public Health and Community Medicine (Dr Elmore), Seattle; and Departments of Family Medicine and Public Health and Preventive Medicine, Oregon Health and Science University, Portland (Dr Carney).
|
Title: | |
Source: | JAMA. 298(9):1038-1045, September 5, 2007.
|
Abstract: | Context: Evidence-based medical education requires rigorous studies appraising educational efficacy.
Objectives: To assess trends over time in methods used to evaluate undergraduate medical education interventions and to identify whether participation of medical education departments or centers is associated with more rigorous methods.
Data Sources: The PubMed, Cochrane Controlled Trials Registry, Campbell Collaboration, and ERIC databases (January 1966-March 2007) were searched using terms equivalent to students, medical and education, medical crossed with all relevant study designs.
Study Selection: We selected publications in all languages from every fifth year, plus the most recent 12 months, that evaluated an educational intervention for undergraduate medical students. Four hundred seventy-two publications met criteria for review.
Data Extraction: Data were abstracted on number of participants; types of comparison groups; whether outcomes assessed were objective, subjective, and/or validated; timing of outcome assessments; funding; and participation of medical education departments and centers. Ten percent of publications were independently abstracted by 2 authors to assess validity of the data abstraction.
Results: The annual number of publications increased over time from 1 (1969-1970) to 147 (2006-2007). In the most recent year, there was a mean of 145 medical student participants; 9 (6%) recruited participants from multiple institutions; 80 (54%) used comparison groups; 37 (25%) used randomized control groups; 91 (62%) had objective outcomes; 23 (16%) had validated outcomes; 35 (24%) assessed an outcome more than 1 month later; 21 (14%) estimated statistical power; and 66 (45%) reported funding. In 2006-2007, medical education department or center participation, reported in 46 (31%) of the recent publications, was associated only with enrolling more medical student participants (P = .04); for all studies from 1969 to 2007, it was associated only with measuring an objective outcome (P = .048). Between 1969 and 2007, the percentage of publications reporting statistical power and funding increased; percentages did not change for other study features.
Conclusions: The annual number of published studies of undergraduate medical education interventions demonstrating methodological rigor has been increasing. However, considerable opportunities for improvement remain.
Copyright 2007 by the American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use. American Medical Association, 515 N. State St, Chicago, IL 60610.
|
Author Keywords: | Education, Medical, Undergraduate; Program Evaluation; Research; Students, Medical.
|
References: | 1. Evidence-Based Medicine Working Group. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA 1992; 268(17):2420-2425.
2. van der Vleuten CP, Dolmans DH, Scherpbier A. The need for evidence in education. Med Teach 2000; 22(3):246-250.
3. Hutchinson L. Evaluating and researching the effectiveness of educational interventions. BMJ 1999; 318(7193):1267-1269.
4. Harden RM, Grant J, Buckley G, Hart IR. Best evidence medical education-BEME guide No. 1. Med Teach 1999; 21(6):553-562.
5. Issenberg SB, McGaghie W, Petrusa E, Lee Gordon D, Scalese R. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005; 27(1):10-28.
6. Price EG, Beach MC, Gary TL, et al. A systematic review of the methodological rigor of studies evaluating cultural competence training of health professionals. Acad Med 2005; 80(6):578-586.
7. Chen FM, Bauchner H, Burstin H. A call for outcomes research in medical education. Acad Med 2004; 79(10):955-960.
8. Lurie SJ. Raising the passing grade for studies of medical education. JAMA 2003; 290(9):1210-1212.
9. Murray E. Challenges in educational research. Med Educ 2002; 36(2):110-112.
10. Reed D, Price EG, Windish DM, et al. Challenges in systematic reviews of educational intervention studies. Ann Intern Med 2005; 142(12 pt 2):1080-1089.
11. Shea JA, Arnold L, Mann KVA. RIME perspective on the quality and relevance of current and future medical education research. Acad Med 2004; 79(10):931-938.
12. Prystowsky JB, Bordage G. An outcomes research perspective on medical education: the predominance of trainee assessment and satisfaction. Med Educ 2001; 35(4):331-336.
13. Dornan T, Littlewood S, Margolis SA, Scherpbier A, Spencer J, Ypinazar V. How can experience in clinical and community settings contribute to early medical education? a BEME systematic review. Med Teach 2006; 28(1):3-18.
14. Letterie GS. Medical education as a science: the quality of evidence for computer-assisted instruction. Am J Obstet Gynecol 2003; 188(3):849-853.
15. Ogrinc G, Mutha S, Irby DM. Evidence for longitudinal ambulatory care rotations: a review of the literature. Acad Med 2002; 77(7):688-693.
16. Carline JD. Funding medical education research: opportunities and issues. Acad Med 2004; 79(10):918-924.
17. Reed DA, Kern DE, Levine RB, Wright SM. Costs and funding for published medical education research. JAMA 2005; 294(9):1052-1057.
18. Wolf FM. Methodological quality, evidence, and research in medical education (RIME). Acad Med 2004; 79(10)(suppl):S68-S69.
19. Bordage G, Caelleigh AS, Steinecke A; Joint Task Force of Academic Medicine and GEA-RIME Committee. Review criteria for research manuscripts. Acad Med 2001; 76(9):897-978.
20. Green ML. Identifying, appraising, and implementing medical education curricula: a guide for medical educators. Ann Intern Med 2001; 135(10):889-896.
21. Kirkpatrick DL. Evaluation of training. In: Craig RL, Bittel LR, eds. Training and Development Handbook. New York, NY: McGraw-Hill; 1967:87-112.
22. Cohen J. Statistical Power Analyses for the Behavioral Sciences. 2nd ed. New York, NY: Academic Press Inc; 1988:235.
23. Jekel J, Elmore J, Katz D. Epidemiology, Biostatistics and Preventative Medicine. 2nd ed. Philadelphia, PA: Harcourt Health Sciences; 2001:114.
24. Davis MH, Karunathilake I, Harden RM. AMEE education guide No. 28: the development and role of departments of medical education. Med Teach 2005; 27(8):665-675.
25. van der Vleuten CP, Dolmans DH, de Grave WS, et al. Education research at the Faculty of Medicine, University of Maastricht: fostering the interrelationship between professional and education practice. Acad Med 2004; 79(10):990-996.
26. Wartman SA. Revisiting the idea of a national center for health professions education research. Acad Med 2004; 79(10):910-917.
27. Carney PA, Nierenberg DW, Pipas CF, Brooks WB, Stukel TA, Keller AM. Educational epidemiology: applying population-based design and analytic approaches to study medical education. JAMA 2004; 292(9):1044-1050.
28. Glick TH. Evidence-guided education: patients' outcome data should influence our teaching priorities. Acad Med 2005; 80(2):147-151.
29. Whitcomb ME. Using clinical outcomes data to reform medical education. Acad Med 2005; 80(2):117.
30. Okuda N, Okamura T, Kadowaki T, Tanaka T, Ueshima H. Weight-control intervention in overweight subjects at high risk of cardiovascular disease: a trial of a public health practical training program in a medical school. Nippon Koshu Eisei Zasshi 2004; 51(7):552-560.
31. Williams RL, Reid S, Myeni C, Pitt L, Solarsh G. Practical skills and valued community outcomes: the next step in community-based education. Med Educ 1999; 33(10):730-737.
32. Litzelman DK, Cottingham AH. The new formal competency-based curriculum and informal curriculum at Indiana University School of Medicine: overview and five-year analysis. Acad Med 2007; 82(4):410-421.
33. O'Connor Grochowski C, Halperin EC, Buckley EG. A curricular model for the training of physician scientists: the evolution of the Duke University School of Medicine curriculum. Acad Med 2007; 82(4):375-382.
34. Loeser H, O'Sullivan P, Irby DM. Leadership lessons from curricular change at the University of California, San Francisco, School of Medicine. Acad Med 2007; 82(4):324-330.
35. Goldstein EA, Maclaren CF, Smith S, et al. Promoting fundamental clinical skills: a competency-based college approach at the University of Washington. Acad Med 2005; 80(5):423-433.
36. Neville AJ, Norman GR. PBL in the undergraduate MD program at McMaster University: three iterations in three decades. Acad Med 2007; 82(4):370-374.
37. Peters AS, Greenberger-Rosovsky R, Crowder C, Block SD, Moore GT. Long-term outcomes of the New Pathway Program at Harvard Medical School: a randomized controlled trial. Acad Med 2000; 75(5):470-479.
38. Hoffman K, Hosokawa M, Blake R Jr, Headrick L, Johnson G. Problem-based learning outcomes: ten years of experience at the University of Missouri-Columbia School of Medicine. Acad Med 2006; 81(7):617-625.
39. Shin JH, Haynes RB, Johnston ME. Effect of problem-based, self-directed undergraduate education on life-long learning. CMAJ 1993; 148(6):969-976.
40. Tolnai S. Continuing medical education and career choice among graduates of problem-based and traditional curricula. Med Educ 1991; 25(5):414-420.
41. Tolnai S. Lifelong learning habits of physicians trained at an innovative medical school and a more traditional one. Acad Med 1991; 66(7):425-426.
42. Schmidt HG, Vermeulen L, van der Molen HT. Longterm effects of problem-based learning: a comparison of competencies acquired by graduates of a problem-based and a conventional medical school. Med Educ 2006; 40(6):562-567.
43. Mennin SP, Kalishman S, Friedman M, Pathak D, Snyder J. A survey of graduates in practice from the University of New Mexico's conventional and community-oriented, problem-based tracks. Acad Med 1996; 71(10):1079-1089.
44. Santos-Gomez L, Kalishman S, Rezler A, Skipper B, Mennin SP. Residency performance of graduates from a problem-based and a conventional curriculum. Med Educ 1990; 24(4):366-375.
45. Prideaux D. Researching the outcomes of educational interventions: a matter of design: RTCs have important limitations in evaluating educational interventions. BMJ 2002; 324(7330):126-127.
46. Drescher U, Warren F, Norton K. Towards evidence-based practice in medical training: making evaluations more meaningful. Med Educ 2004; 38(12):1288-1294.
47. Torgerson CJ. Educational research and randomised trials. Med Educ 2002; 36(11):1002-1003.
48. Norman GR, Schmidt HG. Effectiveness of problem-based learning curricula: theory, practice and paper darts. Med Educ 2000; 34(9):721-728.
49. Britten N. Making sense of qualitative research: a new series. Med Educ 2005; 39(1):5-6.
50. Kelly M, Murphy A. An evaluation of the cost of designing, delivering and assessing an undergraduate communication skills module. Med Teach 2004; 26(7):610-614.
51. Education Group for Guidelines on Evaluation. Guidelines for evaluating papers on educational interventions. BMJ 1999; 318(7193):1265-1267.
|
Language: | English.
|
Document Type: | Review.
|
Journal Subset: | Clinical Medicine.
|
ISSN: | 0098-7484
|
NLM Journal Code: | 7501160
|
Annotation(s) | |
|
|