The New England Journal of Medicine

Numéro : Volume 360(5), 29 January 2009, p 491-499
Copyright : Copyright (C) 2009 Massachusetts Medical Society. All rights reserved.
Type de publication : [Special Article]
DOI : 10.1056/NEJMsa0810119
ISSN : 0028-4793
Accès : 00006024-200901290-00008

A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population

Haynes, Alex B. M.D., M.P.H.; Weiser, Thomas G. M.D., M.P.H.; Berry, William R. M.D., M.P.H.; Lipsitz, Stuart R. Sc.D.; Breizat, Abdel-Hadi S. M.D., Ph.D.; Dellinger, Patchen E. M.D.; Herbosa, Teodoro M.D.; Joseph, Sudhir M.S.; Kibatala, Pascience L. M.D.; Lapitan, Marie Carmela M. M.D.; Merry, Alan F. M.B., Ch.B., F.A.N.Z.C.A., F.R.C.A.; Moorthy, Krishna M.D., F.R.C.S.; Reznick, Richard K. M.D., M.Ed.; Taylor, Bryce M.D.; Gawande, Atul A. M.D., M.P.H.; the Safe Surgery Saves Lives Study Group
Informations sur l'auteur
From the Harvard School of Public Health (A.B.H., T.G.W., W.R.B., A.A.G.), Massachusetts General Hospital (A.B.H.), and Brigham and Women's Hospital (S.R.L., A.A.G.) - all in Boston; University of California-Davis, Sacramento (T.G.W.); Prince Hamzah Hospital, Ministry of Health, Amman, Jordan (A.-H.S.B.); University of Washington, Seattle (E.P.D.); College of Medicine, University of the Philippines, Manila (T.H.); St. Stephen's Hospital, New Delhi, India (S.J.); St. Francis Designated District Hospital, Ifakara, Tanzania (P.L.K.); National Institute of Health-University of the Philippines, Manila (M.C.M.L.); University of Auckland and Auckland City Hospital, Auckland, New Zealand (A.F.M.); Imperial College Healthcare National Health Service Trust, London (K.M.); and University Health Network, University of Toronto, Toronto (R.K.R., B.T.). Address reprint requests to Dr. Gawande at the Department of Surgery, Brigham and Women's Hospital, 75 Francis St., Boston, MA 02115, or at [email protected].
*Members of the Safe Surgery Saves Lives Study Group are listed in the Appendix.
This article (10.1056/NEJMsa0810119) was published at NEJM.org on January 14, 2009.
Supported by grants from the World Health Organization.
No potential conflict of interest relevant to this article was reported.

Abstract

Background: Surgery has become an integral part of global health care, with an estimated 234 million operations performed yearly. Surgical complications are common and often preventable. We hypothesized that a program to implement a 19-item surgical safety checklist designed to improve team communication and consistency of care would reduce complications and deaths associated with surgery.

Methods: Between October 2007 and September 2008, eight hospitals in eight cities (Toronto, Canada; New Delhi, India; Amman, Jordan; Auckland, New Zealand; Manila, Philippines; Ifakara, Tanzania; London, England; and Seattle, WA) representing a variety of economic circumstances and diverse populations of patients participated in the World Health Organization's Safe Surgery Saves Lives program. We prospectively collected data on clinical processes and outcomes from 3733 consecutively enrolled patients 16 years of age or older who were undergoing noncardiac surgery. We subsequently collected data on 3955 consecutively enrolled patients after the introduction of the Surgical Safety Checklist. The primary end point was the rate of complications, including death, during hospitalization within the first 30 days after the operation.

Results: The rate of death was 1.5% before the checklist was introduced and declined to 0.8% afterward (P=0.003). Inpatient complications occurred in 11.0% of patients at baseline and in 7.0% after introduction of the checklist (P<0.001).

Conclusions: Implementation of the checklist was associated with concomitant reductions in the rates of death and complications among patients at least 16 years of age who were undergoing noncardiac surgery in a diverse group of hospitals.



Surgical care is an integral part of health care throughout the world, with an estimated 234 million operations performed annually.1 This yearly volume now exceeds that of childbirth.2 Surgery is performed in every community: wealthy and poor, rural and urban, and in all regions. The World Bank reported that in 2002, an estimated 164 million disability-adjusted life-years, representing 11% of the entire disease burden, were attributable to surgically treatable conditions.3 Although surgical care can prevent loss of life or limb, it is also associated with a considerable risk of complications and death. The risk of complications is poorly characterized in many parts of the world, but studies in industrialized countries have shown a perioperative rate of death from inpatient surgery of 0.4 to 0.8% and a rate of major complications of 3 to 17%.45 These rates are likely to be much higher in developing countries.6789 Thus, surgical care and its attendant complications represent a substantial burden of disease worthy of attention from the public health community worldwide.

Data suggest that at least half of all surgical complications are avoidable.45 Previous efforts to implement practices designed to reduce surgical-site infections or anesthesia-related mishaps have been shown to reduce complications significantly.101112 A growing body of evidence also links teamwork in surgery to improved outcomes, with high-functioning teams achieving significantly reduced rates of adverse events.1314

In 2008, the World Health Organization (WHO) published guidelines identifying multiple recommended practices to ensure the safety of surgical patients worldwide.15 On the basis of these guidelines, we designed a 19-item checklist intended to be globally applicable and to reduce the rate of major surgical complications (Table 1). (For the formatted checklist, see the Supplementary Appendix, available with the full text of this article at NEJM.org.) We hypothesized that implementation of this checklist and the associated culture changes it signified would reduce the rates of death and major complications after surgery in diverse settings.

Table 1 Table 1 Opens a popup window Opens a popup window Opens a popup window

Methods

Study Design

We conducted a prospective study of preintervention and postintervention periods at the eight hospitals participating as pilot sites in the Safe Surgery Saves Lives program (Table 2). These institutions were selected on the basis of their geographic distribution within WHO regions, with the goal of representing a diverse set of socioeconomic environments in which surgery is performed. Table 3 lists surgical safety policies in place at each institution before the study. We required that a coinvestigator at each site lead the project locally and that the hospital administration support the intervention. A local data collector was chosen at each site and trained by the four primary investigators in the identification and reporting of process measures and complications. This person worked on the study full-time and did not have clinical responsibilities at the study site. Each hospital identified between one and four operating rooms to serve as study rooms. Patients who were 16 years of age or older and were undergoing noncardiac surgery in those rooms were consecutively enrolled in the study. The human subjects committees of the Harvard School of Public Health, the WHO, and each participating hospital approved the study and waived the requirement for written informed consent from patients.

Table 2 Table 2 Opens a popup window Table 3 Table 3 Opens a popup window Opens a popup window

Intervention

The intervention involved a two-step checklist-implementation program. After collecting baseline data, each local investigator was given information about areas of identified deficiencies and was then asked to implement the 19-item WHO safe-surgery checklist (Table 1) to improve practices within the institution. The checklist consists of an oral confirmation by surgical teams of the completion of the basic steps for ensuring safe delivery of anesthesia, prophylaxis against infection, effective teamwork, and other essential practices in surgery. It is used at three critical junctures in care: before anesthesia is administered, immediately before incision, and before the patient is taken out of the operating room. The checklist was translated into local language when appropriate and was adjusted to fit into the flow of care at each institution. The local study team introduced the checklist to operating-room staff, using lectures, written materials, or direct guidance. The primary investigators also participated in the training by distributing a recorded video to the study sites, participating in a teleconference with each local study team, and making a visit to each site. The checklist was introduced to the study rooms over a period of 1 week to 1 month. Data collection resumed during the first week of checklist use.

Data Collection

We obtained data on each operation from standardized data sheets completed by the local data collectors or the clinical teams involved in surgical care. The data collectors received training and supervision from the primary investigators in the identification and classification of complications and process measures. Perioperative data included the demographic characteristics of patients, procedural data, type of anesthetic used, and safety data. Data collectors followed patients prospectively until discharge or for 30 days, whichever came first, for death and complications. Outcomes were identified through chart monitoring and communication with clinical staff. Completed data forms were stripped of direct identifiers of patients and transmitted to the primary investigators. We aimed to collect data on 500 consecutively enrolled patients at each site within a period of less than 3 months for each of the two phases of the study. At the three sites at which this goal could not be achieved, the period of data collection was extended for up to 3 additional months to allow for accrual of a sufficient number of patients. The sample size was calculated to detect a 20% reduction in complications after the checklist was implemented, with a statistical power of 80% and an alpha value of 0.05.

Outcomes

The primary end point was the occurrence of any major complication, including death, during the period of postoperative hospitalization, up to 30 days. Complications were defined as they are in the American College of Surgeons' National Surgical Quality Improvement Program 17: acute renal failure, bleeding requiring the transfusion of 4 or more units of red cells within the first 72 hours after surgery, cardiac arrest requiring cardiopulmonary resuscitation, coma of 24 hours' duration or more, deep-vein thrombosis, myocardial infarction, unplanned intubation, ventilator use for 48 hours or more, pneumonia, pulmonary embolism, stroke, major disruption of wound, infection of surgical site, sepsis, septic shock, the systemic inflammatory response syndrome, unplanned return to the operating room, vascular graft failure, and death. Urinary tract infection was not considered a major complication. A group of physician reviewers determined, by consensus, whether postoperative events reported as "other complications" qualified as major complications, using the Clavien classification for guidance.18

We assessed adherence to a subgroup of six safety measures as an indicator of process adherence. The six measures were the objective evaluation and documentation of the status of the patient's airway before administration of the anesthetic; the use of pulse oximetry at the time of initiation of anesthesia; the presence of at least two peripheral intravenous catheters or a central venous catheter before incision in cases involving an estimated blood loss of 500 ml or more; the administration of prophylactic antibiotics within 60 minutes before incision except in the case of preexisting infection, a procedure not involving incision, or a contaminated operative field; oral confirmation, immediately before incision, of the identity of the patient, the operative site, and the procedure to be performed; and completion of a sponge count at the end of the procedure, if an incision was made. We recorded whether all six of these safety measures were taken for each patient.

Statistical Analysis

Statistical analyses were performed with the use of the SAS statistical software package, version 9.1 (SAS Institute). To minimize the effect of differences in the numbers of patients at each site, we standardized the rates of various end points to reflect the proportion of patients from each site. These standardized rates were used to compute the frequencies of performance of specified safety measures, major complications, and death at each site before and after implementation of the checklist.19 We used logistic-regression analysis to calculate two-sided P values for each comparison, with site as a fixed effect. We used generalized-estimating-equation methods to test for any effect of clustering according to site.

We performed additional analyses to test the robustness of our findings, including logistic-regression analyses in which the presence or absence of a data collector in the operating room and the case mix were added as variables. We classified cases as orthopedic, thoracic, nonobstetric abdominopelvic, obstetric, vascular, endoscopic, or other. To determine whether the effect of the checklist at any one site dominated the results, we performed cross-validation by sequentially removing each site from the analysis. Finally, we disaggregated the sites on the basis of whether they were located in high-income or low- or middle-income countries and repeated our analysis of primary end points. All reported P values are two-sided, and no adjustments were made for multiple comparisons.

Results

We enrolled 3733 patients during the baseline period and 3955 patients after implementation of the checklist. Table 4 lists characteristics of the patients and their distribution among the sites; there were no significant differences between the patients in the two phases of the study.

Table 4 Table 4 Opens a popup window Opens a popup window Opens a popup window

The rate of any complication at all sites dropped from 11.0% at baseline to 7.0% after introduction of the checklist (P<0.001); the total in-hospital rate of death dropped from 1.5% to 0.8% (P=0.003) (Table 5). The overall rates of surgical-site infection and unplanned reoperation also declined significantly (P<0.001 and P=0.047, respectively). Operative data were collected by the local data collector through direct observation for 37.5% of patients and by unobserved clinical teams for the remainder. Neither the presence nor absence of a direct observer nor changes in case mix affected the significance of the changes in the rate of complications (P<0.001 for both alternative models) or the rate of death (P=0.003 with the presence or absence of direct observation included and P=0.002 with case-mix variables included). Rates of complication fell from 10.3% before the introduction of the checklist to 7.1% after its introduction among high-income sites (P<0.001) and from 11.7% to 6.8% among lower-income sites (P<0.001). The rate of death was reduced from 0.9% before checklist introduction to 0.6% afterward at high-income sites (P=0.18) and from 2.1% to 1.0% at lower-income sites (P=0.006), although only the latter difference was significant. In the cross-validation analysis, the effect of the checklist intervention on the rate of death or complications remained significant after the removal of any site from the model (P<0.05). We also found no change in the significance of the effect on the basis of clustering (P=0.003 for the rate of death and P=0.001 for the rate of complications).

Table 5 Table 5 Opens a popup window Opens a popup window Opens a popup window

Table 6 shows the changes in six measured processes at each site after introduction of the checklist. During the baseline period, all six measured safety indicators were performed for 34.2% of the patients, with an increase to 56.7% of patients after implementation of the checklist (P<0.001). At each site, implementation of the checklist also required routine performance of team introductions, briefings, and debriefings, but adherence rates could not be measured.

Table 6 Table 6 Opens a popup window Opens a popup window Opens a popup window

Discussion

Introduction of the WHO Surgical Safety Checklist into operating rooms in eight diverse hospitals was associated with marked improvements in surgical outcomes. Postoperative complication rates fell by 36% on average, and death rates fell by a similar amount. All sites had a reduction in the rate of major postoperative complications, with a significant reduction at three sites, one in a high-income location and two in lower-income locations. The reduction in complications was maintained when the analysis was adjusted for case-mix variables. In addition, although the effect of the intervention was stronger at some sites than at others, no single site was responsible for the overall effect, nor was the effect confined to high-income or low-income sites exclusively. The reduction in the rates of death and complications suggests that the checklist program can improve the safety of surgical patients in diverse clinical and economic environments.

Whereas the evidence of improvement in surgical outcomes is substantial and robust, the exact mechanism of improvement is less clear and most likely multifactorial. Use of the checklist involved both changes in systems and changes in the behavior of individual surgical teams. To implement the checklist, all sites had to introduce a formal pause in care during surgery for preoperative team introductions and briefings and postoperative debriefings, team practices that have previously been shown to be associated with improved safety processes and attitudes 142021 and with a rate of complications and death reduced by as much as 80%.13 The philosophy of ensuring the correct identity of the patient and site through preoperative site marking, oral confirmation in the operating room, and other measures proved to be new to most of the study hospitals.

In addition, institution of the checklist required changes in systems at three institutions, in order to change the location of administration of antibiotics. Checklist implementation encouraged the administration of antibiotics in the operating room rather than in the preoperative wards, where delays are frequent. The checklist provided additional oral confirmation of appropriate antibiotic use, increasing the adherence rate from 56 to 83%; this intervention alone has been shown to reduce the rate of surgical-site infection by 33 to 88%.22232425262728 Other potentially lifesaving measures were also more likely to be instituted, including an objective airway evaluation and use of pulse oximetry, though the change in these measures was less dramatic.15 Although the omission of individual steps was still frequent, overall adherence to the subgroup of six safety indicators increased by two thirds. The sum of these individual systemic and behavioral changes could account for the improvements observed.

Another mechanism, however, could be the Hawthorne effect, an improvement in performance due to subjects' knowledge of being observed.29 The contribution of the Hawthorne effect is difficult to disentangle in this study. The checklist is orally performed by peers and is intentionally designed to create a collective awareness among surgical teams about whether safety processes are being completed. However, our analysis does show that the presence of study personnel in the operating room was not responsible for the change in the rate of complications.

This study has several limitations. The design, involving a comparison of preintervention data with postintervention data and the consecutive recruitment of the two groups of patients from the same operating rooms at the same hospitals, was chosen because it was not possible to randomly assign the use of the checklist to specific operating rooms without significant cross-contamination. One danger of this design is confounding by secular trends. We therefore confined the duration of the study to less than 1 year, since a change in outcomes of the observed magnitude is unlikely to occur in such a short period as a result of secular trends alone. In addition, an evaluation of the American College of Surgeons' National Surgical Quality Improvement Program cohort in the United States during 2007 did not reveal a substantial change in the rate of death and complications (Ashley S. personal communication, http://acsnsqip.org). We also found no change in our study groups with regard to the rates of urgent cases, outpatient surgery, or use of general anesthetic, and we found that changes in the case mix had no effect on the significance of the outcomes. Other temporal effects, such as seasonal variation and the timing of surgical training periods, were mitigated, since the study sites are geographically mixed and have different cycles of surgical training. Therefore, it is unlikely that a temporal trend was responsible for the difference we observed between the two groups in this study.

Another limitation of the study is that data collection was restricted to inpatient complications. The effect of the intervention on outpatient complications is not known. This limitation is particularly relevant to patients undergoing outpatient procedures, for whom the collection of outcome data ceased on their discharge from the hospital on the day of the procedure, resulting in an underestimation of the rates of complications. In addition, data collectors were trained in the identification of complications and collection of complications data at the beginning of the study. There may have been a learning curve in the process of collecting the data. However, if this were the case, it is likely that increasing numbers of complications would be identified as the study progressed, which would bias the results in the direction of an underestimation of the effect.

One additional concern is how feasible the checklist intervention might be for other hospitals. Implementation proved neither costly nor lengthy. All sites were able to introduce the checklist over a period of 1 week to 1 month. Only two of the safety measures in the checklist entail the commitment of significant resources: use of pulse oximetry and use of prophylactic antibiotics. Both were available at all the sites, including the low-income sites, before the intervention, although their use was inconsistent.

Surgical complications are a considerable cause of death and disability around the world.3 They are devastating to patients, costly to health care systems, and often preventable, though their prevention typically requires a change in systems and individual behavior. In this study, a checklist-based program was associated with a significant decline in the rate of complications and death from surgery in a diverse group of institutions around the world. Applied on a global basis, this checklist program has the potential to prevent large numbers of deaths and disabling complications, although further study is needed to determine the precise mechanism and durability of the effect in specific settings.

Appendix

The members of the Safe Surgery Saves Lives Study Group were as follows: Amman, Jordan: A.S. Breizat, A.F. Awamleh, O.G. Sadieh; Auckland, New Zealand: A.F. Merry, S.J. Mitchell, V. Cochrane, A.-M. Wilkinson, J. Windsor, N. Robertson, N. Smith, W. Guthrie, V. Beavis; Ifakara, Tanzania: P. Kibatala, B. Jullu, R. Mayoka, M. Kasuga, W. Sawaki, N. Pak; London, England: A. Darzi, K. Moorthy, A. Vats, R. Davies, K. Nagpal, M. Sacks; Manila, Philippines: T. Herbosa, M.C.M. Lapitan, G. Herbosa, C. Meghrajani; New Delhi, India: S. Joseph, A. Kumar, H. Singh Chauhan; Seattle, Washington: E.P. Dellinger, K. Gerber; Toronto, Canada: R.K. Reznick, B. Taylor, A. Slater; Boston, Massachusetts: W.R. Berry, A.A. Gawande, A.B. Haynes, S.R. Lipsitz, T.G. Weiser; Geneva, Switzerland: L. Donaldson, G. Dziekan, P. Philip; Baltimore, Maryland: M. Makary; Ankara, Turkey: I. Sayek; Sydney, Australia: B. Barraclough.

References

1. Weiser TG, Regenbogen SE, Thompson KD, et al. An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet 2008;372:139-44. [Context Link]

2. Ronsmans C, Graham WJ. Maternal mortality: who, when, where, and why. Lancet 2006;368:1189-200. [Context Link]

3. Debas HT, Gosselin R, McCord C, Thind A. Surgery. In: Jamison DT, Breman JG, Measham AR, et al., eds. Disease control priorities in developing countries. 2nd ed. Disease Control Priorities Project. Washington, DC: International Bank for Reconstruction and Development/World Bank, 2006:1245-60. [Context Link]

4. Gawande AA, Thomas EJ, Zinner MJ, Brennan TA. The incidence and nature of surgical adverse events in Colorado and Utah in 1992. Surgery 1999;126:66-75. [Context Link]

5. Kable AK, Gibberd RW, Spigelman AD. Adverse events in surgical patients in Australia. Int J Qual Health Care 2002;14:269-76. Buy Now [Context Link]

6. Bickler SW, Sanno-Duanda B. Epidemiology of paediatric surgical admissions to a government referral hospital in the Gambia. Bull World Health Organ 2000;78:1330-6. Full Text [Context Link]

7. Yii MK, Ng KJ. Risk-adjusted surgical audit with the POSSUM scoring system in a developing country. Br J Surg 2002;89:110-3. [Context Link]

8. McConkey SJ. Case series of acute abdominal surgery in rural Sierra Leone. World J Surg 2002;26:509-13. [Context Link]

9. Ouro-Bang'na Maman AF, Tomta K, Ahouangbevi S, Chobli M. Deaths associated with anaesthesia in Togo, West Africa. Trop Doct 2005;35:220-2. [Context Link]

10. Dellinger EP, Hausmann SM, Bratzler DW, et al. Hospitals collaborate to decrease surgical site infections. Am J Surg 2005;190:9-15. [Context Link]

11. Classen DC, Evans RS, Pestotnik SL, Horn SD, Menlove RL, Burke JP. The timing of prophylactic administration of antibiotics and the risk of surgical-wound infection. N Engl J Med 1992;326:281-6. Ovid Full Text [Context Link]

12. Runciman WB. Iatrogenic harm and anaesthesia in Australia. Anaesth Intensive Care 2005;33:297-300. [Context Link]

13. Mazzocco K, Petitti DB, Fong KT, et al. Surgical team behaviors and patient outcomes. Am J Surg 2008 September 11 (Epub ahead of print). [Context Link]

14. Lingard L, Regehr G, Orser B, et al. Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch Surg 2008;143:12-8. Buy Now [Context Link]

15. World Alliance for Patient Safety. WHO guidelines for safe surgery. Geneva: World Health Organization, 2008. [Context Link]

16. World Bank. Data & statistics: country classification. (Accessed January 5, 2009, at http://go.worldbank.org/K2CKM78CC0.))

17. Khuri SF, Daley J, Henderson W, et al. The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care. J Am Coll Surg 1995;180:519-31. [Context Link]

18. Dindo D, Demartines N, Clavien PA. Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg 2004;240:205-13. Buy Now [Context Link]

19. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. 3rd ed. Hoboken, NJ: John Wiley, 2003. [Context Link]

20. Sexton JB, Makary MA, Tersigni AR, et al. Teamwork in the operating room: frontline perspectives among hospitals and operating room personnel. Anesthesiology 2006;105:877-84. Buy Now [Context Link]

21. Makary MA, Sexton JB, Freischlag JA, et al. Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder. J Am Coll Surg 2006;202:746-52. [Context Link]

22. Platt R, Zaleznik DF, Hopkins CC, et al. Perioperative antibiotic prophylaxis for herniorrhaphy and breast surgery. N Engl J Med 1990;322:153-60. Ovid Full Text [Context Link]

23. Austin TW, Coles JC, Burnett R, Goldbach M. Aortocoronary bypass procedures and sternotomy infections: a study of antistaphylococcal prophylaxis. Can J Surg 1980;23:483-5. [Context Link]

24. Baum ML, Anish DS, Chalmers TC, Sacks HS, Smith H Jr, Fagerstrom RM. A survey of clinical trials of antibiotic prophylaxis in colon surgery: evidence against further use of no-treatment controls. N Engl J Med 1981;305:795-9. Buy Now [Context Link]

25. Bernard HR, Cole WR. The prophylaxis of surgical infection: the effect of prophylactic antimicrobial drugs on the incidence of infection following potentially contaminated operations. Surgery 1964;56:151-7. [Context Link]

26. Hasselgren PO, Ivarsson L, Risberg B, Seeman T. Effects of prophylactic antibiotics in vascular surgery: a prospective, randomized, double-blind study. Ann Surg 1984;200:86-92. Buy Now [Context Link]

27. Barker FG II. Efficacy of prophylactic antibiotics for craniotomy: a meta-analysis. Neurosurgery 1994;35:484-92. Buy Now [Context Link]

28. Norden CW. Antibiotic prophylaxis in orthopedic surgery. Rev Infect Dis 1991;13:Suppl 10:S842-S846. [Context Link]

29. Mayo E. The human problems of an industrial civilization. New York: Macmillan, 1933. [Context Link]



Outils d'article