***** BMJ 2000;320:759-763 (18 March)
Clinical review
Reporting and preventing medical mishaps: lessons from non-medical near miss reporting systems
Paul Barach, clinical fellow, Stephen D Small, assistant anaesthetist.
Department of Anesthesia and Critical Care, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
Correspondence to: P Barach pbarach at etherdome.mgh.harvard.edu
Reducing mishaps from medical management is central to efforts to improve quality and lower costs in health care. Nearly 100 000 patients are estimated to die preventable deaths annually in hospitals in the United States, with many more incurring injuries at an annual cost of $9 billion. Underreporting of adverse events is estimated to range from 50%-96% annually.1-3 This annual toll exceeds the combined number of deaths and injuries from motor and air crashes, suicides, falls, poisonings, and drownings.4 Many stakeholders in health care have begun to work together to resolve the moral, scientific, legal, and practical dilemmas of medical mishaps. To achieve this goal, an environment fostering a rich reporting culture must be created to capture accurate and detailed data about nuances of care.
Outcomes in complex work depend on the integration of individual, team, technical, and organisational factors. 5 6 A continuum of cascade effects exists from apparently trivial incidents to near misses and full blown adverse events. 7 8 Consequently, the same patterns of causes of failure and their relations precede both adverse events and near misses. Only the presence or absence of recovery mechanisms determines the actual outcome.9 The National Research Council defines a safety "incident" as an event that, under slightly different circumstances, could have been an accident.10 Focusing on data for near misses may add noticeably more value to quality improvement than a sole focus on adverse events.
Schemes for reporting near misses, "close calls," or sentinel ("warning") events have been institutionalised in aviation,w1 w2 nuclear power technology,w3 w4 petrochemical processing, steelw5 production,w6 military operations, and air transportation.w7-w11 In health care, efforts are now being made to create incident reporting systems for medical near misses 8 11-15 to supplement the limited data available from mandatory reporting systems focused on preventable deaths and serious injuries.
There are, however, powerful disincentives to reporting.16-18 Management attitudes and institutional climate can greatly influence the success or failure of reporting efforts.19 Reason identifies four critical elements of an effective safety culture that is, a reporting, just, flexible, and learning culture.20 Can this model be validated in health care? Given the lack of a review that addresses these questions, we report our preliminary findings of a study of incident reporting systems for near misses in non-medical domains.
Summary points
Research studies have validated an epidemic of grossly underreported, preventable injuries due to medical management
Recent policy documents have placed high priority on improving incident reporting as the first step in addressing patient injuries, and have called for translation of lessons from other industries
Complex non-medical industries have evolved incident reporting systems that focus on near misses, provide incentives for voluntary reporting, ensure confidentiality while bolstering accountability, and emphasise perspectives of systems in data collection, analysis, and improvement
Reporting of near misses offers numerous benefits over adverse events: greater frequency allowing quantitative analysis; fewer barriers to data collection; limited liability; and recovery patterns that can be captured, studied, and used for improvement
Education and engagement of all stakeholders of health care and negotiation of their conflicting goals will be necessary to change the balance of barrier incentives in favour of implementing reporting systems....
...We collected numerous structural characteristics about incident reporting systems for non-medical events (table 1). Seven of the 12 systems were mandated and implemented by the federal government, with voluntary participation. Ten systems were confidential, the other two anonymous. All stimulated elaboration by narrative. (The aviation safety reporting system has saved all of its 500 000 reports in their entirety.) Most offered feedback to their respective communities. Some offered legal immunity to reporters as long as data were submitted promptly (up to 10 days after the event for the aviation safety reporting system; see appendix 2 on website).
We reduced these elements to several common threads characterising near miss reporting (box). Finally, we analysed the mix of barriers and incentives that ultimately govern the success of incident reporting systems (table 2).
Common conflicts in near miss reporting systems, with examples
Sacrificing accountability for information -- Negotiating moral hazards in choosing between good of society compared with needs of individuals Near miss data compared with accident data -- Near miss data plentiful, minimises hindsight bias, proactive, less costly, no indemnity A change in focus from errors and adverse events to recovery processes -- Recovery equals resilience; emphasis on successful recovery, which offers learning opportunity Trade offs between large aggregate national databases and regional systems -- National offers longer denominators, capture of rare events; regional offers potentially more specific feedback and local effectiveness Finding right mix of barriers and incentives -- Supporting needs of all stakeholders; ecological model Safety has up front, direct costs; payback is indirect -- Spending "hard" money to save larger sums and reduce quality waste Safety and respect for reporters as well as patients -- A just culture that acknowledges pervasiveness of hindsight bias and balances accountability needs of society The need for continuous timely feedback that reporters find relevant; changing bureaucratic culture -- Critical to sustain effort of ongoing reporting
...Comparison of near misses with adverse outcomes offers advantages: (a) near misses occur 3-300 times more often than adverse events, enabling quantitative analysis 7 14 21 ; (b) fewer barriers to data collection exist, allowing analysis of interrelations of small failures 22; (c) recovery strategies can be studied to enhance proactive interventions and to de-emphasise the culture of blame 5 20 23 ; and (d) hindsight bias is more effectively reduced. 24 25
The sum of barriers and incentives can be considered in terms of their impact on individuals, organisations, and society. Powerful disincentives to reporting depend on the organisational culture 26 and include extra work, scepticism, lack of trust, fear of reprisals, and lack of effectiveness of present reporting systems. Incentives to reporting included, in addition to confidentiality, that incident reporting systems should be prophylactic (provide some degree of immunity), philanthropic (reporters identify with injured patients and other healthcare providers that could benefit from data), and therapeutic (reporters learn from reporting about adverse events).24 Incentives for society included accountability, transparency, enhanced community relations, and sustaining trust and confidence in the healthcare system.
Examination of successful non-medical domains indicates that the following factors are important in determining the quality of incident reports and the success of incident reporting systems: immunity (as far as practical); confidentiality or data de-identification (making data untraceable to caregivers, patients, institutions, time); independent outsourcing of report collection and analysis by peer experts; rapid meaningful feedback to reporters and all interested parties; ease of reporting; and sustained leadership support.
Discussion
We aimed to provide an educational resource about incident reporting systems of near misses and related lessons on safety that are transferable from other industries. An organisation's interpretation of near misses influences how it collects information related to safety, and thus its capacity to prevent the recurrence of undesirable events.7 Tamuz emphasises that the use of broad ambiguous definitions of potential dangers aids discovery of risks that escape existing definitions 18 (see table on website). Concessions to reporters ultimately lead to discoveries, which enable focused improvements in training, organisation, management of work, and the design of systems.
In medicine there is a long tradition of examining past practice to understand how things might have been done differently.27 However, conferences on morbidity and mortality, grand rounds, and peer review all currently share the same shortcomings: a lack of human factors and thinking about systems; a narrow focus on individual performance to the exclusion of contributory team and larger social issues; hindsight bias; a tendency to search for errors as opposed to the myriad causes of error induction; and a lack of multidisciplinary integration into an organisation wide safety culture. The situation is akin to that of the field of injury control, where until there was focused public attention and demand for action on injuries and their prevention, injury remained a neglected health problem.28 Only recently, however, have the quality and patient safety movements brought this mindset to bear on all healthcare services.3
Near miss reporting We defined a near miss as any event that could have had adverse consequences but did not and was indistinguishable from fully fledged adverse events in all but outcome.23 Reporting systems are thought to have contributed importantly to low accident rates in industries with huge catastrophic potential by enabling managers to take a proactive, preventive approach. 13 19 Finally, near misses offer powerful reminders of system hazards and retard the process of forgetting to be afraid.7
Aviation reporting systems Investigation into public accidents and confidential near miss analyses have been complementary in the successful effort to improve air safety.24 After three decades, over 500 000 confidential near miss reports (currently over 30 000 yearly reports) have been logged by the aviation safety reporting system. Eligibility for limited immunity for non-criminal offences is a powerful incentive to report. Cracks in the framework of trust among stakeholders in aviation have been associated with noteable decreases in reporting.18
Risk management in aviation illustrates how organisations cooperate, by capturing near miss information to augment the sparse history of crashes and injuries.20 The decades long aviation effort to improve safety through system monitoring and feedback holds many important lessons for health care. Data from incident reporting systems on near misses have been effectively used to redesign aircraft, air traffic control systems, airports, and pilot training, and to reduce human error.18 An overarching lesson from 25 years of aviation experience is that methods for data collection and structures evolved to simultaneously maximise confidentiality, bidirectional information flow, and improvement in local processes.29...
Reporting participation: mandatory versus voluntary The analysis and evolution of reporting systems for non-medical near misses supports the contention that all reporting, to an extent, is voluntary. Clearly, both voluntary and mandatory approaches are required, each with its own benefits and limitations. Mature safety cultures are driven by forces external and internal to industries, and over time these forces nourish voluntarism and reporting of near misses. Furthermore, rapidly improving technology and information systems enable wider monitoring and public awareness of adverse outcomes in open systems.31 These developments diminish distinctions between mandatory and voluntary behaviour.32
Anonymous versus confidential provisions The most obvious way of ensuring confidentiality of the data and reporter is to have the reports filed anonymously. For example, excerpts from reports to the aviation safety reporting system are published anonymously in a weekly newsletter, Callback, with candid accounts of actions contributing to dangerous situations 20 (see appendix 3 on website). Reports in numerous medical incident reporting systems travel only one way, anonymously. 11 32 33 34
O'Leary and Chappell point out, however, that anonymity is not always possible or desirable.35 Analysts cannot contact reporters for more information; anonymous reports may be unreliable; and, in some situations, it is difficult to guarantee anonymity. Anonymity may also be criticised for its threat to accountability and transparency, both at variance with the ethics of professionalism.36 It may, however, be important to provide anonymity early in the evolution of an incident reporting system, at least until trust is built and reporters see practical results.
Medical reporting systems Health care has lagged behind other industries in implementing reporting systems and other initiatives related to safety. 1 3 20 In the past five years, however, there has been a concerted effort in this direction. Studies in anaesthesia,11 w5 w24 w25 emergency care,12 intensive care,32 w26 w27 transfusion medicine,15 cytology,w30 occupational and industrial medicine,w31 w32 cardiac surgery,w33 pharmacy,w34 and nursingw35; the Veterans Administration near miss incident reporting systemw36; and in medicine research into human factors 6 20 w9 w10 represent a critical mass of safety research.
A recent report from the Institute of Medicine, To Err is Human, strongly recommends complementary mandatory incident reporting systems and voluntary near miss reporting systems in health care.3 Experts in non-medical domains are quick to share anecdotes of dangers controlled by information from incident reporting systems. Many directors of reporting systems whom we interviewed believe that the debriefing process involved in confidential reporting of an incident brings closure, adds to long term recall, and supports behavioural change. The benefits of incident reporting systems in health care will be defined by a combination of: longitudinal observational studies of liability and injuries, ethnographic case studies, complex economic analyses, and strong face validity.
The barrier analysis How can we transform the current culture of blame and resistance to one of learning and increasing safety? Understanding the balance of barriers and incentives to reporting is the first step (table 2). It will be essential to introduce norms that inculcate a learning, non-punitive safety reporting culture in professional schools and graduate training programmes, with support from consumers, patient advocacy groups, regulators, and accreditors. Some trial and error learning will be necessary. Legal protection for reporters will need to be reinforced, as it has as been in Australia and New Zealand, where incident reporting systems have been successful in gaining acceptance and credibility.37
Cost benefit analysis Many high risk fields such as nuclear power technology, aviation, and petrochemical processing have shown that implementing incident reporting systems for near misses are essential because they benefit their organisations more than they cost. 7 30 38 w23 The system developed for petrochemical processing uses seven quality indicators to assess the effectiveness of reporting systems but highlights the fairness and the cost effectiveness. Directors of systems we interviewed believe that these systems not only reduce quality waste but are cost effective.39 This is similar to the worker safety climate, where companies that have had to embrace the safety rules of the occupational safety health administration have discovered the profit of a healthy workforce.40
Evidence based medicine and improvement in outcomes are accelerating the translation of lessons learned in other domains over the past decades.41 Studies of incident reporting systems for non-medical near misses hold promise for extending this trend and catalysing a shift in the healthcare culture from a punitive to a collaborative mindset that seeks to identify the underlying system failures.42
Conclusions Non-punitive, protected, voluntary incident reporting systems in high risk non-medical domains have grown to produce large amounts of essential process information unobtainable by other means. Non-medical incident reporting systems have evolved over the past three decades to emphasise near misses, in addition to adverse events, to encourage confidentiality over anonymity, and to move beyond traditional linear thinking about human error, to analyses of multiple causation at the level of systems.
For healthcare reporting systems there must be incentives to promote voluntary reporting completely, confidentially, and objectively. Reporting should be the right, easy, and safe policy for healthcare professionals. To maximise the usefulness of incident reporting systems there will be a need to balance accountability, system transparency, and protections for reporters. To ease the implementation of incident reporting systems, the community must be involved in system oversight, support, and advocacy. The top priority must be to design systems geared to preventing, detecting, and minimising effects of undesirable combinations of design, performance, and circumstance. Experience with non-medical incident reporting systems in aviation, nuclear power technology, and petrochemical processing, offer lessons applicable to the design of safety reporting systems in health care....
[Footnotes omitted; the full article is available at <http://www.bmj.com/cgi/content/full/320/7237/759?maxtoshow=&HITS=10&hits=10&RESULTFORMAT=&fulltext=punitive&searchid=QID_NOT_SET&stored_search=&FIRSTINDEX=>.] *****
Yoshie