Research

Impact of work schedules of senior resident physicians on patient and resident physician safety: nationwide, prospective cohort study

Abstract

Objective To determine whether long weekly work hours and shifts of extended duration (≥24 hours) are associated with adverse patient and physician safety outcomes in more senior resident physicians (postgraduate year 2 and above; PGY2+).

Design Nationwide, prospective cohort study.

Setting United States, conducted over eight academic years (2002-07, 2014-17).

Participants 4826 PGY2+ resident physicians who completed 38 702 monthly web based reports of their work hours and patient and resident safety outcomes.

Main outcome measures Patient safety outcomes included medical errors, preventable adverse events, and fatal preventable adverse events. Resident physician health and safety outcomes included motor vehicle crashes, near miss crashes, occupational exposures to potentially contaminated blood or other bodily fluids, percutaneous injuries, and attentional failures. Data were analysed with mixed effects regression models that accounted for dependence of repeated measures and controlled for potential confounders.

Results Working more than 48 hours per week was associated with an increased risk of self-reported medical errors, preventable adverse events, and fatal preventable adverse events as well as near miss crashes, occupational exposures, percutaneous injuries, and attentional failures (all P<0.001). Working between 60 and 70 hours per week was associated with a more than twice the risk of a medical error (odds ratio 2.36, 95% confidence interval 2.01 to 2.78) and almost three times the risk of preventable adverse events (2.93, 2.04 to 4.23) and fatal preventable adverse events (2.75, 1.23 to 6.12). Working one or more shifts of extended duration in a month while averaging no more than 80 weekly work hours was associated with an 84% increased risk of medical errors (1.84, 1.66 to 2.03), a 51% increased risk of preventable adverse events (1.51, 1.20 to 1.90), and an 85% increased risk of fatal preventable adverse events (1.85, 1.05 to 3.26). Similarly, working one or more shifts of extended duration in a month while averaging no more than 80 weekly work hours also increased the risk of near miss crashes (1.47, 1.32 to 1.63) and occupational exposures (1.17, 1.02 to 1.33).

Conclusions These results indicate that exceeding 48 weekly work hours or working shifts of extended duration endangers even experienced (ie, PGY2+) resident physicians and their patients. These data suggest that regulatory bodies in the US and elsewhere should consider lowering weekly work hour limits, as the European Union has done, and eliminating shifts of extended duration to protect the more than 150 000 physicians training in the US and their patients.

What is already known on this topic

  • Long work weeks and shifts of extended duration (≥24 hours) are associated with increased risks to physician safety and adverse patient safety outcomes

  • However, most studies have focused on resident physicians during postgraduate year (PGY) 1 (ie, interns)

What this study adds

  • When more experienced resident physicians (PGY2 and above) worked long weekly hours and shifts of extended duration, risks to them and their patients were similar in magnitude to the risks previously reported for PGY1 resident physicians

How this study might affect research, practice, or policy

  • These results could prompt policy makers in many countries, including the US Accreditation Council for Graduate Medical Education, and organisations that employ resident physicians to re-examine work hour limitations and to consider restrictions closer to those implemented through the European Working Time Directive

Introduction

Long work weeks and shifts of extended duration (≥24 hours) have been a cornerstone of medical education in the US, and in much of the world, for more than 100 years. Given the concerns of sleep researchers, the government, the general public, and physicians themselves regarding these schedules, reformed work hour guidelines have been attempted.

The first nationwide workhour guidelines in the United States, implemented by the Accreditation Council for Graduate Medical Education (ACGME) went into effect in 2003, allowing all resident physicians to work 80-88 hours and multiple shifts of extended duration per week. In 2007, the Institute of Medicine of the National Academies—a multidisciplinary body of experts from across fields that is now known as the National Academy of Medicine—was commissioned to evaluate the safety of this policy. After studying this issue for over a year, they concluded that it was unsafe for any resident physician to work for more than 16 consecutive hours without sleep.1 Consequently, the ACGME issued new work hour guidelines that went into effect on 1 July 2011, limiting resident physicians in their first postgraduate year (ie, interns; PGY1) to work shifts of 16 hours or less. However, contrary to the advice of the National Academy of Medicine, the ACGME endorsed extended duration work shifts of up to 28 consecutive hours for more senior resident physicians (ie, in their second postgraduate year and beyond (PGY2+)); 80 hour work weeks were continued for all resident physicians.2 In its impact statement, the ACGME Task Force on Quality Care and Professionalism explained: “Residents who have completed the PGY 1 year have greater preparation and increased knowledge and are therefore better prepared to make decisions and care for patients during prolonged shifts,”1 although no data suggest that people who are more experienced on a task (eg, truck driving) are less vulnerable to the impact of sleep deprivation. Nonetheless, few data have directly evaluated the effects of work hours on patient and resident safety among PGY2+ resident physicians (ie, physicians who have more than one year of postgraduate clinical training after having completed medical school, equivalent to junior doctors in foundational year 2 and above under the Modernising Medical Careers scheme in the United Kingdom).

To resolve this knowledge gap, we investigated the association between long work weeks and work shifts of extended duration in PGY2+ resident physicians and patient safety outcomes (medical errors, adverse events, patient deaths) as well as resident physician health and safety outcomes (motor vehicle crashes, near miss crashes, occupational exposures to potentially contaminated blood or other body fluids, percutaneous injuries, attentional failures).

Methods

We conducted a nationwide prospective cohort study of resident physicians in the US for eight academic years (2002-07 and 2014-17). All study procedures were approved by the Partners Human Research Committee and a certificate of confidentiality was issued by the US Centers for Disease Control and Prevention.

Data collection

With assistance from the Association of American Medical Colleges, US medical school graduates and individuals who matched to a US residency programme from 2002 to 2006 were invited by email to participate in an online study. Similarly, from 2014 to 2016, all medical school graduates who completed an application through the Electronic Residency Application Service were invited by email to participate in the study. The invitation directed potential participants to the study website where information about the study, excluding the study hypotheses, was provided.

Those individuals who chose to enrol in the study completed an electronic consent form and provided an email address where they wanted to receive their monthly surveys. Throughout the course of the study, they had the opportunity to update their email address (eg, change from a school email address to a hospital or personal email address). At the end of each academic year, participants were invited to continue their participation into their next year of residency. On enrolment, each participant was given a unique ID enabling the linking of the surveys completed by that individual throughout the course of their participation. After their first year of participation in the study, resident physicians were invited to continue their participation as more senior resident physicians. Nominal incentives (eg, $30 (£25.05; €28.39) for completing five monthly surveys) were provided as well as randomly drawn cash prizes.

In June of each year, unique individual links were sent via email to resident physicians who consented to participate in the study. The baseline survey collected information, on personal characteristics, including age, gender, height, weight, medical history, and specialty programme. Monthly reports collected work hour information, including total hours of work, frequency of shifts of extended duration (≥24 hours), hours engaged in patient care, and additional work related to their residency programme, using previously validated methodology.3 Hours of sleep at work and away from work were reported. In a separate section of the report, participants reported important medical errors in the past month and any patient outcomes resulting from errors. Errors resulting in patient harm were considered preventable adverse events. Participants also reported on the frequency of adverse health and safety outcomes, including motor vehicle crashes and near miss crashes. The instrument used to collect information on motor vehicle crashes has been previously validated.3 We also collected information on the frequency of occupational exposures to potentially contaminated blood or other bodily fluid and queried how many times participants nodded off or fell asleep (attentional failures) during inappropriate times (eg, surgery; rounds with attending physicians; while talking to or examining patients; and in lectures, seminars, and grand rounds). See online supplemental materials 1 for survey questions.

Statistical analysis

Given that the major components of the ACGME work hour guidelines did not differ substantially for PGY2+ resident physicians in our 2002-07 and 2014-17 study cohorts (ie, 80-88 hour work week limit, 28-30 consecutive work hour limit, including time for transitions; minimum four days off per month), we pooled the responses for our analyses, although we controlled for cohort and other potentially confounding factors in multivariable analyses. We excluded months when participants reported ≥14 work-free days (vacation months), and when work hour information was missing or reported to exceed 168 hours of work per week. Weekly work hours were calculated as the sum of the number of hours spent physically awake in the hospital, classes, or workplace, plus the number of hours asleep in the hospital.

We examined the association among weekly work hours, shifts of extended duration, and adverse health and safety outcomes. The incidence of adverse health and safety outcomes were calculated. We tested the significance of the calculated incidence rate ratios using likelihood ratio tests in log-linear models. Sensitivity analyses used Pearson and deviance based, scaled Poisson models that accounted for overdispersion, obtaining similar results. We dichotomised rare outcomes to reflect the presence or absence of at least one outcome during the month, and estimated the risk of each outcome using generalised linear models with a binomial distribution and log-link function. Basic models for clinical outcomes were adjusted for reported hours of patient care that month. We identified potentially confounding variables a priori based on relevance to the research question and biological plausibility. Fully adjusted multivariable models controlled for age, gender, specialty programme, cohort, and an age imputation indicator variable. Analyses stratified by cohort are presented in online supplemental tables S1A and S1B.

For clinical outcomes (medical errors, preventable adverse events, medical errors resulting in patient death, occupational exposures, and percutaneous injuries), we also controlled for the hours of patient care reported that month. Mixed effects models were used to examine shifts of extended duration or weekly work hours as the independent variable of interest, with a random intercept for participant to control for the dependence between repeated measures. We conducted analyses with weekly work hours as a continuous variable and separately as a categorical variable with hours grouped into categories to inform policy decisions. Missing data for age (total 205 participants, 1561 person months (4% of months)) were imputed with the median age of the participant cohort, and a binary variable was created to indicate that age was imputed for that participant’s observations (age imputation indicator variable).4 We did sensitivity analyses with and without accounting for missing data to guide the final models presented (online supplemental tables S4A-C, figure S1).

Categorical analyses used ≤48 hours as a referent because it is the European Working Time Directive's limit. We chose additional, reasonable cut-off points (60, 70, and 80 h/week) that had sufficiently distributed data and that could be analysed and reasonably translated to meaningful policy. Further, because the ACGME limit on work weeks is 80 hours, extended routinely to 88 hours, we dichotomised the analysis (>80 v ≤80 hours), to evaluate the risks associated with working above the limit.

Motor vehicle crash models were limited to participants who reported a valid driver’s license and who also reported driving to or from work. We limited medical error and occupational exposure models to months in which participants reported hours in patient care. SAS (version 9.4, SAS Institute, Cary, NC) was used for statistical analysis. All tests were two sided and P<0.05 was considered significant.

Patient and public involvement

We have worked extensively with public stakeholders, patient advocates, and resident physician advocacy organisations in our work on the effects of sleep deficiency on patient safety. We plan to widely disseminate the results to relevant patient and public communities, including organisations such as the Committee for Interns and Residents, Patient Safety Action Network, Agency for Healthcare Research and Quality, ACGME, National Academy of Medicine, and Royal College of Physicians. We will also post the results to the study website.

Results

We collected 14 173 responses from 1747 PGY2+ resident physicians from 2002 to 2007, and 24 529 responses from 3079 PGY2+ resident physicians from 2015 to 2017 (figure 1). Nearly three quarters of PGY1 resident physicians who provided informed consent contributed monthly reports (73% and 74% cooperation rates in the 2002-07 and 2015-17 cohorts, respectively). Of these PGY1 physicians, more than one third continued participation into their more senior years of residency (35% and 43% retention rates in the 2002-07 and 2015-17 cohorts, respectively). More than half (54%) of study participants were female and mean age was 29.7 (standard deviation 3.4 years). Resident physicians from a diverse array of specialties participated in the study. The most prevalent specialty was internal medicine (24%; table 1), similar to national prevalence.5

Figure 1
Figure 1

Participation of resident physicians in study. PGY1=resident physicians in the first year of training after medical school graduation; PGY2+=resident physicians at postgraduate year 2 and above. *278 individuals did not participate as PGY1 resident physicians. †35 individuals did not participate as PGY1 resident physicians

Table 1
|
Baseline characteristics of participants

An average of 324.6 (standard deviation 196.0) reports per month were completed by PGY2+ resident physicians. Each resident completed an average of eight reports (standard deviation 6) . Mean weekly work hours were 60.0 (standard deviation 16.1; table 2). Overall, 29 560 (76.4%) weeks exceeded 48 hours, 18 073 (46.7%) exceeded 60 hours, and 3734 (9.7%) exceeded 80 hours. Beyond those hours, 1024 (21%) resident physicians reported moonlighting; among those who did moonlight, the overall mean hours spent moonlighting were 0.60 (standard deviation 2.6) per week. Resident physicians reported working a mean of 1.6 (standard deviation 2.6) shifts of extended duration per month. Although daily sleep duration averaged 6.9 (standard deviation 1.0), resident physicians on shifts of extended duration reported obtaining a mean of only 2.5 hours (standard deviation 1.8) of sleep. Resident physicians reported obtaining no sleep on 14% of shifts of extended duration (table 2).

Table 2
|
Hours of work and sleep recorded among 38 702 study months

Serious medical errors and preventable adverse events

30.5% (1453/4764) of PGY2+ resident physicians reported at least one medical error; 8.3% (397/4760) reported at least one preventable adverse event and 1.8% (85/4760) reported at least one fatal preventable adverse event. Figure 2 illustrates the relation between weekly work hours and adverse outcomes when comparing each incremental increase in weekly work hours to the referent of ≤40 weekly work hours. In continuous analyses, the risk of medical error increased for all hours after 50 weekly work hours.

In categorical analyses, medical errors and preventable adverse events increased significantly in a linear manner when weekly work exceeded 48 hours (table 3). Fatal adverse events also increased significantly when weekly work exceeded 60 hours. Working between 60 and 70 hours per week was associated with a more than twice the risk of reporting a medical error (odds ratio 2.36, 2.01 to 2.78, P<0.001) and almost three times the risk of preventable adverse events (2.93, 2.04 to 4.23, P<0.001) and fatal preventable adverse events (2.75, 1.23 to 6.12, P<0.001; table 3). When comparing categories of weekly work hours, the odds of reporting a medical error, a preventable adverse event, and a fatal adverse event increased roughly fourfold when weekly hours exceeded 80 (4.01, 3.32 to 4.84; 3.84, 2.51 to 5.87; and 3.67, 1.45 to 9.30; respectively; table 3). Working one shift of extended duration in a month while averaging no more than 80 weekly work hours was associated with an increased risk of reporting medical errors (1.84, 1.66 to 2.03), preventable adverse events (1.51, 1.20 to 1.90), and fatal preventable adverse events (1.85, 1.05 to 3.26) compared with working no shifts of extended duration (table 4). Incidence rates are presented in online supplemental tables S2 and S3.

Table 3
|
Adjusted association between increasing weekly work hours and adverse health and safety outcomes among PGY2+ resident physicians
Figure 2
Figure 2

Continuous analysis of adverse safety outcomes among study participants. All models are adjusted for age, gender, specialty, and cohort; medical errors and adverse events are further adjusted for hours in patient care. Estimates for near miss crashes and attentional failures are incidence rate ratios (95% confidence intervals); all other estimates are odds ratios (95% confidence intervals). Crashes=motor vehicle crashes. Referent group is ≤40 hours/week. An odds ratio of 1 is indicated by a horizontal black line; estimates crossing 1 do not differ significantly from the referent group (≤40 hours/week)

Table 4
|
Adjusted association between weekly work hours, shifts of extended duration, and adverse health and safety outcomes among PGY2+ resident physicians

Motor vehicle crashes and near miss crashes

Of 580 motor vehicle crashes reported, 213 (36.7%) occurred on the commute from work. Compared with working fewer than 80 hours per week, when PGY2+ resident physicians worked 80 hours or more per week, we saw an 86% increase in the risk of a crash on the commute from work and a 99% increase in the incidence of near miss crashes (table 4). Working a shift of extended duration and 80 hours per week further increased the risk of any crash and a crash on the commute from work (odds ratios 1.44 (95% confidence interval 1.08 to 1.93) and 2.67 (1.78 to 4.01), respectively; table 4). In categorical analysis, we saw a dose dependent increase in reported near miss crashes as weekly work hours increased above 48 hours, with the incidence more than doubled with 70 or more weekly work hours (between >70 and ≤80 work hours/week, incidence rate ratio 2.11, 95% confidence interval 1.81 to 2.46; table 3). Working one or more shifts of extended duration while averaging no more than 80 hours per week in a month significantly increased the near miss crash risk (incidence rate ratio 1.47, 95% confidence interval 1.32 to 1.63, P<0.001, table 4). The combination of more weekly work hours (>80) and shifts of extended duration further increased the risk of a near miss crash (incidence rate ratio 2.54, 95% confidence interval 2.19 to 2.94, P<0.001; table 4).

Occupational exposures and percutaneous injuries

Of 663 percutaneous injuries reported on monthly surveys, 631 (95%) reported to occupational health. We saw a significant dose dependent increase in the risk of occupational exposures and percutaneous injuries when weekly work hours increased beyond 48 hours (P<0.001; table 3). Working one or more shifts of extended duration in a month was associated with an increased risk of an occupational exposure (odds ratio 1.17, 95% confidence interval 1.02 to 1.33; P<0.05 and >0.001; table 4).

Attentional failures

Of 38 702 monthly reports, attentional failures while working were reported in 2972 (8%). About a quarter of PGY2+ resident physicians (24% (1160/4826)) reported at least one attentional failure. We saw a significant dose dependent increase in attentional failures as weekly work hours increased. PGY2+ resident physicians were almost two times more likely to fall asleep at inappropriate times when working more than 60 hours per week (incident rate ratio 1.80 (95% confidence interval 1.69 to 1.92), P<0.001; table 3) Working one or more shifts of extended duration in a month was associated with a 40% increased risk of attentional failures (1.40, 1.34 to 1.48, P<0.001; table 4).

Discussion

Principal findings

Senior resident physicians (PGY2+) work long weekly hours, with three quarters of work weeks including over 48 hours and nearly half exceeding 60 hours. PGY2+ resident physicians working more than 48 hours per week had a significantly increased risk of making a medical error and injuring a patient. The risk of a medical error resulting in death significantly increased when weekly work hours exceeded 60 hours. Additionally, work shifts of extended duration significantly increased risk to patient safety. Further, the combination of long weekly work hours and shifts of extended duration had a synergistic effect, amplifying the risks to patient safety. Importantly, motor vehicle crashes, near miss crashes, percutaneous injuries, and attentional failures showed similar patterns of worsening with long work weeks and work shifts of extended duration, suggesting that these two factors pose a danger not only to patients, but also to resident physicians. These increased risks associated with long weekly work hours and shifts of extended duration by PGY2+ resident physicians were similar in magnitude to the risks we previously reported in PGY1 resident physicians.6–8

Comparison of results with previous studies

Our results are consistent with and build on previous literature, providing multispecialty, US wide data for experienced (PGY2+) resident physicians. A previous US report found an increased risk of medical errors resulting in adverse patient outcomes for first and second year resident physicians who worked more than 80 weekly hours.9

Data from the UK have also shown a relation between work hours and patient safety. A large retrospective review showed no increase in mortality, average length of stay, or readmission rate in regions of England that were adherent to the 48 hour weekly work limit, as compared with other regions of the country that had not yet implemented that limit.10 A similar large trial in the US found that the change in hospital level mortality was not inferior as defined by the investigators (a difference of more than 1% in absolute mortality rate between the groups), although mortality was substantially higher when restrictions to PGY1 resident physicians' work hours were temporarily lifted compared with programmes that maintained work hour restrictions.11–13

Further, in a clinical trial reviewing medical records of more than 1700 admissions of 19 resident physicians, there were approximately a third fewer medical errors when residents worked fewer than 48 hours per week had about a third fewer medical errors than those who worked fewer 56 work hour limit per week.14 Although the number of adverse events has fallen in the past decade, their frequency remains unacceptable.15 Based on estimates during a month in 2018, 25% of Medicare patients in hospital experience harm.16

Strengths and limitations of the study

Strengths of our study included its wide geographical representation and cross specialty make up, its focus on PGY2+ resident physicians, an understudied group, and the consistent findings of dose-response associations observed among long work weeks, shifts of extended duration, and important health and safety outcomes.

Our study had several limitations. Despite the large amount of monthly data collected from resident physicians across specialties and geographical regions, and the similarity of our cohort to that of the US national resident population,5 those who chose to participate had specific interest in work hours, thus raising the potential of participation bias. However, potential participants were not informed of the specific study hypotheses. Although response bias is always possible in survey studies, we deliberately chose a shorter, consistent monthly time frame and the questions relating to our independent variables and primary outcome measures were distributed among questions regarding secondary outcome measures such as sleep, caffeine use, and physical activity.

Further, questionnaire data rely on self-reports. Questions regarding work hours, motor vehicle crashes, and percutaneous injuries were previously validated.3 7 Although patient safety data were not independently validated and the definition of what incidents constituted a important error or adverse patient outcome might have varied from participant to participant, it is unlikely to have varied within each participant between survey months. Additionally, the consistency of the results when the outcome of the error resulted in a death—a tragic but unambiguous outcome—provides a common metric of severity. Voluntary self-report can also contribute to missingness. We imputed observations with missing age using the median value for each cohort. This imputation was necessary for 4% of the observations. The pattern of missingness was characterised as missing at random. We did not perform multiple imputation because of the lack of data to inform a multiple imputation approach, limited variability of age in the sample, and the minimal effect of varied approaches on results. Results of sensitivity analyses using only complete information and analyses that omitted age from the models were similar to analyses using single imputation (online supplemental tables S4A-C, figure S1). Although self-reported outcomes have inherent limitations, they also have advantages: resident reported outcomes reflect a more proximal, direct connection between resident individual performance under a discrete set of working conditions and outcomes, compared with studies looking at hospital-wide outcomes of systemic interventions that are downstream of resident physicians and subject to confounding due to concurrent safety interventions and other factors.11 13 Moreover, perceived medical errors that result in an injury or death to a patient under the care of a resident physician, which can only be derived from self-reports, have been associated with adverse mental health outcomes.17

Policy implications

Although long work hours have remained part of the cultural norm for resident physicians in the US, the general public does not approve of them. In a nationally representative sample, 81% of participants indicated that patients should be informed if a treating resident physician had been working for 24 or more hours, and 80% would want a different doctor.18

The World Health Organization and International Labour Organization recognise that working more than 55 hours per week is an occupational risk factor.19 Other countries have successfully limited work hours of physicians in training.20 21 The European Working Time Directive led to junior doctors in the UK being restricted to 56 weekly hours in 2004, which was further reduced to 48 hours per week (averaged over 26 weeks) in 2009. The shorter work weeks were associated with a maintenance or improvement in patient safety.10 14 Despite an opt-out clause that allows for additional work, European Working Time Directive rules include a minimum of 11 hours of rest every 24 hours, one day off each week, and four weeks of annual leave. By contrast, over the past two decades, the US’s policy on shifts of extended duration has vacillated, particularly for PGY1 resident physicians. Current ACGME policy allows for 28 hour shifts and 80-88 hour work weeks for all resident physicians, fundamentally unchanged from 2003. Our data reveal that PGY2+ resident physicians are just as vulnerable to the impact of long work weeks and work shifts of extended duration as PGY1 resident physicians, supporting the notion that clinical experience and advanced training do not mitigate their effects. Policies consistent with the European Working Time Directive’s limits for all physicians could potentially mitigate these risks and could be extended to other healthcare workers and all those in safety sensitive occupations.

As efforts are made to safely reduce work hours, it is important to recognise that patient and resident safety is multifactorial. The ROSTERS trial recently found that increased workload likely confounded efforts to implement a safer work schedule.22 Schedule design is also critical, as attempts to reduce consecutive working hours can result in other undesirable changes such as increased consecutive night shifts, reduced number of hours off between work shifts, or unfavourable rotation schemes. Additional research is required to study the interaction between shift duration, weekly work hours, workload, handoffs, and teamwork in order to craft appropriate policies and operationally effective schedules to minimise risks to patients and resident physicians. Creative solutions, such as the use of physician extenders in intensive healthcare settings, and best methods to sway the cultural norms might need to be explored.

Conclusions

We found that the current ACGME work hour guidelines could pose considerable hazards to patients and resident physicians. Other nations have been successful in providing patient care with more limited work hours for physicians in training. Resident physicians throughout the European Union are limited by the European Working Time Directive to 48 hours of work per week.20 The province of Quebec in Canada limits physicians in training to shifts no longer than 16 consecutive hours; New Zealand has imposed such limits for more than 30 years.21 Our data suggest that lower work hour limitations would reduce risks for PGY2+ resident physicians and their patients in the US, although workload and other factors will need to be concurrently investigated as efforts are made to implement safer work schedules.

Ethics approval

This study involves human participants and was approved by Partners Human Research Committee (2002-P-000202). Participants gave informed consent to participate in the study before taking part.