Research

Effectiveness of BNT162b2, mRNA-1273, and ChAdOx1-S vaccines against severe covid-19 outcomes in a nationwide mass vaccination setting: cohort study

Abstract

Objective To estimate the effectiveness of the three covid-19 vaccines by Pfizer-BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford-AstraZeneca (ChAdOx1-S) in people after receiving two doses.

Design Cohort study.

Setting Nationwide, population based data in France, from the French National Health Data System (Système National des Données de Santé), between 27 December 2020 and 30 April 2021.

Participants Adults aged ≥50 years receiving a first dose of BNT162b2, mRNA-1273, or ChAdOx1-S were randomly selected (1:1) and matched on the date of vaccination with one unvaccinated control. Individuals were matched on year of birth, sex, region of residence, and residence in a nursing home (for individuals aged ≥75 years). All individuals were followed up until 20 August 2021.

Main outcome measures Primary outcome measure was vaccine effectiveness estimated at least 14 days after the second dose against covid-19 related hospital admission using Cox proportional hazards models adjusted for baseline characteristics and comorbidities. Vaccine effectiveness against covid-19 related death in hospital was also investigated.

Results 11 256 832 vaccinated individuals were included in the study (63.6% (n=7 161 658) with the BNT162b2 vaccine, 7.6% (n=856 599) with the mRNA-1273 vaccine, and 28.8% (n=3 238 575) with the ChAdOx1-S vaccine), along with 11 256 832 matched unvaccinated controls. During follow-up (up to 20 August 2021), 43 158 covid-19 related hospital admissions and 7957 covid-19 related deaths in hospital were registered. Compared with unvaccinated controls, vaccine effectiveness of two doses against covid-19 related hospital admission was 91% (95% confidence interval 91% to 92%), 95% (93% to 96%), and 91% (89% to 94%) for the BNT162b2, mRNA-1273, and ChAdOx1-S vaccines, respectively. Similar results were observed for vaccine effectiveness of two doses against covid-19 related deaths in hospital (BNT162b2, 91% (90% to 93%); mRNA-1273, 96% (92% to 98%); and ChAdOx1 nCoV-19, 88% (68% to 95%)). At 5-6 months after receiving the second dose of vaccine, effectiveness remained high at 94% (92% to 95%) for the BNT162b2 vaccine and 98% (93% to 100%) for the mRNA-1273 vaccine. Vaccine effectiveness of ChAdOx1-S estimated at 3-4 months was 90% (63% to 97%). All three vaccines remained effective at the time of circulation of the delta variant of SARS-CoV-2 between 1 July and 20 August 2021 (effectiveness between 89% and 95%).

Conclusions These findings provide evidence indicating that two doses of ChAdOx1-S is as effective as two doses of mRNA vaccines in France against the alpha and delta variants of SARS-CoV-2. The effectiveness of ChAdOx1-S should be further examined with a longer follow-up and in the light of the circulation of new SARS-CoV-2 variants of concern.

What is already known on this topic

  • Several observational studies have been published on the effectiveness of receiving two doses of BNT162b2 and mRNA-1273 vaccines against severe covid-19 outcomes, such as covid-19 related hospital admission or covid-19 related death in hospital

  • However, relatively little comparable data for the ChAdOx1-S vaccine are available, especially when compared with other mRNA vaccines in the same country

What this study adds

  • This matched cohort study, based on nationwide population based data in France, included more than 11 million vaccinated individuals aged 50 ≥years, of whom more than 3 million were vaccinated with the ChAdOx1-S vaccine

  • Compared with unvaccinated controls, risk reduction in people who received two vaccine doses was 91% for the ChAdOx1-S vaccine versus 91% and 95% for the BNT162b2 mRNA and mRNA-1273 vaccines, respectively

  • Effectiveness of ChAdOx1-S still reached 90% at 3-4 months following 2 weeks after the second dose of vaccine, and remained high (91%) at the time of circulation of the delta variant of SARS-CoV-2 in France; similar results were observed for the mRNA vaccines up to 5-6 months after the second dose

How this study might affect research, practice, or policy

  • These findings indicate that the BNT162b2 mRNA, mRNA-1273, and ChAdOx1-S vaccines were highly and equally effective against severe covid-19 outcomes after completing a two dose vaccination schedule

  • These results were valid at the time of the alpha and delta variants of SARS-CoV-2 circulation, but cannot be assumed to be entirely transferable to current or future dominant variants of SARS-CoV-2

Introduction

Since December 2020, health authorities facing a rapidly progressing pandemic caused by the highly transmissible SARS-CoV-2 have issued emergency use authorisation for three covid-19 vaccines. Authorisation was based on safety and efficacy data from randomised, placebo controlled, phase 3 trials. The three vaccines are BNT162b2 (Comirnaty by Pfizer-BioNTech),1 mRNA-1273 (Spikevax by Moderna),2 and ChAdOx1-S (Vaxzevria by AstraZeneca)3 4; their respective efficacy for preventing symptomatic covid-19 was 95%, 94%, and 70% (estimated at the time of circulation of the original strain of SARS-CoV-2).

In France, the mass vaccination campaign started on 27 December 2020, initially with the BNT162b2 and mRNA-1273 vaccines. Vaccine rollout proceeded in phases, starting with individuals who had the highest risk of being infected by SARS-CoV-2. Vaccination was prioritised first to healthcare workers, people living in nursing homes, and people aged ≥75 years, as well as individuals with severe or multiple chronic conditions.5 From February 2021, the vaccination was extended to people aged ≥50 years with comorbidities. The ChAdOx1-S vaccine was made available in France in February 2021; its use was restricted to individuals aged ≥55 years from 19 March 2021.6

A few months after the start of mass vaccination campaigns worldwide, several studies were conducted in real world settings and showed high levels of effectiveness of the BNT162b2,7–52 mRNA-1273,12–24 26 29 31 32 34 43 45 47–51 53 54 and ChAdOx1-S 36–40 42 43 46 48 50 52 55–58 vaccines against covid-19 infection or severe covid-19 disease. Vaccine effectiveness against covid-19 hospital admissions or death after full vaccination, defined as admission or death occurring seven or 14 days after the second dose of the mRNA vaccines (BNT162b2 and mRNA-1273), was estimated at 80% or more.7 9 23 25–27 30 31 34 44–48 50–54 However, reports on the effectiveness of two doses of ChAdOx1-S have been less frequent so far,42 43 46 48 50 52 55–58 mainly because of differences in the interval between the first and second doses (that is, about 12 weeks for ChAdOx1-S v four weeks for mRNA vaccines in France); a two dose vaccination schedule requires a much longer interval for ChAdOx1-S than for the mRNA vaccines. Additionally, availability and use of the ChAdOx1-S vaccine were relatively limited worldwide. We found 10 published studies examining its two dose vaccine effectiveness in vaccinated and unvaccinated individuals living in the following regions or countries: Scotland,42 57 England,46 Sweden,48 Hungary,43 Ontario (Canada),50 Colombia,52 Sao Paulo (Brazil),55 Argentina,58 and India.56 Among these studies, only two were conducted that included more than 300 000 individuals vaccinated with ChAdOx1-S and that were adequately adjusted for comorbidities; both were set up in the UK.46 57 Large observational studies from other countries are needed to back up the evidence.

In this cohort study, we estimated the effectiveness of the BNT162b2, mRNA-1273, and ChAdOx1-S vaccines against covid-19 related hospital admission or covid-19 related death in hospital by assessing results from different follow-up time intervals after receipt of the first and second doses. We assessed data for individuals aged ≥50 years from the French nationwide database.

Methods

Data source

This cohort study used data from the French National Health Data System (Système National des Données de Santé (SNDS), formerly known as SNIIRAM)).59 SNDS covers the entire population of France (67 million residents). Each person is identified anonymously by a unique, lifelong number. Since 2006, SNDS has recorded all reimbursement data for outpatient care including drugs, imaging, and laboratory tests; inpatient care (including diagnoses and procedures performed) from the national hospital discharge database (Programme de Médicalisation des Systèmes d’Information (PMSI)); and health expenditure for patients with long term diseases, such as cancer and diabetes, which is fully reimbursed in France. The SNDS has been extensively used to conduct real life pharmacoepidemiological studies, including those on the covid-19 pandemic.60–72 The SNDS also contains sociodemographic data and, when applicable, the date of death.

Information on hospital stays is routinely collected monthly in the PMSI. In April 2020, the French government encouraged hospitals to report all hospital stays related to covid-19 once a week or once a fortnight until July 2020 and then monthly through a fast track procedure (fast track PMSI). Our study was based on the fast track PMSI database available as of 12 October 2021. A cut-off discharge date of 20 August 2021 was chosen to ensure completeness of data over the study period.

Definitions of all variables used in this study were based on the International Classification of Diseases, 10th revision (ICD-10) codes for primary and secondary diagnosis; Common Classification of Medical Procedures codes for procedures; and Anatomical Therapeutic Chemical, French medication ID (code identifiant de presentation, or common unit of dispensation unité commune de dispensation) codes for drugs. We used algorithms developed by national health insurance employees in the Diseases and Healthcare Expenditure Mapping.71 73 These algorithms are detailed in online supplemental table 1.

Information on covid-19 vaccination status (ie, vaccine products and dates of first and second injections) was derived from the national information system on covid-19 vaccines VAC-SI (Système d’Information Vaccin covid-19) database. Information on SARS-CoV-2 test results (by reverse transcription polymerase chain reaction, antigen, or antibody) was derived from the national information system on SARS-CoV-2 tests (the Système d’Informations de DEPistage database). We linked all the extracted data required for this study to the SNDS using individuals’ unique and anonymous identifiers.

Study design and population

We conducted a matched cohort study. Participants were eligible if they received at least one healthcare reimbursement between 2018 and 2020 (reflecting recent healthcare use before the vaccine rollout) and were aged ≥50 years. All newly vaccinated people were matched on a 1:1 ratio to randomly selected unvaccinated controls. Matching criteria included age, sex, and region of residence, and residency in a nursing home for those individuals aged ≥75 years (three categories: no, yes without inpatient pharmacy, and yes with inpatient pharmacy). Newly vaccinated people were eligible for inclusion, even if they had previously been selected as a control. All included individuals were followed up from the date of their inclusion (as defined by the vaccination date of the vaccinated individual, both for the vaccinated and their matched counterpart in each pair) until the end of follow-up. Follow-up of the pair ended at the earliest instance of the following events: occurrence of an outcome of interest, death, vaccination of the unvaccinated control, or the end of the study period (20 August 2021). From this cohort, we separately examined the three subcohorts, BNT162b2 mRNA, mRNA-1273, and ChAdOx1-S vaccine groups, and their respective control group. Individuals who received two doses of vaccine within an interval of <15 days were excluded along with their matched controls.

Outcomes of interest

The primary outcome was covid-19 related hospital admission, defined on the basis of one of the following principal or secondary diagnosis discharge codes derived from the ICD-10 codes: U07.10 (covid-19, respiratory form, virus identified), U07.11 (covid-19, respiratory form, virus not identified), U07.14 (covid-19, other clinical forms, virus identified), U07.15 (covid-19, other clinical forms, virus not identified), U04.9 (severe acute respiratory syndrome, unspecified). The secondary outcome was death in hospital from covid-19.

Covariables

In addition to variables used for matching (ie, age, sex, region of residence, and nursing home status), information was made available on the following characteristics:

  • Social deprivation index categorised by quintiles as a marker of socioeconomic status based on the residence area’s median household income, percentage of high school graduates in the population aged ≥15 years, percentage of manual workers in the labour force, and unemployment in the individual’s city of residence

  • History of positive covid-19 status based on history of covid-19 related hospitalisation or positive SARS-CoV-2 infection test before inclusion date

  • History of influenza vaccination in 2018 or 2019

  • Presence of health conditions that were previously shown to be associated with severe covid-19 outcomes.71

These considered health conditions were: frailty, alcohol related conditions, cardiovascular risk factors (that is, smoking related conditions, hypertension, diabetes mellitus, dyslipidaemia, and obesity related conditions), cardiovascular diseases (that is, coronary heart disease, heart failure, cardiac rhythm disorder, valvular heart disease, occlusive peripheral arterial disease, stroke, and pulmonary embolism), chronic respiratory conditions, dialysis, having a transplanted kidney, liver failure, active cancer, depression, psychosis, dementia, epilepsy, Parkinson’s disease, inflammatory bowel disease, rheumatoid arthritis, and ankylosing spondylitis.

Statistical analysis

The categorical variables are reported as frequencies with percentages and the continuous variables reported as means with standard deviations. To report the balance in each individual covariable between vaccine and control groups, the difference in proportions for categorical variables and means for continuous variables is standardised (standardised means difference).74 The imbalance between the groups is defined as an absolute value greater than 0.10.74

We conducted Cox proportional hazards models that were systematically adjusted for matching variables to compare the incidence of outcomes of interest between the vaccinated and control groups. We ran two types of models: the first model adjusted for matching variables, and the second was model 1 but with further adjustment for all the baseline characteristics described in the Covariables section above. For all models, vaccine effectiveness was calculated as 1−hazard ratio (HR)×100; with the lower and upper limits of the confidence interval calculated as (1−HRUpper)×100 and(1−HRLower)×100, respectively.75

We considered seven follow-up time intervals to estimate the risk reduction over time: four after the receipt of the first dose (≥0, 0-6, 7-13, and 14-28 days for the BNT162b2 and mRNA-1273 vaccines or 14-84 days for the ChAdOx1-S vaccine) and three after the receipt of the second dose (≥0, ≥7, and ≥14 days). The primary outcome measure was vaccine effectiveness estimated ≥14 days after the second dose.

We conducted two sets of complementary analyses. Firstly, to study the duration of vaccine protection against the studied outcomes, we estimated vaccine effectiveness by monthly intervals starting 14 days after the second dose. Secondly, to examine vaccine protection at the time of the circulation of the delta variant (B.1.617.2) of SARS-CoV-2, we estimated vaccine effectiveness between 1 July and 20 August 2021. In France, the proportion of the delta variant increased from 55.4% on 1 July 2021 to 80.5% 10 days later; on 20 August, delta represented 95.2% of all monitored variants (online supplemental figure 1).

Subgroup analyses were undertaken by sex and age groups (age 50-64, 65-74, 75-84, ≥85 years) among vaccinated individuals (≥14 days after the second dose) and their unvaccinated controls. We used SAS Enterprise Guide version 4.3 software (SAS Institute, Cary, NC) for all our analyses.

Patient and public involvement

Patients and the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Results

From 27 December 2020 to 30 April 2021, 28 611 967 individuals aged ≥50 years were eligible to be enrolled into our study; the 1:1 matching procedure identified 11 256 832 people in the vaccinated group (7 161 658 (63.6%) individuals in the BNT162b2 group, 856 599 (7.6%) in the mRNA-1273 group, and 3 238 575 (28.8%) in the ChAdOx1-S group) and 11 256 832 in the unvaccinated group (table 1). Overall, 4 406 052 (39.1%) of unvaccinated controls were vaccinated during the inclusion period (figure 1). The median follow-up time from the first dose was 49 days (interquartile range 19-116) in the BNT162b2 vaccine group, 48 days (20-117) in the mRNA-1273 vaccine group, and 51 days (22-116) in the ChAdOx1-S vaccine group (table 2).

Table 1
|
Baseline characteristics of vaccinated individuals and matched unvaccinated controls, by covid-19 vaccine
Figure 1
Figure 1

Flowchart of participant inclusion. Matching criteria included age, sex, and region of residence, plus residency in a nursing home for those individuals aged ≥75 years. Date of inclusion was defined by the vaccination date of the first dose of the vaccinated individual, both for the vaccinated and matched controls in each pair. Matching procedure was performed on a daily basis. Individuals who were initially (matching procedure I) in the control group were eligible for inclusion in the exposure group when vaccinated during the inclusion period (matching procedure II). Follow-up of pairs ended at the earliest instance of the following events: occurrence of an outcome of interest, death, vaccination of unvaccinated controls, or the end of the study period (20 August 2021). *During matching procedure I, all individuals of the control group were unvaccinated (n=6 850 780). †In the matched unvaccinated group from matching procedure I (n=6 850 780), some individuals were vaccinated afterwards during the inclusion period (matching procedure II, n=4 406 052); they were eligible for inclusion in the vaccinated group. ‡All matched vaccinated individuals included those who were matched during matching procedure I (n=6 850 780) and those who were in the unvaccinated group from matching procedure I (n=6 850 780) who were vaccinated during matching procedure II (n=4 406 052; they were included twice in the study). §All matched unvaccinated individuals included those who were matched during matching procedure I (n=6 850 780) and those who were not matched during matching procedure I but were during matching procedure II (n=4 406 052)

Table 2
|
Vaccine effectiveness against covid-19 related hospital admission by follow-up time intervals and vaccine group

Regardless of vaccine product, vaccinated individuals versus unvaccinated individuals were less likely to be socially disadvantaged (proportions in the first group (least deprived) of the social deprivation index: 20.8% v 17.6% in the BNT162b2 cohort, 22.2% v 18.7% in the mRNA-1273 cohort, and 21.2% v 17.7% in the ChAdOx1-S cohort), less likely to be infected by SARS-CoV-2 before covid-19 vaccination (2.7% v 5.1% in the BNT162b2 cohort, 2.6% v 4.9% in the mRNA-1273 cohort, and 2.1% v 4.8% in the ChAdOx1-S cohort), and more likely to be vaccinated against influenza (42.6% v 29.5% in the BNT162b2 cohort, 40.6% v 27.2% in the mRNA-1273 cohort, and 28.0% v 15.5% in the ChAdOx1-S cohort; table 1; online supplemental tables 2–4). Differences in comorbidities between the vaccinated group and unvaccinated group were small in the mRNA vaccine cohorts (absolute standardised difference <0.10). In the ChAdOx1-S cohort, vaccinated individuals were more likely than unvaccinated individuals to have hypertension (47.2% v 36.1%), diabetes (17.8% v 11.4%), dyslipidaemia (31.4% v 21.7%), and coronary heart disease (8.2% v 5.6%; online supplemental table 4). Furthermore, among vaccinated individuals, people given ChAdOx1-S differed from those who received the mRNA vaccines. They were younger (mean age of 65 years v ≥71), less likely to be women (49% v>57%), and less likely to live in a nursing home (0% v 2.2%); and more likely to have received influenza vaccines in the preceding years (28% v ≥40%), be frail (4% v ≥8%), and have a cardiac comorbidity (heart failure 1.5% v≥2.8%; cardiac rhythm disorder 4.3% v ≥7.2%; valvular heart disease 1.7% v ≥2.9%), or dementia 0.5% v ≥1.5%; table 1).

In the mRNA vaccine groups, 96% of individuals who initially received either BNT162b2 or mRNA-1273 vaccines received the same product for the second dose. Of those who initially had the ChAdOx1-S vaccine, 87% received the same vaccine (online supplemental table 5). The median interval between two doses was 28 days (interquartile range 27-29) for the BNT162b2 vaccine group, 28 days (28-29) for the mRNA-1273 vaccine group, and 77 days (69-84) for the ChAdOx1-S vaccine group. Among those who did not receive a second dose (n=413 402 (3.7%)), about half had a history of covid-19 infection (47% (123 552/264 414) in the BNT162b2 vaccine group, 50% (16 801/33 463) in the mRNA-1273 vaccine group, and 43% (49 583/115 153) in the ChAdOx1-S vaccine group).

During follow-up, when the alpha variant was dominant from January to June 2021 and by the delta variant from July to August 2021, 43 158 (33 209 in the unvaccinated group, 9949 in the vaccinated group) covid-19 related admissions to hospital and 7957 (6171 unvaccinated, 1786 vaccinated) covid-19 related deaths in hospital were recorded. Table 2 presents the effectiveness of the three study vaccines against covid-19 related hospital admission according to follow-up time intervals. Compared with unvaccinated groups, all vaccines reduced the risk of admission by ≥90% after receiving the second dose. From ≥14 days after the second dose, effectiveness reached 91% (95% confidence interval 91% to 92%) for the BNT162b2 vaccine, 95% (93% to 96%) for the mRNA-1273 vaccine, and 91% (89% to 94%) for the ChAdOx1-S vaccine. Similar results were observed in a sensitivity analysis performed after excluding individuals who received different vaccine products between the first and second doses and their matched controls (online supplemental table 6). Vaccine effectiveness against covid-19 related death in hospital (table 3) was 91% (90% to 93%) for the BNT162b2 vaccine, 96% (92% to 98%) for the mRNA-1273 vaccine, and 88% (68% to 95%) for the ChAdOx1-S vaccine.

Table 3
|
Vaccine effectiveness against covid-19 related death in hospital by follow-up time intervals and vaccine group

At 5-6 months following at least 14 days after the second dose, BNT162b2 and mRNA-1273 vaccines were still effective with risk reductions of 94% (92% to 95%) and of 98% (93% to 100%; table 4). Vaccine effectiveness of the ChAdOx1-S vaccine was measurable only at 3-4 months following at least 14 days after the second dose and reached 90% (63% to 97%).

Table 4
|
Vaccine effectiveness against covid-19 related hospital admission by follow-up duration starting 14 days after the second dose and vaccine group

Vaccine effectiveness at the time of the delta variant circulation is presented in table 5. All three vaccines remained highly effective during this period with risk reductions of 89% (87% to 90%) for BNT162b2, 95% (90% to 98%) for mRNA-1273, and of 91% (88% to 94%) for ChAdOx1-S.

Table 5
|
Vaccine effectiveness of two doses against covid-19 related hospital admission at the time of delta variant circulation in France between 1 July and 20 August 2021

Subgroup analyses show that mRNA vaccines were effective across all studied age categories with vaccine effectiveness of 90% or higher regardless of age (online supplemental table 7). By contrast, vaccine effectiveness of the ChAdOx1-Svaccine tended to decrease with age: 96% (93% to 98%) in individuals aged 50-64 years, 89% (83% to 92%) in those aged 65-74 years, and 80% (52% to 91%) in those aged 75-84 years. Vaccine effectiveness of the three vaccines was consistent in both sexes (online supplemental table 8).

Discussion

Principal findings

We did a cohort study in a nationwide mass vaccination setting of more than 11 million vaccinated people aged ≥50 years, matched with their unvaccinated controls. We found that all three vaccines (BNT162b2, mRNA-1273, and ChAdOx1 nCoV-19) decreased the risk of covid-19 related hospital admission by ≥90% after individuals received the two doses (estimated vaccine effectiveness 91% for BNT162b2, 95% for mRNA-1273, 91% for ChAdOx1 nCoV-19). We observed similar results when effectiveness was examined against covid-19 related death in hospital. Our results also suggest that the level of vaccine effectiveness remained higher than 90% at 5-6 months following at least 14 days after the receipt of the second dose for the mRNA vaccines (BNT162b2, mRNA-1273) and at 3-4 months for the ChAdOx1-S vaccine. Additionally, the effectiveness of the three vaccines appeared to be maintained against the delta variant. Furthermore, while mRNA vaccines appeared consistently effective across all age subgroups, ChAdOx1-S vaccine effectiveness tended to decrease in people aged ≥65 years compared with those aged 50-64 years.

Comparison with other studies

Our estimates of the two dose vaccine effectiveness of the mRNA vaccines against covid-19 related hospital admission or covid-19 related death in hospital are consistent with the 81.0% to 97.4% estimates reported in previously published studies based on different designs (test negative, case-control studies and cohort studies).7 9 22 25–27 29 31 34 35 42 44–54 Although estimates of the two dose vaccine effectiveness of ChAdOx1-S are less abundant, they were also similar to our results, ranging from 81.5% to 97.5%.42 43 46 48 50 52 55–58 Two reasons might explain the lack or delayed publication of results on the two dose vaccine effectiveness of the ChAdOx1-S vaccine. It had less worldwide use than the other vaccines and its interdose interval was long (≥12 weeks in the UK, where ChAdOx1-S was mainly used) compared with that of the mRNA vaccines (four weeks). These reasons might be due to restrictions in the ChAdOx1-S vaccine supply and the temporary loss of trust in this vaccine following reports of blood clots and one death after its use in March 2021.76 We found that the effectiveness of two doses of the ChAdOx1-S vaccine was similar to that of the mRNA vaccines. This finding, based on more than 3 million people vaccinated with the ChAdOx1 nCoV-19 vaccine, is reassuring.

Several studies have shown that the effectiveness of mRNA vaccines to protect against SARS-CoV-2 infection waned with time77 (eg, effectiveness fell from 88% (within the first month after full vaccination) to 47% (after about five months),25 78% to 17%,28 82% to 33%,45 84% to 69%,46 92% to 47%,48 88% to 68%,49 90% to 70%,51 and 94% to 80%53). However, these vaccines maintained better effectiveness against severe covid-19 than against SARS-CoV-2 infection. Two dose vaccine effectiveness varied from 87% (within the first month after full vaccination) to 88% (after five months),25 96.0% to 88.9%,28 96% to 80%,45 98.6% to 93.8%,46 89% to 64%,48 94% to 92%,49 92% to 81%,51 and 98% to 80%.53 We also found that the effectiveness of two doses of mRNA vaccines against severe covid-19 remained at a high level, from 90% for BNT162b2 and 92% for mRNA-1273 within the first month after the receipt of two doses to 94% for BNT162b2 and 98% for mRNA-1273 at 5-6 months after the receipt of two doses.

Owing to a long interdose interval for the ChAdOx1-S vaccine and its delayed use from February 2021 in France, we could not estimate its effectiveness at 5-6 months after the receipt of two doses. However, its effectiveness was estimated at 90% after 3-4 months versus 94% during the first month after full vaccination. In a study from England, researchers found a similar result to ours: from 96% effectiveness within the first month after the receipt of two doses to 90% after four months46; in two studies conducted in Sweden and Scotland, researchers found a larger decrease in vaccine effectiveness: 89% to 64%,48 and 84% to 64%,57 respectively. Effectiveness of all vaccine products with a longer follow-up still needs to be studied.

For some of the results, the confidence intervals for the ChAdOx1-S vaccine are much wider than for the mRNA vaccines it is being compared to. These wider confidence intervals could be explained by a systematically shorter follow-up time after the second dose, leaving less time to develop outcomes of interest. This shorter follow-up time was caused by a longer interdose interval for the ChAdOx1-S vaccine than for the mRNA vaccines.

Two dose vaccine effectiveness during the time of the circulation of the delta variant of SARS-CoV-2 was 89% for the BNT162b2 vaccine, 95% for the mRNA-1273 vaccine, and 91% for the ChAdOx1-S vaccine. A similar result was reported in published studies on these vaccines from different countries.25 45 46 50 51 53

We also observed that mRNA vaccines were highly effective (≥90%) across all studied age categories. However, the ChAdOx1-S vaccine’s effectiveness tended to decrease with age. Lower effectiveness (80%) among adults aged ≥75 years than among those aged ≤74 years might be due partly to a selection bias, because this vaccine was not formally recommended for this older portion of the population. Decreased vaccine effectiveness of ChAdOx1 nCoV-1958 and mRNA vaccines44 45 52 among older participants has also been observed elsewhere.

Strengths and limitations

This study had some limitations. Firstly, given the observational nature of the data, our study could have been affected by residual confounding owing to differences between vaccinated individuals and unvaccinated controls, especially in terms of healthcare seeking behaviour or risk of infection, which could have been affected by changes in public health policy or transmission dynamics during the study.78 To take into account these differences, each newly vaccinated person was matched on the day of the vaccination to an unvaccinated control of the same age, sex, region of residence, and nursing home status for individuals aged ≥75 years. Subsequently, we adjusted all analyses on history of influenza vaccine received during the previous two years before the covid-19 outbreak and for a varied range of comorbidities that were shown to be associated with covid-19 related hospital admission.71

Secondly, during the first week after the receipt of the first dose, a risk reduction was observed among vaccinated individuals, although such an early reduction could not be due to the effect of the vaccine. This effect might be explained by healthier or more health conscious people being more likely to be included in the vaccinated group, and by the temporary exclusion of the vaccination of individuals having symptoms suggestive of covid-19 in the unvaccinated group. Owing to the matching procedure, vaccinated and unvaccinated groups had a similar proportion of comorbidities except that vaccinated individuals were less likely to be socially disadvantaged, less likely to be infected by SARS-CoV-2 before vaccination, and more likely to be vaccinated against influenza than unvaccinated controls (online supplemental tables 2–4). We took into account observed differences by adjusting for these covariables and using specific outcomes related to covid-19 vaccines.79 However, residual healthy vaccinee bias could have overestimated vaccine effectiveness against severe covid-19.

Thirdly, our results could have been overestimated because vaccinated individuals were more likely to live in an environment surrounded by vaccinated individuals. Two studies have shown that individuals without SARS-CoV-2 immunity had at least 39% lower risk of infection as the number of immune family members increased.80 81 Finally, our study did not look at covid-19 vaccine effectiveness against non-severe covid-19 outcomes, such as asymptomatic or mild SARS-CoV-19 infections that did not lead to hospital admission.

SNDS, a claims database comprising of the population of France, has allowed us to comprehensively examine the effectiveness of three covid-19 vaccines in adults aged ≥50 years. This study also provides estimates of the effectiveness of two doses of the ChAdOx1-S vaccine at a national level in France, among the 3 million individuals who have received this vaccine. Our study population, derived from the general population, should limit the risk of selection bias.

Conclusions

This nationwide cohort study of more than 11 million vaccinated people matched with unvaccinated controls showed that the BNT162b2, mRNA-1273, and ChAdOx1-S vaccines were highly and equally effective against severe covid-19 outcomes after completing a two dose vaccination schedule. The level of effectiveness persisted at 5-6 months after the receipt of the second dose for mRNA vaccines, at 3-4 months after the second dose of the ChAdOx1-S vaccine, and at the time of the delta variant of SARS-CoV-2 circulation. These results from the study conducted between 27 December 2020 and 20 August 2021 cannot be assumed to be entirely transferable to the current or future dominant variants. The effectiveness of covid-19 vaccines should be carefully examined over a longer period and with regard to possible surges of new SARS-CoV-2 variants of concern.

Ethics approval

This research was authorised by the French Data Protection Agency (CNIL Commission Nationale de l’Informatique et des Libertés).