Authors: Yinon M. Bar-On, M.Sc., Yair Goldberg, Ph.D., Micha Mandel, Ph.D., Omri Bodenheimer, M.Sc., Ofra Amir, Ph.D., Laurence Freedman, Ph.D., Sharon Alroy-Preis, M.D., Nachman Ash, M.D., Amit Huppert, Ph.D., and Ron Milo, Ph.D. April 5, 2022 DOI: 10.1056/NEJMoa2201570 NEW ENGLAND JOURNAL OF MEDICINE
Abstract
BACKGROUND
On January 2, 2022, Israel began administering a fourth dose of BNT162b2 vaccine to persons 60 years of age or older. Data are needed regarding the effect of the fourth dose on rates of confirmed severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection and of severe coronavirus disease 2019 (Covid-19).
METHODS
Using the Israeli Ministry of Health database, we extracted data on 1,252,331 persons who were 60 years of age or older and eligible for the fourth dose during a period in which the B.1.1.529 (omicron) variant of SARS-CoV-2 was predominant (January 10 through March 2, 2022). We estimated the rate of confirmed infection and severe Covid-19 as a function of time starting at 8 days after receipt of a fourth dose (four-dose groups) as compared with that among persons who had received only three doses (three-dose group) and among persons who had received a fourth dose 3 to 7 days earlier (internal control group). For the estimation of rates, we used quasi-Poisson regression with adjustment for age, sex, demographic group, and calendar day.
RESULTS
The number of cases of severe Covid-19 per 100,000 person-days (unadjusted rate) was 1.5 in the aggregated four-dose groups, 3.9 in the three-dose group, and 4.2 in the internal control group. In the quasi-Poisson analysis, the adjusted rate of severe Covid-19 in the fourth week after receipt of the fourth dose was lower than that in the three-dose group by a factor of 3.5 (95% confidence interval [CI], 2.7 to 4.6) and was lower than that in the internal control group by a factor of 2.3 (95% CI, 1.7 to 3.3). Protection against severe illness did not wane during the 6 weeks after receipt of the fourth dose. The number of cases of confirmed infection per 100,000 person-days (unadjusted rate) was 177 in the aggregated four-dose groups, 361 in the three-dose group, and 388 in the internal control group. In the quasi-Poisson analysis, the adjusted rate of confirmed infection in the fourth week after receipt of the fourth dose was lower than that in the three-dose group by a factor of 2.0 (95% CI, 1.9 to 2.1) and was lower than that in the internal control group by a factor of 1.8 (95% CI, 1.7 to 1.9). However, this protection waned in later weeks.
CONCLUSIONS
Rates of confirmed SARS-CoV-2 infection and severe Covid-19 were lower after a fourth dose of BNT162b2 vaccine than after only three doses. Protection against confirmed infection appeared short-lived, whereas protection against severe illness did not wane during the study period.
During late December 2021, with the emergence of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) B.1.1.529 (omicron) variant, the prevalence of confirmed infection rose sharply in Israel. Some of the contributing factors were increased immune evasion by the variant1 and the passage of more than 4 months since most adults had received their third vaccine dose. In an effort to address the challenges presented by the omicron variant and to reduce the load on the health care system, on January 2, 2022, Israeli authorities approved the administration of a fourth dose of the BNT162b2 vaccine (Pfizer–BioNTech) to persons who were 60 years of age or older, as well as to high-risk populations and health care workers, if more than 4 months had passed since receipt of their third dose. The real-world effectiveness of the fourth dose against confirmed infection and severe illness remains unclear. In this study, we used data from the Israeli Ministry of Health national database to study the relative effectiveness of the fourth dose as compared with only three doses against confirmed infection and severe illness among older persons in the Israeli population.
Methods
STUDY POPULATION
For this analysis, we included persons who, on January 1, 2022, were 60 years of age or older and had received three doses of BNT162b2 at least 4 months before the end of the study period (March 2). We excluded the following persons from the analysis: those who had died before the beginning of the study period (January 10); those for whom no information regarding their age or sex was available; those who had had a confirmed SARS-CoV-2 infection before the beginning of the study, determined with the use of either a polymerase-chain-reaction (PCR) assay or a state-regulated rapid antigen test; those who had received a third dose before its approval for all older residents (i.e., before July 30, 2021); those who had been abroad for the entire study period (January 10 to March 2; persons were considered to be abroad 10 days before traveling until 10 days after their return to Israel); and those who had received a vaccine dose of a type other than BNT162b2.
For persons who met the inclusion criteria, we extracted information on March 4, 2022, regarding SARS-CoV-2 infection (confirmed either by state-regulated rapid antigen test or by PCR) and severe Covid-19 (defined with the use of the National Institutes of Health definition2 as a resting respiratory rate of >30 breaths per minute, an oxygen saturation of <94% while breathing ambient air, or a ratio of partial pressure of arterial oxygen to fraction of inspired oxygen of <300) during the 14 days after confirmation of infection. During the study period, infections were overwhelmingly dominated by the omicron variant.3 We also extracted data regarding vaccination (dates and brands of first, second, third, and fourth doses) and demographic variables such as age, sex, and demographic group (general Jewish, Arab, or ultra-Orthodox Jewish), as determined by the person’s statistical area of residence (similar to a census block4).
STUDY DESIGN
The study period started on January 10, 2022, and ended on March 2, 2022, for confirmed infection and ended on February 18, 2022, for severe illness. The starting date was set to 7 days after the start of the vaccination campaign (January 3, 2022) so that at least the first four-dose group (days 8 to 14 after vaccination) would be represented throughout the study period (Fig. S1 in the Supplementary Appendix, available with the full text of this article at NEJM.org). The end dates were chosen to minimize the effects of missing outcome data due to delays in reporting PCR or antigen test results and to allow time for the development of severe illness.
The design of the study was similar to that of a previous study in which we assessed the protection conferred by the third vaccine dose as compared with the second dose.5 We calculated the total number of person-days at risk and the incidence of confirmed infection and of severe Covid-19 during the study period defined for each outcome. For persons who received the fourth dose, treatment groups were defined according to the number of weeks that had passed since receiving that dose, starting from the second week (8 to 14 days after vaccination). These four-dose groups were compared with two control groups. The first control group included persons who were eligible for a fourth dose but had not yet received it (three-dose group). Because persons who received the fourth dose might have differed from those who had not according to unmeasured confounding variables, a second control group was defined as persons who had received a fourth dose 3 to 7 days earlier (internal control group). This control group included the same persons as the four-dose groups, but during a period in which the fourth dose was not expected to affect the rate of confirmed infection or severe illness. The membership in these groups was dynamic, and participants contributed risk days to different study groups on different calendar days, depending on their vaccination status.
OVERSIGHT
The study was approved by the institutional review board of the Sheba Medical Center. All the authors contributed to the conceptualization of the study, critically reviewed the results, approved the final version of the manuscript, and made the decision to submit the manuscript for publication. The authors vouch for the accuracy and completeness of the data in this report. The Israeli Ministry of Health and Pfizer have a data-sharing agreement, but only the final results of this study were shared.
STATISTICAL ANALYSIS
Using quasi-Poisson regression, we estimated the rates of confirmed infection and severe Covid-19 per 100,000 person-days for each study group (included as factors in the model), with adjustment for the following demographic variables: age group (60 to 69 years, 70 to 79 years, or ≥80 years), sex, and demographic group (general Jewish, Arab, or ultra-Orthodox Jewish). Because incidences of both confirmed infection and severe illness increased rapidly during January 2022, the risk of exposure at the beginning of the study period was lower than at the end of the study period. Moreover, the fraction of the population in each study group changed throughout the study period (Fig. S1). Therefore, we included calendar date as an additional covariate to account for changing exposure risk.6 The end of the study period for severe Covid-19 was set to 14 days before the date of data retrieval (March 4), allowing at least 14 days of follow-up time for the development of severe illness. To ensure the same follow-up time for severe Covid-19 in all persons, we considered only cases of severe illness that developed within 14 days after confirmation of infection. The date used for counting events of severe Covid-19 was defined as the date of the test confirming the infection that subsequently led to the severe illness.
Persons who received four doses were assigned to groups according to the numbers of weeks that had passed since receipt of the fourth dose; for each outcome, we estimated the incidence rate in each of these four-dose groups and in the two control groups. We calculated two rate ratios for each treatment group and each outcome: first, the ratio of the rate in the three-dose group to that in each four-dose group; and second, the ratio of the rate in the internal control group to that in each four-dose group. Note that the higher this rate ratio is, the greater the protection conferred by the fourth dose of vaccine. In addition, adjusted rate differences per 100,000 person-days during the study period were estimated with a method similar to that used in our previous analysis.7 Confidence intervals were calculated by exponentiating the 95% confidence intervals for the regression coefficients, without adjustment for multiplicity. Thus, the confidence intervals should not be used to infer differences between study groups.
To check for possible biases, we performed several sensitivity analyses. First, we estimated the rate ratios for confirmed infection using an alternative statistical method that relied on matching (similar to that used by Dagan et al.8), as described in detail in the Supplementary Appendix; this approach could not be applied to the analysis of severe Covid-19 because of the small case numbers. Second, we examined the results of using data on infections confirmed only by PCR testing and excluding data on those confirmed by state-regulated antigen testing. Third, we repeated the analyses with data from the general Jewish population only. Fourth, we analyzed the data while accounting for the exposure risk over time in each person’s area of residence. Fifth, we analyzed the data while accounting for the time of vaccination since the third dose. Further details of the sensitivity analyses are provided in the Supplementary Appendix.
Results
STUDY POPULATION
Figure 1.Study Poplation.Table 1.Demographic and Clinical Characteristics of the Persons in the Study Groups.
A total of 1,252,331 persons met the criteria for inclusion in the study (Figure 1). The total number of events and person-days at risk in each of the study groups, along with the distribution of covariates used in the analysis, are shown in Table 1, which provides statistics aggregated across weeks since receipt of the fourth dose from the second week onward. The information for each treatment group according to the week since receipt of the fourth dose is provided in Table S1. Overall, the distributions of covariates in the aggregated treatment groups are similar to those in the internal control group. As compared with the three-dose group, the aggregated four-dose groups and the internal control group included more person-days over the age of 80 years (24.9% and 25.1%, respectively, vs. 16.2%) and more person-days from the general Jewish population (94.2% and 93.7% vs. 84.4%). Those in the three-dose group had a larger number of risk days than did those in the aggregated four-dose groups (31.0 million person-days vs. 23.9 million person-days) but had more confirmed infections (111,780 vs. 42,325) and more severe cases (1210 vs. 355).
PROTECTION CONFERRED BY THE FOURTH DOSE
As shown in Table 1, the unadjusted rate of confirmed infection was 177 cases per 100,000 person-days in the aggregated four-dose groups, 361 cases per 100,000 person-days in the three-dose group, and 388 cases per 100,000 person-days in the internal control group. The unadjusted rate of severe Covid-19 was 1.5 cases per 100,000 person-days in the aggregated four-dose groups, 3.9 cases per 100,000 person-days in the three-dose group, and 4.2 cases per 100,000 person-days in the internal control group.Table 2.Results of the Quasi-Poisson Regression Analysis of Confirmed SARS-CoV-2 Infection.Table 3.esults of the Quasi-Poisson Regression Analysis of Severe Covid-19.Figure 2.Adjusted Rate Ratios for Confirmed Infection and Severe Illness.
The results of the quasi-Poisson regression analysis are summarized in Table 2 for confirmed infection and in Table 3 for severe illness. Figure 2 provides a graphical representation of the results for both confirmed infection and severe illness.
The adjusted rate of confirmed infection was lower in the four-dose groups than in the two control groups. The adjusted rate among persons in the fourth week (22 to 28 days) after receipt of the fourth dose was lower by a factor of 2.0 (95% confidence interval [CI], 1.9 to 2.1) than that in the three-dose group and was lower by a factor of 1.8 (95% CI, 1.7 to 1.9) than that in the internal control group. The adjusted rate of confirmed infection (after rounding) in the fourth week after the fourth dose was 171 cases per 100,000 person-days (95% CI, 165 to 177), as compared with 340 cases per 100,000 person-days (95% CI, 337 to 343) in the three-dose group and 308 cases per 100,000 person-days (95% CI, 299 to 317) in the internal control group (Table S2). In the analysis of adjusted rate differences, the group in the fourth week after the fourth dose had 170 fewer confirmed infections per 100,000 person-days (95% CI, 162 to 176) than the three-dose group, and 137 fewer confirmed infections per 100,000 person-days (95% CI, 125 to 148) than the internal control group. From the fifth week (29 to 35 days) onward, the rate ratio for confirmed infection started to decline. The adjusted rate of infection in the eighth week after the fourth dose was very similar to those in the control groups; the rate ratio for the three-dose group as compared with the four-dose group was 1.1 (95% CI, 1.0 to 1.2), and the rate ratio for the internal control group as compared with the four-dose group was only 1.0 (95% CI, 0.9 to 1.1).
The rate ratios comparing the control groups with the four-dose groups were larger and longer-lasting for severe Covid-19. For persons in the fourth week after receipt of the fourth dose, the adjusted rate of severe illness was lower by a factor of 3.5 (95% CI, 2.7 to 4.6) than that in the three-dose group and was lower by a factor of 2.3 (95% CI, 1.7 to 3.3) than that in the internal control group. The adjusted rate of severe Covid-19 (after rounding) in the fourth week after the fourth dose was 1.6 cases per 100,000 person-days (95% CI, 1.2 to 2.0), as compared with 5.5 cases per 100,000 person-days (95% CI, 5.2 to 5.9) in the three-dose group and 3.6 cases per 100,000 person-days (95% CI, 3.0 to 4.5) in the internal control group (Table S2). The adjusted rate differences were 3.9 fewer cases per 100,000 person-days (95% CI, 3.4 to 4.5) and 2.1 fewer cases per 100,000 person-days (95% CI, 1.4 to 3.0) than the three-dose group and the internal control group, respectively. Severe illness continued to occur at lower rates in the four-dose groups than in the control groups in later weeks after receipt of the fourth dose, and no signs of waning were evident by the sixth week after receipt of the fourth dose (Figure 2).
SENSITIVITY ANALYSES
The results of the matched analysis of confirmed infection were similar to the results obtained in the main analysis (Fig. S3). In addition, restricting the quasi-Poisson regression analysis to the general Jewish population, adding as a covariate the exposure risk over time in each individual’s area of residence, or adding as a covariate the time since administration of the third dose did not substantially change the results of the main analysis (Figs. S4 and S5).
As described in the Supplementary Appendix, the testing policy in Israel was changed in early January 2022 (before the study period) for persons younger than 60 years of age. Even though the testing policy for the study population (persons ≥60 years of age) did not change, we tested the possible effect of the type of diagnostic test used to confirm infection by repeating the analysis counting only infections confirmed by positive PCR tests. This resulted in only very minor changes to the estimated level of protection conferred by the fourth dose (Figs. S4 and S5). In addition, we compared the testing rate and test type (PCR or antigen) among persons who received the fourth dose as compared with those who received only three doses and found the differences to be of limited extent (Fig. S2).
Discussion
The omicron variant is genetically divergent from the ancestral SARS-CoV-2 strain for which the BNT162b2 vaccine was tailored. The results presented here indicate that as compared with three vaccine doses given at least 4 months earlier, a fourth dose provides added short-term protection against confirmed infections and severe illness caused by the omicron variant. The incidence rate for confirmed infection was lower by a factor of 2 and the rate of severe disease lower by a factor of 3 among persons in the fourth week after receiving the fourth dose than among eligible persons who did not receive the fourth dose.
Comparing the rate ratio over time since the fourth dose (Figure 2) suggests that the protection against confirmed infection with the omicron variant reaches a maximum in the fourth week after vaccination, after which the rate ratio decreases to approximately 1.1 by the eighth week; these findings suggest that protection against confirmed infection wanes quickly. In contrast, protection against severe illness did not appear to decrease by the sixth week after receipt of the fourth dose. More follow-up is needed in order to evaluate the protection of the fourth dose against severe illness over longer periods.
Although our analysis attempts to address biases such as confounding, some sources of bias may not have been measured or adequately controlled for — for example, behavioral differences between persons who received the fourth dose and those who did not. For severe illness, differences in the prevalence of coexisting conditions could potentially have affected the results; however, this information is not recorded in the national database, and therefore we did not adjust for such differences. Differences in coexisting conditions could also be associated with differential treatment with antiviral drugs such as ritonavir-boosted nirmatrelvir, which could have affected the results. To address some of these biases, we compared the rate of confirmed infection and severe illness within the group of people who received the fourth dose. Estimates of the rate ratio during the first days after vaccination could include the effect of transient biases (Fig. S6). These potential biases include the “healthy vaccinee” bias,9 in which people who feel ill tend not to get vaccinated in the following days, which leads to a lower number of confirmed infections and severe disease in the four-dose group during the first days after vaccination. Moreover, one would expect that detection bias due to behavioral changes, such as the tendency to perform fewer tests after vaccination, is more pronounced shortly after receipt of the dose.
Thus, we compared the rates of confirmed infections and severe illness at different weeks after the fourth dose, from the second week onward, with the rates on days 3 to 7 after its receipt, a period during which the transient biases would have diminished but before the vaccine would be expected to have affected the rate of the outcomes of interest.6 The rate ratios obtained for confirmed infections were very similar to those obtained when comparing the treatment groups with the persons who did not receive a fourth dose. For severe illness, the rate ratios relative to the internal control group were lower than the rate ratios relative to the three-dose group. Even when the internal control group was the basis for comparison, the rate ratios for severe illness were still higher than those for confirmed infection and did not show signs of waning immunity.
In addition, several sensitivity analyses were performed to assess the robustness of the results to further potential biases. First, we performed the analyses using data only from the general Jewish population, since the participants in that group are more common in the population that received the fourth dose. Second, we included in the model the risk of exposure in the person’s area of residence. The results of these analyses were similar to the results of the main analysis.
Overall, these analyses provided evidence for the effectiveness of a fourth vaccine dose against severe illness caused by the omicron variant, as compared with a third dose administered more than 4 months earlier. For confirmed infection, a fourth dose appeared to provide only short-term protection and a modest absolute benefit. Several reports have indicated that the protection against hospital admission conferred by a third dose given more than 3 months earlier is substantially lower against the omicron variant than the protection of a fresh third dose against hospital admission for illness caused by the B.1.617.2 (delta) variant.1,10,11 In our study, a fourth dose appeared to increase the protection against severe illness relative to three doses that were administered more than 4 months earlier.