COVID-19 vaccination effectiveness in the population of Friuli Venezia Giulia, North-East Italy. Control of bias associated with divergent compliance to policies in a test-negative case-control study

Abstract

Background: Vaccine effectiveness (VE) studies consolidate knowledge of real-world effectiveness in different contexts. However, methodological issues may undermine their conclusions: to assess the VE against COVID-19 within the Italian population, a specific threat to validity is related to the consequences of divergent compliance to the Green Pass policy.

Methods: To address this challenge we conducted a test negative case-control (TNCC) study and multiple sensitivity analysis among residents aged ≥ 12 in Friuli Venezia Giulia Region (FVG), North-east Italy, from February 1, 2021 to March 31, 2022. Information regarding 211,437 cases of COVID-19 infection and 845,748 matched controls was obtained from the regional computerized health database. The investigation considered: COVID-19 infection, hospitalization, and death. Multiple conditional logistic regressions adjusted for covariates were performed and VE was estimated as (1-OR COVID-19_{vaccinated vs. unvaccinated})x100. Mediation analyses were carried out to offset potential collider variables, particularly, the number of swabs performed after the introduction of pandemic restrictions.

Results: Full-cycle VE against infection decreased from 96% (95% CI: 96, 97) in the Alpha period to 43% (95% CI: 42, 45) in the Omicron period. Booster dose raised the protection in Omicron period to 67% (95% CI: 66, 67). Against the evasive Omicron variant, the protection of the booster dose was 87% (95% CI: 83, 90) for hospitalization and 90% (95% CI: 82, 95) for death. The number of swabs performed was included as a covariate in the adjustments, and the mediation analysis confirmed that it was a strong mediator between vaccination and COVID-19-related outcomes.

Conclusions: The study suggests that, under similar TNCC settings, mediation analysis and adjustment for number of diagnostic tests should be included, as an effective approach to the challenge of differential testing behavior that may determine substantial selection bias. This correction allowed us to align with results from other studies that show how full-cycle VE against infection was initially high but decreased over time by variant circulation, counterbalanced by booster dose that raised protection across variants and outcome severity.

Keywords: Alfa variant; COVID-19; Delta variant; Mediation analysis; Omicron variant; Selection Bias; Vaccine effectiveness.