<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD 2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="letter">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">EXCLI J</journal-id>
      <journal-title>EXCLI Journal</journal-title>
      <issn pub-type="epub">1611-2156</issn>
      <publisher>
        <publisher-name>Leibniz Research Centre for Working Environment and Human Factors</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">2026-9442</article-id>
      <article-id pub-id-type="doi">10.17179/excli2026-9442</article-id>
      <article-id pub-id-type="pii">Doc476</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Letter to the editor</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Reply to the letter to the editor by Manzoli, Acuti Martelucci and Flacco (doi: 10.17179&#x2F;excli2025-9176)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Alessandria</surname>
            <given-names>Marco</given-names>
          </name>
          <xref ref-type="corresp" rid="COR1">&#x0002a;</xref>
          <xref ref-type="aff" rid="A1">1</xref>
          <xref ref-type="aff" rid="A2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Berrino</surname>
            <given-names>Franco</given-names>
          </name>
          <xref ref-type="aff" rid="A3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Malatesta</surname>
            <given-names>Giovanni M.</given-names>
          </name>
          <xref ref-type="aff" rid="A4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Donzelli</surname>
            <given-names>Alberto</given-names>
          </name>
          <xref ref-type="aff" rid="A5">5</xref>
        </contrib>
      </contrib-group>
      <aff id="A1">
        <label>1</label>Department of Theoretical and Applied Sciences, eCampus University, 22060 Novedrate, Italy</aff>
      <aff id="A2">
        <label>2</label>Department of Life Sciences and Systems Biology, University of Turin, 10123 Turin, Italy</aff>
      <aff id="A3">
        <label>3</label>(past) Department of Predictive and Preventive Medicine, Fondazione IRCCS Istituto Nazionale dei Tumori, 20133 Milan, Italy</aff>
      <aff id="A4">
        <label>4</label>Scientific Committee of the Foundation &#x22;Allineare Sanit&#xE0; e Salute&#x22;, 51100 Pistoia, Italy</aff>
      <aff id="A5">
        <label>5</label>Independent Medical-Scientific Commission, Foundation &#x22;Allineare Sanit&#xE0; e Salute&#x22;, 20131 Milan, Italy</aff>
      <author-notes>
        <corresp id="COR1">*To whom correspondence should be addressed: Marco Alessandria, Department of Theoretical and Applied Sciences, eCampus University, 22060 Novedrate, Italy; Department of Life Sciences and Systems Biology, University of Turin, 10123 Turin, Italy, E-mail: <email>marco.alessandria@uniecampus.it</email></corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>15</day>
        <month>04</month>
        <year>2026</year>
      </pub-date>
      <pub-date pub-type="collection">
        <year>2026</year>
      </pub-date>
      <volume>25</volume>
      <fpage>476</fpage>
      <lpage>478</lpage>
      <history>
        <date date-type="received">
          <day>05</day>
          <month>01</month>
          <year>2026</year>
        </date>
        <date date-type="accepted">
          <day>22</day>
          <month>02</month>
          <year>2026</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>Copyright &#xA9; 2026 Alessandria et al.</copyright-statement>
        <copyright-year>2026</copyright-year>
        <license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
          <p>This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (http://creativecommons.org/licenses/by/4.0/) You are free to copy, distribute and transmit the work, provided the original author and source are credited.</p>
        </license>
      </permissions>
      <self-uri xlink:href="https://www.excli.de/vol25/excli2026-9442.pdf">This article is available from https://www.excli.de/vol25/excli2026-9442.pdf</self-uri>
    </article-meta>
  </front>
  <body>
    <sec>
      <title>⁯⁯⁯</title><p>We appreciate the journal&#x27;s policy of providing space for scientific debate on the articles it publishes. We are writing this further letter to correct three statements by Manzoli et al. (2025[<xref ref-type="bibr" rid="R11">11</xref>]) regarding our Comment (Malatesta et al., 2025[<xref ref-type="bibr" rid="R10">10</xref>]) and our previous articles, which distort their meaning.</p><p>1. Manzoli et al. (2025[<xref ref-type="bibr" rid="R11">11</xref>]) state: <italic>&#x201C;...which, however, produced either crude rates</italic> (Berrino et al., 2023[<xref ref-type="bibr" rid="R3">3</xref>]) <italic>or multivariable models that were inexplicably not adjusted for age</italic> (Alessandria et al., 2024[<xref ref-type="bibr" rid="R2">2</xref>])<italic>.&#x201D;</italic> This could give readers the impression that Berrino et al. and Alessandria et al. lacked transparency, and we believe this clarification is necessary.</p><p>In the first cited text, Berrino et al. (2023[<xref ref-type="bibr" rid="R3">3</xref>]), the limitations and intentions are clearly stated: <italic>&#x201C;It must be clear that these computations are merely an exercise to illustrate the direction of the bias and do not pretend to provide true estimates of the effect.&#x201D;</italic> Despite this, we are convinced that the research findings of both Flacco et al. (2023[<xref ref-type="bibr" rid="R5">5</xref>]) and Acuti Martellucci et al. (2025[<xref ref-type="bibr" rid="R1">1</xref>]), which attribute a significant benefit to mRNA products for all causes of death (including non-COVID causes), are questionable, as no biologically plausible reason could explain a therapeutic effect of mRNA products for all causes of death. Therefore, any estimate showing such an association should raise suspicion of serious bias, requiring thorough investigation by the scientific community.</p><p>Instead, the second text cited by Manzoli et al. (i.e. Alessandria et al., 2024[<xref ref-type="bibr" rid="R2">2</xref>]), carried out the correction for age and explicitly stated that <italic>&#x201C;Additional information collected to adjust the estimated HRs included nine covariates: sex, AGE, hypertension, diabetes, chronic obstructive pulmonary disease (COPD), cardiovascular disease (CVD), kidney diseases, cancer, and infection (individuals infected by SARS-CoV-2),&#x201D;</italic> and that furthermore <italic>&#x201C;With the aim to verify the validity of assumption of the model, Schoenfeld&#x27;s test was used considering both the value of the global test and each covariate, so we can use the appropriate stratification if the assumptions of the model were not satisfied.&#x201D;</italic> Applying stratification implicitly allows the HR to be controlled for covariates (such as age) that do not satisfy the model&#x27;s proportionality assumptions. Stratification, for age or other covariates, is necessary to obtain reliable HR values when those covariates do not meet the model assumptions (Kleinbaum and Klein, 2012[<xref ref-type="bibr" rid="R9">9</xref>]).</p><p>2. Manzoli et al. continue by stating that <italic>&#x201C;... our use of Cox models, which aligned time zero, eligibility, and treatment, accounted for the different duration of follow-up of exposed and unexposed individuals (Acuti Martellucci et al., 2025</italic>[<xref ref-type="bibr" rid="R1">1</xref>]<italic>).&#x201D;</italic> However, in the section describing the use of the Cox model, there are no statements supporting the procedure. In fact, simply adopting Cox models in itself does not align time zero, eligibility, and treatment assignment unless the dataset design does so. Conversely, what is written in their &#x201C;Follow-up&#x201D; section appears to support the hypothesis of inadequately addressed immortal time, which could explain a significant bias in their results.</p><p>3. Furthermore, Manzoli et al. add: <italic>&#x201C;Also, &#x5B;&#x2026;&#x5D; correcting for the immortal time bias is debatable as the vaccinated individuals would appear twice with issues of intra-cluster variance (Hern&#xE1;n et al., 2016</italic>[<xref ref-type="bibr" rid="R7">7</xref>]<italic>).&#x201D;</italic> However, the method we used is the one proposed by Mantel-Byar, considered the gold standard and recognized as a procedure that provides unbiased estimates of associations (Weberpals et al., 2018[<xref ref-type="bibr" rid="R13">13</xref>]; Mi et al., 2016[<xref ref-type="bibr" rid="R12">12</xref>]). The Mantel-Byar method is based on time-dependent information, where each subject contributes unexposed and exposed person-time based on the patient&#x27;s exact exposure status at each point during follow-up (i.e., the time a subject spends in each of the two categories - first unvaccinated, then vaccinated - is precisely separated. When the subject transitions from one category to the other, person-time calculation in the first category stops, censorship occurs, and person-time calculation restarts with the subject in the new category. Therefore, it is the time a person spends within a category that is considered, not the person - Hanley and Foster, 2014[<xref ref-type="bibr" rid="R6">6</xref>]). We have no record that this has any relevance to the paper by Hern&#xE1;n et al. (2016[<xref ref-type="bibr" rid="R7">7</xref>]) cited by Manzoli et al., which, moreover, does not mention any intra-cluster variance issue.</p><p>We reiterate that we are also convinced that healthy-vaccinee bias is among the causes of the implausible mortality results reported by Acuti Martellucci et al. (2025[<xref ref-type="bibr" rid="R1">1</xref>]), as they themselves acknowledge. This bias is probably even greater than they claimed and persists much longer than Chemaitelly et al. (2025[<xref ref-type="bibr" rid="R4">4</xref>]) estimated, as demonstrated by the example of Jackson et al. (2006[<xref ref-type="bibr" rid="R8">8</xref>]), cited in our letter, among many other possible examples. However, we believe that to this bias must be added the immortal-time bias. This bias, combined with healthy-vaccinee bias, leads to mortality results that are grossly devoid of biological meaning.</p><p>We also reiterate that our various contributions to the scientific debate have never required corrections to the articles we commented on, as Manzoli et al. claim. Instead, we aim to provide constructive criticism to the scientific debate on issues of great relevance to health policy. We hope for an open, evidence-based debate, free from methodological errors and censorship, provided that the scientific validity of the data and methods used is safeguarded.</p><p>If Acuti Martellucci et al. (2025[<xref ref-type="bibr" rid="R1">1</xref>]) make available the datasets used for their analysis, as already requested in our letter, we will be able to verify the method used to avoid immortal time bias and compare it with our approach.</p></sec>
    <sec>
      <title>Declaration</title><sec><title>Conflict of interest</title><p>The authors have nothing to declare.</p></sec><sec><title>Artificial Intelligence (AI) - assisted technology</title><p>We did not use artificial intelligence.</p></sec></sec>
  </body>
  <back>
    <ref-list>
      <ref id="R1">
        <label>1</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Acuti Martellucci</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Capodici</surname>
              <given-names>A</given-names>
            </name>
            <name>
              <surname>Soldato</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Fiore</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Zauli</surname>
              <given-names>E</given-names>
            </name>
            <name>
              <surname>Carota</surname>
              <given-names>R</given-names>
            </name>
            <etal />
          </person-group>
          <article-title>COVID-19 vaccination, all-cause mortality, and hospitalization for cancer: 30-month cohort study in an Italian province</article-title>
          <source>EXCLI Journal</source>
          <year>2025</year>
          <volume>24</volume>
          <fpage>690</fpage>
          <lpage>707</lpage>
        </citation>
      </ref>
      <ref id="R2">
        <label>2</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Alessandria</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Malatesta</surname>
              <given-names>GM</given-names>
            </name>
            <name>
              <surname>Berrino</surname>
              <given-names>F</given-names>
            </name>
            <name>
              <surname>Donzelli</surname>
              <given-names>A</given-names>
            </name>
          </person-group>
          <article-title>A Critical Analysis of All-Cause Deaths during COVID-19 Vaccination in an Italian Province</article-title>
          <source>Microorganisms</source>
          <year>2024</year>
          <volume>12</volume>
          <fpage>1343</fpage>
        </citation>
      </ref>
      <ref id="R3">
        <label>3</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Berrino</surname>
              <given-names>F</given-names>
            </name>
            <name>
              <surname>Donzelli</surname>
              <given-names>A</given-names>
            </name>
            <name>
              <surname>Bellavite</surname>
              <given-names>P</given-names>
            </name>
            <name>
              <surname>Malatesta</surname>
              <given-names>G</given-names>
            </name>
          </person-group>
          <article-title>COVID-19 vaccination and all-cause and non-COVID-19 mortality. A revaluation of a study carried out in an Italian Province</article-title>
          <source>Epidemiol Prev</source>
          <year>2023</year>
          <volume>47</volume>
          <fpage>374</fpage>
          <lpage>378</lpage>
        </citation>
      </ref>
      <ref id="R4">
        <label>4</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Chemaitelly</surname>
              <given-names>H</given-names>
            </name>
            <name>
              <surname>Ayoub</surname>
              <given-names>HH</given-names>
            </name>
            <name>
              <surname>Coyle</surname>
              <given-names>P</given-names>
            </name>
            <name>
              <surname>Tang</surname>
              <given-names>P</given-names>
            </name>
            <name>
              <surname>Hasan</surname>
              <given-names>MR</given-names>
            </name>
            <name>
              <surname>Yassine</surname>
              <given-names>HM</given-names>
            </name>
            <etal />
          </person-group>
          <article-title>Assessing healthy vaccinee effect in COVID-19 vaccine effectiveness studies: a national cohort study in Qatar</article-title>
          <source>Elife</source>
          <year>2025</year>
          <volume>14</volume>
          <fpage>e103690</fpage>
        </citation>
      </ref>
      <ref id="R5">
        <label>5</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Flacco</surname>
              <given-names>ME</given-names>
            </name>
            <name>
              <surname>Acuti Martellucci</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Soldato</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Di Martino</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Carota</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>De Benedictis</surname>
              <given-names>M</given-names>
            </name>
            <etal />
          </person-group>
          <article-title>COVID-19 Vaccination Did Not Increase the Risk of Potentially Related Serious Adverse Events: 18-Month Cohort Study in an Italian Province</article-title>
          <source>Vaccines</source>
          <year>2023</year>
          <volume>11</volume>
          <fpage>31</fpage>
          <lpage>44</lpage>
        </citation>
      </ref>
      <ref id="R6">
        <label>6</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Hanley</surname>
              <given-names>JA</given-names>
            </name>
            <name>
              <surname>Foster</surname>
              <given-names>BJ</given-names>
            </name>
          </person-group>
          <article-title>Avoiding blunders involving &#x27;immortal time&#x27;</article-title>
          <source>Int J Epidemiol</source>
          <year>2014</year>
          <volume>43</volume>
          <fpage>949</fpage>
          <lpage>961</lpage>
        </citation>
      </ref>
      <ref id="R7">
        <label>7</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Hern&#xE1;n</surname>
              <given-names>MA</given-names>
            </name>
            <name>
              <surname>Sauer</surname>
              <given-names>BC</given-names>
            </name>
            <name>
              <surname>Hern&#xE1;ndez-D&#xED;az</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Platt</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Shrier</surname>
              <given-names>I</given-names>
            </name>
          </person-group>
          <article-title>Specifying a target trial prevents immortal time bias and other self-inflicted injuries in observational analyses</article-title>
          <source>J Clin Epidemiol</source>
          <year>2016</year>
          <volume>79</volume>
          <fpage>70</fpage>
          <lpage>75</lpage>
        </citation>
      </ref>
      <ref id="R8">
        <label>8</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Jackson</surname>
              <given-names>LA</given-names>
            </name>
            <name>
              <surname>Jackson</surname>
              <given-names>ML</given-names>
            </name>
            <name>
              <surname>Nelson</surname>
              <given-names>JC</given-names>
            </name>
            <name>
              <surname>Neuzil</surname>
              <given-names>KM</given-names>
            </name>
            <name>
              <surname>Weiss</surname>
              <given-names>NS</given-names>
            </name>
          </person-group>
          <article-title>Evidence of bias in estimates of influenza vaccine effectiveness in seniors</article-title>
          <source>Int J Epidemiol</source>
          <year>2006</year>
          <volume>35</volume>
          <fpage>337</fpage>
          <lpage>344</lpage>
        </citation>
      </ref>
      <ref id="R9">
        <label>9</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Kleinbaum</surname>
              <given-names>DG</given-names>
            </name>
            <name>
              <surname>Klein</surname>
              <given-names>M</given-names>
            </name>
          </person-group>
          <source>Survival Analysis: A Self-Learning Text</source>
          <year>2012</year>
          <edition>3rd ed.</edition>
          <publisher-loc>New York</publisher-loc>
          <publisher-name>Spinger</publisher-name>
        </citation>
      </ref>
      <ref id="R10">
        <label>10</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Malatesta</surname>
              <given-names>GM</given-names>
            </name>
            <name>
              <surname>Alessandria</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Berrino</surname>
              <given-names>F</given-names>
            </name>
            <name>
              <surname>Donzelli</surname>
              <given-names>A</given-names>
            </name>
          </person-group>
          <article-title>Comment to &#x201C;COVID-19 vaccination, all-cause mortality, and hospitalization for cancer: 30-month cohort study in an Italian province&#x201D;</article-title>
          <source>EXCLI Journal</source>
          <year>2025</year>
          <volume>24</volume>
          <fpage>1797</fpage>
          <lpage>1799</lpage>
        </citation>
      </ref>
      <ref id="R11">
        <label>11</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Manzoli</surname>
              <given-names>L</given-names>
            </name>
            <name>
              <surname>Acuti Martellucci</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Flacco</surname>
              <given-names>ME</given-names>
            </name>
          </person-group>
          <article-title>Reply to the Letter to the editor by Malatesta, Alessandria, Berrino and Donzelli</article-title>
          <source>EXCLI Journal</source>
          <year>2025</year>
          <volume>24</volume>
          <fpage>1800</fpage>
          <lpage>1801</lpage>
        </citation>
      </ref>
      <ref id="R12">
        <label>12</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Mi</surname>
              <given-names>X</given-names>
            </name>
            <name>
              <surname>Hammill</surname>
              <given-names>BG</given-names>
            </name>
            <name>
              <surname>Curtis</surname>
              <given-names>LH</given-names>
            </name>
            <name>
              <surname>Lai</surname>
              <given-names>EC</given-names>
            </name>
            <name>
              <surname>Setoguchi</surname>
              <given-names>S</given-names>
            </name>
          </person-group>
          <article-title>Use of the landmark method to address immortal person-time bias in comparative effectiveness research: a simulation study</article-title>
          <source>Stat Med</source>
          <year>2016</year>
          <volume>35</volume>
          <fpage>4824</fpage>
          <lpage>4836</lpage>
        </citation>
      </ref>
      <ref id="R13">
        <label>13</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Weberpals</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Jansen</surname>
              <given-names>L</given-names>
            </name>
            <name>
              <surname>Silversmit</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Verbeeck</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>van der Geest</surname>
              <given-names>L</given-names>
            </name>
            <name>
              <surname>Vissers</surname>
              <given-names>PA</given-names>
            </name>
            <etal />
          </person-group>
          <article-title>Comparative performance of a modified landmark approach when no time of treatment data are available within oncological databases: exemplary cohort study among resected pancreatic cancer patients</article-title>
          <source>Clin Epidemiol</source>
          <year>2018</year>
          <volume>10</volume>
          <fpage>1109</fpage>
          <lpage>1125</lpage>
        </citation>
      </ref>
    </ref-list>
  </back>
</article>