Non-specific effect of vaccines
Non-specific effects of vaccines (also called "heterologous effects" or "off-target effects") are effects which go beyond the specific protective effects against the targeted diseases. Non-specific effects can be strongly beneficial, increasing protection against non-targeted infections, but also at times negative, increasing susceptibility to non-targeted infections.[1] This depends on both the vaccine and the sex of the infant.[2]
All live attenuated vaccines studied so far (BCG vaccine, measles vaccine, oral polio vaccine, smallpox vaccine) have been shown to reduce mortality more than can be explained by prevention of the targeted infections. In contrast, inactivated vaccines (diphtheria-tetanus-pertussis vaccine (DTP), hepatitis B vaccine, inactivated polio vaccine) may increase overall mortality despite providing protection against the target diseases.
These effects may be long-lasting, at least up to the time point where a new type of vaccine is given. The non-specific effects can be very pronounced, with significant effects on overall mortality and morbidity. In a situation with herd immunity to the target disease, the non-specific effects can be more important for overall health than the specific vaccine effects.[2]
The non-specific effects should not be confused with the side effects of vaccines (such as local reactions at the site of vaccination or general reactions such as fever, head ache or rash, which usually resolve within days to weeks – or in rare cases anaphylaxis). Rather, non-specific effects represent a form of general immunomodulation, with important consequences for the immune system's ability to handle subsequent challenges.
It is estimated that millions of child deaths in low income countries could be prevented every year if the non-specific effects of vaccines were taken into consideration in immunization programs.[1]
History
The hypothesis that vaccines have non-specific effects was formulated in the early 1990s by Peter Aaby at the Bandim Health Project in West Africa.[3]
The first indication of the importance of the non-specific effects of vaccines came in a series of randomized controlled trials (RCTs) in the late 1980s. It was tested whether a high-titer (high-dose) measles vaccine (HTMV) given at 4–6 months of age was as effective against measles infection as the standard measles vaccine (MV) given at 9 months of age. Early administration of the HTMV prevented measles infection just as effectively as did the standard MV given at 9 months of age.
However, early administration of the HTMV was associated with twofold higher overall mortality among females (there was no difference in mortality for males).[4][5][6] In other words, the girls given HTMV died more often despite having the same protection against measles as the infants given standard MV. The discovery forced WHO to withdraw the HTMV in 1992.[7] It was later discovered that it was not the HTMV, but rather a subsequent inactivated vaccine (DTP or IPV for different children), that caused the increase in female mortality.[8] Although the mechanism was different than initially thought, this finding represents unexpected effects of a change in the vaccine program not attributable to the disease-specific protection provided by the vaccines.
This first observation that vaccines could protect against the target disease but at the same time affect mortality after infection with other pathogens, in a sex-differential manner, led to several further studies showing that other vaccines might also have such nonspecific effects.
Live attenuated versus inactivated vaccines
Numerous observational studies and randomised trials (RCTs) have found that the impact on mortality of live and inactivated vaccines differ markedly. All live vaccines studied so far (BCG, measles vaccine, oral polio vaccine (OPV) and smallpox vaccine) have been shown to reduce mortality more than can be explained by prevention of the targeted infection(s). In contrast, inactivated vaccines (diphtheria-tetanus-pertussis (DTP), hepatitis B, inactivated polio vaccine) may have deleterious effects in spite of providing target disease protection.[9]
BCG vaccine
The live attenuated BCG vaccine developed against tuberculosis has been shown to have strong beneficial effects on the ability to combat non-tuberculosis infections.[2][10]
Several studies have suggested that BCG vaccination may reduce atopy, particularly when given early in life. Furthermore, in multiple observational studies BCG vaccination has been shown to provide beneficial effects on overall mortality.[11] These observations encouraged randomised controlled trials to examine BCG vaccination's beneficial non-specific effects on overall health.[12][13][14][15] Since BCG vaccination is recommended to be given at birth in countries that have a high incidence of tuberculosis it would have been unethical to randomize children into 'BCG' vs. 'no BCG' groups. However, many low-income countries delay BCG vaccination for low-birth-weight (LBW) infants; this offered the opportunity to directly test the effect of BCG on overall mortality.
In the first two randomised controlled trials receipt of BCG+OPV at birth vs. OPV only ('delayed BCG') was associated with strong reductions in neonatal mortality; these effects were seen as early as 3 days after vaccination. BCG protected against sepsis as well as respiratory infections.[16][17] Among BCG vaccinated children, those who develop a BCG scar or a positive skin test (TST) are less likely to develop sepsis and exhibit an overall reduction in child mortality of around 50%.[14][18][19]
In a recent WHO-commissioned review based on five clinical trials and nine observational studies, it was concluded that "the results indicated a beneficial effect of BCG on overall mortality in the first 6–12 months of life.[16] Relevant follow-up in some of the trials was short, and all of the observational studies were regarded as being at risk of bias, so the confidence in the findings was rated as very low according to the GRADE criteria and "There was a suggestion that BCG vaccination may be more beneficial the earlier it is given". Furthermore, "estimated effects are in the region of a halving of mortality risk" and "any effect of BCG vaccine on all-cause mortality is not likely to be attributable to any great extent to fewer deaths from tuberculosis (i.e. to a specific effect of BCG vaccine against tuberculosis)".[20] Based on the evidence, the WHO's Strategic Group of Experts on Immunization concluded that "the non-specific effects on all-cause mortality warrant further research".[21]
Measles vaccine
Standard titer measles vaccine is recommended at 9 months of age in low-income countries where measles infection is endemic and often fatal. Many observational studies have shown that measles-vaccinated children have substantially lower mortality than can be explained by the prevention of measles-related deaths.[22] Many of these observational studies were natural experiments, such as studies comparing the mortality before and after the introduction of measles vaccine and other studies where logistical factors rather than maternal choice determined whether a child was vaccinated or not.
These findings were later supported in randomized trials from 2003 to 2009 in Guinea-Bissau. An intervention group of children given standard titer measles vaccine at 4.5 and 9 month of age had a 30% reduction in all-cause mortality compared to the children in the control group, which were only vaccinated against measles at 9 month of age.[9]
In a recent WHO-commissioned review based on four randomized trials and 18 observational studies, it was concluded that "There was consistent evidence of a beneficial effect of measles vaccine, although all observational studies were assessed as being at risk of bias and the GRADE rating was of low confidence. There was an apparent difference between the effect in girls and boys, with girls benefitting more from measles vaccination", and furthermore "estimated effects are in the region of a halving of mortality risk" and "if these effects are real then they are not fully explained by deaths that were established as due to measles".[20] Based on the evidence, the WHO's Strategic Advisory Group of Experts on Immunization concluded that "the non-specific effects on all-cause mortality warrant further research".[21]
Diphtheria-tetanus-pertussis vaccine
DTP vaccine against diphtheria, tetanus and pertussis does not seem to have the same beneficial effects as BCG, measles vaccine, OPV and smallpox vaccine, and in fact opposite effects are observed.[23] The negative effects are seen as long as DTP vaccine is the most recent vaccine. BCG or measles vaccine given after DTP reverses the negative effects of DTP.[23] The negative effects are seen mostly in females.[23]
The negative effects are found in several observational studies. However, six WHO-commissioned studies concluded that there were strong beneficial effects of DTP on overall mortality.[24][25][26][27][28][29] However, controversy ensued as these studies had important methodological shortcomings.[30][31] For example, the WHO-commissioned studies had counted "no information about vaccination" as "unvaccinated", and they had retrospectively updated vaccine information from surviving children, while no similar update could be made for dead children, creating a so-called "survival bias" which will always produce highly beneficial effect estimates for the most recent vaccine.[32]
In a recent WHO-commissioned review of DTP based on ten observational studies, it was concluded that, "the findings were inconsistent, with a majority of the studies indicating a detrimental effect of DTP, and two studies indicating a beneficial effect. All of the studies were regarded as being at risk of bias, so the confidence in the findings was rated as very low according to the GRADE criteria."
Furthermore, "three observational studies provided a suggestion that simultaneous administration of BCG and DTP may be preferable to the recommended schedule of BCG before DTP; and there was suggestion that mortality risk may be higher when DTP is given with, or after, measles vaccine compared with when it is given before measles vaccine (from five, and three, observational studies, respectively). These results are consistent with hypotheses that DTP vaccine may have detrimental effects on mortality, although a majority of the evidence was generated by a group centred in Guinea-Bissau who have often written in defence of such a hypothesis."[20]
Smallpox vaccine
When smallpox vaccine was introduced in the early 19th century, there were anecdotal descriptions of non-specific beneficial effects. In the second half of the 20th century the potential for beneficial non-specific effects of smallpox vaccine was reviewed, and new evidence on "para-immune effects" was added.[33] More recent studies have focused on the phasing out of smallpox vaccine in the 1970s and compared vaccinated and unvaccinated cohorts.
Smallpox vaccine leaves a very characteristic scar. In low-income countries, having a smallpox vaccine scar has been associated with reductions of more than 40% in overall mortality among adults;[34][35] in high-income countries smallpox vaccination has been associated with a tendency for reduced risk of asthma,[36] and significantly reduced risk of malignant melanoma [37] and infectious disease hospitalizations.[38] There are no studies that contradict these observations. However no randomized trials testing the effect of smallpox vaccine on overall mortality and morbidity have been conducted.
Sex differences
Non-specific effects are frequently different in males and females. There are accumulating data illustrating that males and females may respond differently to vaccination, both in terms of the quality and quantity of the immune response.[4][5][6][23][39] If true, then we must consider whether vaccination schedules should differ for males and females, or as has been suggested "should we treat the sexes differently in order to treat them equally?"[39]
Interactions between health interventions
The non-specific effects of vaccines can be boosted or diminished when other immunomodulating health interventions such as other vaccines, or vitamins, are provided.[40]
Influence of pre-existing specific immunity
The beneficial NSEs of live vaccines are stronger with earlier vaccination, possibly due to maternal antibodies.[41] Boosting with live vaccines also seems to enhance the beneficial effects.
High-income countries
The non-specific effects were primarily observed in low-income countries with high infectious disease burdens, but they may not be limited to these areas. Recent Danish register-based studies have shown that the live attenuated measles-mumps-rubella vaccine (MMR) protects against hospital admissions with infectious diseases and specifically getting ill by respiratory syncytial virus.[42][43][44]
Immunological mechanisms
The findings from the epidemiological studies on the non-specific effects of vaccines pose a challenge to the current understanding of vaccines, and how they affect the immune system, and also question whether boys and girls have identical immune systems and should receive the same treatment.
The mechanisms for these effects are unclear. It is not known how vaccination induces rapid beneficial or harmful changes in the general susceptibility to infectious diseases, but the following mechanisms are likely to be involved.
Heterologous T-cell immunity
It is well known from animal studies that infections, apart from inducing pathogen-specific T-cells, also induce cross-reactive T-cells through epitope sharing, so-called heterologous immunity.[45][46] Heterologous T-cell immunity can lead to improved clearance of a subsequent cross-reactive challenge, but it may also lead to increased morbidity.[47] This mechanism may explain why DTP could have negative effects.
It would, however, not explain effects occurring shortly after vaccination, as for instance the rapidly occurring beneficial effects of BCG vaccine,[16] as the heterologous effect would only be expected to be present after some weeks, as the adaptive immune response need time to develop. Also, it is difficult to explain why the effect would vanish once a child receives a new vaccine.
Trained innate immunity
The concept that not only plants and insects, but also humans have innate immune memory may provide new clues to why vaccines have non-specific effects. Studies into BCG have recently revealed that BCG induces epigenetic changes in the monocytes in adults, leading to increased pro-inflammatory cytokine production upon challenges with unrelated mitogens and pathogens (trained innate immunity).[48]
In SCID mice that have no adaptive immune system, BCG reduced mortality from an otherwise lethal candida infection. The effects of BCG presented when tested after 2 weeks, but would be expected to occur rapidly after vaccination, and hence might be able to explain the very rapid protection against neonatal septicaemia seen after BCG vaccine.[49]
Trained innate immunity may also explain the generally increased resistance against broad disease categories, such as fevers and lower respiratory tract infections; such effects would be difficult to explain merely by shared epitopes, unless such epitopes were almost universally common on pathogens.
Lastly, it is plausible that the effects are reversible by a different vaccine. Hence, trained innate immunity may provide a biological mechanism for the observed non-specific effects of vaccines.[48]
Controversy
In 2000 Aaby and colleagues presented data from Guinea-Bissau which suggested that DTP vaccination could, under some circumstances (e.g. absence of pertussis) be associated with increases in overall mortality, at least until children received measles vaccine. In response, WHO sponsored the analysis of a variety of data sets in other populations to test the hypothesis. None of these studies replicated the observation of increased mortality associated with DTP vaccination.[24][25][26][27][28][29] WHO subsequently concluded, that the evidence was sufficient to reject the hypothesis for an increased nonspecific mortality following DTP vaccination.[50]
However, Aaby and colleagues subsequently pointed out that the studies which failed to show any mortality increase associated with DTP vaccination used methods of analysis that can introduce a bias against finding such an effect.[32]
In these studies, data on childhood vaccinations were typically collected in periodic surveys, and the information on vaccinations, which occurred between successive home visits, was updated at the time of the second visit. The person-time at risk in unvaccinated and vaccinated states was then divided up according to the date of vaccination during the time interval between visits. This method opens up a potential bias, insofar as the updating of person time at risk from unvaccinated to vaccinated is only possible for children who survive to the second follow-up. Those who die between visits typically do not have vaccinations between the first visit and death recorded, and thus they will tend to be allocated as deaths in unvaccinated children – thus incorrectly inflating the mortality rate among unvaccinated children.[32]
This bias has been described before, but in different contexts, as the distinction between 'landmark' and 'retrospective updating' analysis of cohort data.[51] The retrospective updating method can lead to a considerable bias in vaccine studies, biasing observed mortality rate ratios towards zero (a large effect), whereas the landmark method leads to a non-specific misclassification and biases the mortality rate ratio towards unity(no effect).
An additional problem with the literature on the nonspecific effects of vaccines has been the variety and unexpected nature of the hypotheses which have appeared (in particular relating to sex-specific effects), which has meant that it has not always been clear whether some apparent 'effects' were the result of post hoc analyses or whether they were reflections of a priori hypotheses.
This was discussed at length at a review of the work of Aaby and his colleagues in Copenhagen in 2005.[31] The review was convened by the Danish National Research Foundation and the Novo Nordisk Foundation who have sponsored much of the work of Aaby and his colleagues. An outcome of the review was the explicit formulation of a series of testable hypotheses, agreed by the Aaby group.[31] It was hoped that independent investigators would design and conduct studies powered to confirm or refute these hypotheses.
Also, the two foundations sponsored a workshop on the analysis of vaccine effects, which was held in London in 2008.[31] The workshop resulted in three papers.[51][52][53] The proceedings were forwarded to WHO which subsequently concluded that it would "keep a watch on the evidence of nonspecific effects of vaccination".[54]
In 2013, WHO established a working group tasked with reviewing the evidence for the non-specific effects of BCG, measles and DTP vaccines. Two independent reviews were conducted, an immunological review[55] and an epidemiological review.[20] The results were presented at the April 2014 meeting of WHO's Strategic Gourp of Experts on Immunizations (SAGE). WHO/SAGE concluded that further research into the potential NSEs of vaccines was warranted.[21]
Implications for world health
It would have major consequences for child survival if the non-specific effects of vaccines were taken into consideration in immunization programs: BCG and MV should be given to all children as early as possible; restrictive policies for opening multi-dose vials of BCG and MV should be abandoned.
Contrary to current WHO-recommendations, the age of MV should not be raised when measles infection is under control; DTP should not be given simultaneously with MV or after MV; and a booster dose of DTP is likely to have a negative effect on child survival. Finally, eradicating a disease and stopping a live vaccine with beneficial NSEs is likely to have negative effects for the overall health of the affected population.[1][34][35]
Dr. Frank Shann from Australia recently assessed the consequences of changing the current EPI schedule to an alternative schedule taking non-specific effects into account, and concluded: "If all neonates in high-mortality regions were given BCG at birth, and the revised immunization schedule ... were adopted, with extra doses of measles vaccine at 14 weeks and 19 months (at a cost of only US $0.60/dose delivered), ~1 million (30%) of the 3.2 million neonatal deaths each year might be prevented in developing countries, and 1.5 million (30%) of the 4.8 million deaths between 1 month and 5 years of age might be prevented". Furthermore: "This very large reduction in mortality in children <5 years of age would be achieved at a low cost using only vaccines that are already in the routine EPI schedule".[1]
The Arc of the Swallow
In 2008, Danish crime novel author Sissel-Jo Gazan (author of the Danish crime novel Dinosaur Feather) became interested in the work of the Bandim Health Project and based her science crime novel The Arc of the Swallow (Svalens Graf) on the research into non-specific effects of vaccines.
The novel was published in Danish in 2013; it was on the best-seller list for months and won the Readers' Prize 2014 in Denmark. It was published in English in the UK on November 6, 2014 and in the US on April 7, 2015.
References
- Shann F (February 2013). "Nonspecific effects of vaccines and the reduction of mortality in children". Clinical Therapeutics. 35 (2): 109–14. doi:10.1016/j.clinthera.2013.01.007. PMID 23375475.
- Benn CS, Netea MG, Selin LK, Aaby P (13 May 2013). "A small jab - a big effect: nonspecific immunomodulation by vaccines". Trends in Immunology. 34 (9): 431–9. doi:10.1016/j.it.2013.04.004. PMID 23680130.
- Aaby, P; Andersen, M; Sodemann, M; Jakobsen, M; Gomes, J; Fernandes, M (20 November 1993). "Reduced childhood mortality after standard measles vaccination at 4-8 months compared with 9-11 months of age". BMJ. 307 (6915): 1308–11. doi:10.1136/bmj.307.6915.1308. PMC 1679462. PMID 8257884.
- Holt, EA; Moulton, LH; Siberry, GK; Halsey, NA (November 1993). "Differential mortality by measles vaccine titer and sex". The Journal of Infectious Diseases. 168 (5): 1087–96. doi:10.1093/infdis/168.5.1087. PMID 8228340.
- Aaby, P; Samb, B; Simondon, F; Knudsen, K; Seck, AM; Bennett, J (1994). "Sex-specific differences in mortality after high-titre measles immunization in rural Senegal". Bull World Health Organ. 72 (5): 761–70. PMC 2486568. PMID 7955026.
- Aaby, P; Knudsen, K; Whittle, H; Lisse, IM; Thaarup, J; Poulsen, A (June 1993). "Long-term survival after Edmonston-Zagreb measles vaccination in Guinea-Bissau: increased female mortality rate". Journal of Pediatrics. 122 (6): 904–8. doi:10.1016/s0022-3476(09)90015-4. PMID 8501567.
- "Expanded programme on immunization (EPI). Safety of high titre measles vaccines". Wkly Epidemiol Rec. 67 (48): 357–61. 1992. PMID 1449986.
- Aaby, Peter; Jensen, Henrik; Samb, Badara; Cisse, Badara; Sodemann, Morten; Jakobsen, Marianne; Poulsen, Anja; Rodrigues, Amabelia; Lisse, Ida Marie; Simondon, Francois; Whittle, Hilton (28 June 2003). "Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: reanalysis of West African studies". The Lancet. 361 (9376): 2183–2188. doi:10.1016/S0140-6736(03)13771-3. PMID 12842371.
- Aaby, P; Martins, CL; Garly, ML; Bale, C; Andersen, A; Rodrigues, A (2010). "Non-specific effects of standard measles vaccine at 4.5 and 9 months of age on childhood mortality: randomised controlled trial". BMJ. 341 (6495): c6495. doi:10.1136/bmj.c6495. PMC 2994348. PMID 21118875.
- Aaby, P; Kollmann, TR; Benn, CS (October 2014). "Nonspecific effects of neonatal and infant vaccination: public-health, immunological and conceptual challenges". Nature Immunology. 15 (10): 895–9. doi:10.1038/ni.2961. PMID 25232810.
- Steenhuis, TJ; van Aalderen, WM; Bloksma, N (2008). "Bacille-Calmette-Guerin vaccination and the development of allergic disease in children: a randomized, prospective, single-blind study". Clin Exp Allergy. 38 (1): 79–85. doi:10.1111/j.1365-2222.2007.02859.x. PMID 17956585.
- Roth, AE; Nielsen, J (2 January 2007). "A non-beneficial effect of BCG on non-tuberculous childhood mortality?". Vaccine. 25 (1): 12–3. doi:10.1016/j.vaccine.2005.09.005. PMID 16198453.
- Roth, A; Jensen, H; Garly, ML; Djana, Q; Martins, CL; Sodemann, M; Rodrigues, A; Aaby, P (June 2004). "Low birth weight infants and Calmette-Guérin bacillus vaccination at birth: community study from Guinea-Bissau". The Pediatric Infectious Disease Journal. 23 (6): 544–50. doi:10.1097/01.inf.0000129693.81082.a0. PMID 15194836.
- Roth, A; Gustafson, P; Nhaga, A; Djana, Q; Poulsen, A; Garly, ML; Jensen, H; Sodemann, M; Rodriques, A; Aaby, P (June 2005). "BCG vaccination scar associated with better childhood survival in Guinea-Bissau". International Journal of Epidemiology. 34 (3): 540–7. doi:10.1093/ije/dyh392. PMID 15659474.
- Roth, A; Garly, ML; Jensen, H; Nielsen, J; Aaby, P (2006). "Bacillus Calmette-Guerin vaccination and infant mortality". Expert Rev Vaccines. 5 (2): 277–93. doi:10.1586/14760584.5.2.277. PMID 16608427.
- Biering-Sorensen, S; Aaby, P; Napirna, BM; Roth, A; Ravn, H; Rodrigues, A (Mar 2012). "Small randomized trial among low-birth-weight children receiving bacillus Calmette-Guerin vaccination at first health center contact". Pediatr Infect Dis J. 31 (3): 306–8. doi:10.1097/inf.0b013e3182458289. PMID 22189537.
- Aaby, P; Roth, A; Ravn, H; Napirna, BM; Rodrigues, A; Lisse, IM (15 July 2011). "Randomized trial of BCG vaccination at birth to low-birth-weight children: beneficial nonspecific effects in the neonatal period?". J Infect Dis. 204 (2): 245–52. doi:10.1093/infdis/jir240. PMID 21673035.
- Roth, A; Sodemann, M; Jensen, H; Poulsen, A; Gustafson, P; Weise, C; Gomes, J; Djana, Q; Jakobsen, M; Garly, ML; Rodrigues, A; Aaby, P (September 2006). "Tuberculin reaction, BCG scar, and lower female mortality". Epidemiology. 17 (5): 562–8. doi:10.1097/01.ede.0000231546.14749.ab. PMID 16878042.
- Garly, ML; Martins, CL; Balé, C; Baldé, MA; Hedegaard, KL; Gustafson, P; Lisse, IM; Whittle, HC; Aaby, P (20 June 2003). "BCG scar and positive tuberculin reaction associated with reduced child mortality in West Africa. A non-specific beneficial effect of BCG?". Vaccine. 21 (21–22): 2782–90. doi:10.1016/s0264-410x(03)00181-6. PMID 12798618.
- WHO/SAGE. "Epidemiology review Report to SAGE" (PDF). Retrieved 7 May 2015.
- WHO (2014). "Meeting of the Strategic advisory group of experts on immunization, april 2014 – conclusions and recommendations". Wkly Epidemiol Rec. 89 (21): 221–36. PMID 24864348.
- Aaby, P; Martins, CL; Garly, ML; Rodrigues, A; Benn, CS; Whittle, H (2012). "The optimal age of measles immunisation in low-income countries: a secondary analysis of the assumptions underlying the current policy". BMJ Open. 2 (4): e000761. doi:10.1136/bmjopen-2011-000761. PMC 3401826. PMID 22815465.
- Aaby, P; Benn, C; Nielsen, J; Lisse, IM; Rodrigues, A; Ravn, H (2012). "Testing the hypothesis that diphtheria-tetanus-pertussis vaccine has negative non-specific and sex-differential effects on child survival in high-mortality countries". BMJ Open. 2 (3): e000707. doi:10.1136/bmjopen-2011-000707. PMC 3364456. PMID 22619263.
- Nyarko, P; Pence, B; Debpuur, C (2001). "Immunization status and child survival in rural Ghana". Population Council. Working papers no. 147.
- Lehmann, D; Vail, J; Firth, MJ; de Klerk, NH; Alpers, MP (Feb 2005). "Benefits of routine immunizations on childhood survival in Tari, Southern Highlands Province, Papua New Guinea". Int J Epidemiol. 34 (1): 138–48. doi:10.1093/ije/dyh262. PMID 15561755.
- Elguero, E; Simondon, KB; Vaugelade, J; Marra, A; Simondon, F (October 2010). "Non-specific effects of vaccination on child survival? A prospective study in Senegal". Trop Med Int Health. 10 (10): 956–60. doi:10.1111/j.1365-3156.2005.01479.x. PMID 16185229.
- Vaugelade, J; Pinchinat, S; Guiella, G; Elguero, E; Simondon, F (4 December 2004). "Non-specific effects of vaccination on child survival: prospective cohort study in Burkina Faso". BMJ. 329 (7478): 1309. doi:10.1136/bmj.38261.496366.82. PMC 534835. PMID 15550402.
- Moulton, LH; Rahmathullah, L; Halsey, NA; Thulasiraj, RD; Katz, J; Tielsch, JM (October 2005). "Evaluation of non-specific effects of infant immunizations on early infant mortality in a southern Indian population". Trop Med Int Health. 10 (10): 947–55. doi:10.1111/j.1365-3156.2005.01434.x. PMID 16185228.
- Breiman, RF; Streatfield, PK; Phelan, M; Shifa, N; Rashid, M; Yunus, M (December 2004). "Effect of infant immunisation on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data". Lancet. 364 (9452): 2204–11. doi:10.1016/s0140-6736(04)17593-4. PMID 15610807.
- Aaby, P; Benn, CS; Nielsen, J; Lisse, IM; Rodrigues, A; Jensen, H (Jan 2007). "DTP vaccination and child survival in observational studies with incomplete vaccination data". Trop Med Int Health. 12 (1): 15–24. doi:10.1111/j.1365-3156.2006.01774.x. PMID 17207144.
- Fine, PEM; Smith, PG (2007). "Editorial: 'Non-specific effects of vaccines'- an important analytical insight, and call for a workshop". Trop Med Int Health. 12 (1): 1–4. doi:10.1111/j.1365-3156.2006.01794.x. PMID 17207142.
- Jensen, H; Benn, CS; Lisse, IM; Rodrigues, A; Andersen, PK; Aaby, P (Jan 2007). "Survival bias in observational studies of the impact of routine immunizations on childhood survival". Trop Med Int Health. 12 (1): 5–14. doi:10.1111/j.1365-3156.2006.01773.x. PMID 17207143.
- Mayr, A (June 2004). "Taking advantage of the positive side-effects of smallpox vaccination". J Vet Med B Infect Dis Vet Public Health. 51 (5): 199–201. doi:10.1111/j.1439-0450.2004.00763.x. PMID 15330977.
- Jensen, ML; Dave, S; Schim van der Loeff, M; da Costa, C; Vincent, T; Leligdowicz, A (2006). "Vaccinia scars associated with improved survival among adults in rural Guinea-Bissau". PLOS ONE. 1 (101): e101. Bibcode:2006PLoSO...1..101J. doi:10.1371/journal.pone.0000101. PMC 1762358. PMID 17183634.
- Aaby, P; Gustafson, P; Roth, A; Rodrigues, A; Fernandes, M; Sodemann, M (17 July 2006). "Vaccinia scars associated with better survival for adults. An observational study from Guinea-Bissau". Vaccine. 24 (29–30): 5718–25. doi:10.1016/j.vaccine.2006.04.045. PMID 16720061.
- Bager, P; Westergaard, T; Rostgaard, K; Nielsen, NM; Melbye, M; Aaby, P (June 2003). "Smallpox vaccination and risk of allergy and asthma". J Allergy Clin Immunol. 111 (6): 1227–31. doi:10.1067/mai.2003.1483. PMID 12789221.
- Pfahlberg, A; Kolmel, KF; Grange, JM; Mastrangelo, G; Krone, B; Botev, IN (September 2002). "Inverse association between melanoma and previous vaccinations against tuberculosis and smallpox: results of the FEBIM study". J Invest Dermatol. 119 (3): 570–5. doi:10.1046/j.1523-1747.2002.00643.x. PMID 12230497.
- Sorup, S; Villumsen, M; Ravn, H; Benn, CS; Sorensen, TI; Aaby, P (August 2011). "Smallpox vaccination and all-cause infectious disease hospitalization: a Danish register-based cohort study". Int J Epidemiol. 40 (4): 955–63. doi:10.1093/ije/dyr063. PMID 21543446.
- Flanagan, KL; Klein, SL; Skakkebaek, NE; Marriott, I; Marchant, A; Selin, L (16 Mar 2011). "Sex differences in the vaccine-specific and non-targeted effects of vaccines". Vaccine. 29 (13): 2349–54. doi:10.1016/j.vaccine.2011.01.071. PMID 21300095.
- Benn, CS; Bale, C; Sommerfelt, H; Friis, H; Aaby, P (2003). "Hypothesis: Vitamin A supplementation and childhood mortality: amplification of the non-specific effects of vaccines?". Int J Epidemiol. 32 (5): 822–8. doi:10.1093/ije/dyg208. PMID 14559758.
- Aaby, P; Martins, CL; Garly, ML; Andersen, A; Fisker, AB; Claesson, MH (14 May 2014). "Measles vaccination in the presence or absence of maternal measles antibody: Impact on child survival". Clin Infect Dis. 59 (4): 484–92. doi:10.1093/cid/ciu354. PMC 4111916. PMID 24829213.
- Sorup, S; Benn, CS; Stensballe, LG; Aaby, P; Ravn, H (1 Jan 2015). "Measles-mumps-rubella vaccination and respiratory syncytial virus-associated hospital contact". Vaccine. 33 (1): 237–45. doi:10.1016/j.vaccine.2014.07.110. PMC 4270443. PMID 25446818.
- Sorup, S; Benn, CS; Poulsen, A; Krause, TG; Aaby, P; Ravn, H (26 Feb 2014). "Live vaccine against measles, mumps, and rubella and the risk of hospital admissions for nontargeted infections". JAMA. 311 (8): 826–35. doi:10.1001/jama.2014.470. PMID 24570246.
- de Castro, MJ; Pardo-Seco, J; Martinón-Torres, F (27 February 2015). "Nonspecific (Heterologous) Protection of Neonatal BCG Vaccination Against Hospitalization Due to Respiratory Infection and Sepsis". Clinical Infectious Diseases. 60 (11): 1611–9. doi:10.1093/cid/civ144. PMID 25725054.
- Welsh, RM; Che, JW; Brehm, MA; Selin, LK (May 2010). "Heterologous immunity between viruses". Immunological Reviews. 235 (1): 244–66. doi:10.1111/j.0105-2896.2010.00897.x. PMC 2917921. PMID 20536568.
- Welsh, RM; Selin, LK (June 2002). "No one is naive: the significance of heterologous T-cell immunity". Nat Rev Immunol. 2 (6): 417–26. doi:10.1038/nri820. PMID 12093008.
- Selin, LK; Wlodarczyk, MF; Kraft, AR; Nie, S; Kenney, LL; Puzone, R (June 2011). "Heterologous immunity: immunopathology, autoimmunity and protection during viral infections". Autoimmunity. 44 (4): 328–47. doi:10.3109/08916934.2011.523277. PMC 3633594. PMID 21250837.
- Kleinnijenhuis, J; Quintin, J; Preijers, F; Joosten, LAB; Ifrim, DC; Saeed, S (23 Oct 2012). "Bacille Calmette-Guerin induces NOD2-dependent nonspecific protection from reinfection via epigenetic reprogramming of monocytes". Proc Natl Acad Sci U S A. 109 (43): 17537–42. doi:10.1073/pnas.1202870109. PMC 3491454. PMID 22988082.
- Aaby, P; Benn, CS (23 Oct 2012). "Saving lives by training innate immunity with bacille Calmette-Guerin vaccine". Proc Natl Acad Sci U S A. 109 (43): 17317–8. doi:10.1073/pnas.1215761109. PMC 3491466. PMID 23071307.
- WHO (22 November 2002). "Global Advisory Committee on Vaccine Safety, 20–21 June" (PDF). Weekly Epidemiological Record. 77 (47): 389–404. Retrieved 7 May 2015.
- Farrington, CP; Firth, MJ; Moulton, LH; Ravn, H; Andersen, PK; Evans, S (2009). "Epidemiological studies of the non-specific effects of vaccines: II - methodological issues in the design and analysis of cohort studies". Trop Med Int Health. 14 (9): 977–85. doi:10.1111/j.1365-3156.2009.02302.x. PMID 19531116.
- Shann, F; Nohynek, H; Scott, JA; Hesseling, A; Flanagan, KL (2010). "Randomized Trials to Study the Nonspecific Effects of Vaccines in Children in Low-Income Countries". Pediatric Infectious Disease Journal. 29 (5): 457–61. doi:10.1097/inf.0b013e3181c91361. PMID 20431383.
- Fine, PEM; Williams, TN; Aaby, P; Källander, K; Moulton, LH; Flanagan, KL (2009). "Epidemiological studies of the 'non-specific effects' of vaccines: I - data collection in observational studies". Trop Med Int Health. 14 (9): 969–76. doi:10.1111/j.1365-3156.2009.02301.x. PMID 19531117.
- WHO (18 July 2008). "Meeting of Global Advisory Committee on Vaccine Safety". Wkly Epidemiol Rec. 83 (32): 285–92. PMID 18689006.
- WHO. "Systematic Review of the Non-specific Immunological Effects of Selected Routine" (PDF). WHO. The Oxford University. Retrieved 7 May 2015.