Discussion
Principal findings
In this umbrella review, we evaluated the range, strength, and validity of reported associations between environmental risk factors and non-Hodgkin's lymphoma across 85 meta-analyses of published observational studies. Overall, we identified 257 associations for 134 unique environmental risk factors and 10 non-Hodgkin's lymphoma subtypes. The vast majority of the associations, including those evaluating various dietary, clinical, lifestyle, chemical, and occupational exposures, were classified as having either non-significant or weak evidence. Only 5% of the associations, primarily those for autoimmune and infectious disease related risk factors, presented either highly suggestive or convincing evidence. When the same associations were evaluated in meta-analyses of summary level data and InterLymph meta-analyses of individual participant data, only half were in the same direction, had the same level of statistical significance, and had overlapping 95% confidence intervals. Overall, effect sizes from meta-analyses of individual participant data were more conservative.
This umbrella review suggests evidence of many low quality meta-analyses of summary level data reporting weak associations between environmental risk factors and non-Hodgkin's lymphoma. These findings highlight the need for improving not only primary studies but also evidence synthesis in this field. Moreover, given that many of the assessed risk factors are correlated, simultaneous consideration of multiple risk factors will be useful to understand which ones have the strongest, independent effects on non-Hodgkin's lymphoma risk.
Context of primary findings
Although a wide range of environmental exposures have been evaluated and proposed as potential risk factors for non-Hodgkin's lymphoma, our evaluation suggests that the only highly suggestive or convincing exposures proposed in meta-analyses of summary level data and meta-analyses of individual participant data are related to autoimmune and infectious diseases. In particular, the prominent risk factors related to autoimmune disease include history of coeliac disease, rheumatoid arthritis, primary Sjogren’s syndrome, and systemic lupus erythematosus. Although the exact mechanisms behind these associations remains unclear, many autoimmune disorders are characterised by chronic inflammation,39–41 which could intensify B cell or T cell activation and promote the development of lymphoma.42 43 Previous studies have also suggested that the dysfunction of some protein families, such as Fas ligand and tumour necrosis factor, and the interplay between various immune cells, could be potential mechanisms.44 However, the temporality of these associations is unclear, with studies reporting that autoimmune diseases can occur during lymphoma.45 46
Associations between viral and bacterial infections and non-Hodgkin's lymphoma risk have been suggested for several decades.2 5 6 47 48 Different hypotheses for hepatitis C related lymphomagenesis have been proposed. For instance, chromosomal aberrations, including chromosome t(14;18) translocation, have been found to be associated with mixed cryoglobulinemia, a disorder most commonly caused by hepatitis C infection and that can evolve into lymphoproliferative disorders.49–51 Furthermore, genetic variations, including interleukin 10 polymorphisms, have also been proposed as a pathway between hepatitis C infection and non-Hodgkin's lymphoma susceptibility and development.52 Similar to risk factors related to autoimmune disease, whether these associations are driven by disease status, drug treatment use, or disease-treatment interactions is unclear.53–57 Considering how rare many of these autoimmune and infectious disease related exposures are, future efforts are necessary to determine the impact of multiple environmental as well as non-environmental risk factors simultaneously.5 6
Among 40 associations evaluated by both meta-analyses of summary level data and InterLymph meta-analyses of individual participant data, only half were in the same direction, had the same level of statistical significance, and had overlapping 95% confidence intervals. Unlike meta-analyses of summary level data, meta-analyses of individual participant data tend to focus on studies with more homogeneous designs and patient populations. Furthermore, meta-analyses of individual participant data can allow for better harmonisation of data across studies, more advanced one stage meta-analytical approaches, and analyses accounting for many exposure categories and potential confounders.58 59 Although the InterLymph meta-analyses of individual participant data are particularly robust owing to the large number of non-Hodgkin's lymphoma cases and subtypes considered, meta-analyses of individual participant data without systematic reviews can exclude evidence from high quality case-control or cohort studies. For instance, the InterLymph analyses only included evidence from completed and ongoing case-control studies from consortium members.
Furthermore, the InterLymph findings might be difficult to disentangle, with at least 700 nominally significant associations among thousands of analyses conducted across different subtypes of non-Hodgkin's lymphoma and exposure levels (eg, different type or dosage of alcohol consumption). In the future, the consistency between meta-analyses of summary level data and meta-analyses of individual participant data will need to be monitored, especially because about half of the meta-analyses of summary level data had at least a third of the same component studies as the meta-analyses of individual participant data. In addition, authors of meta-analyses should carefully evaluate whether any external studies can and should be included in their syntheses. We also observed that more than two thirds of the effect sizes were more conservative in the InterLymph meta-analyses of individual participant data than in the meta-analyses of summary level data. This observation might reflect greater selective reporting bias in the studies available in the literature than in a set of studies participating in a consortium.
Our study suggests that nearly all meta-analyses of summary level data evaluating associations between environmental risk factors and risk of non-Hodgkin's lymphoma could be classified as having critically low quality according to the AMSTAR 2 tool. Previous umbrella reviews focused on the associations between environmental risk factors and health outcomes have noted similar concerns. However, the proportion of non-Hodgkin's lymphoma reviews with low or critically low quality is higher than what has been observed among umbrella reviews for inflammatory bowel diseases,60 attention deficit or hyperactivity disorder,61 eating disorders,62 early childhood caries,63 physical activity for academic achievement,64 and physical therapy for tendinopathy.65 These findings might not be surprising considering recent concerns about the mass production of systematic reviews.66 67 Authors should also critically evaluate how their findings relate to existing meta-analyses of individual participant data, focusing on the impact of different methods, populations, and other characteristics.
Limitations of the study
Our umbrella review had several limitations. First, we did not identify potential environmental risk factors that were only examined in individual observational studies. Our objective was to identify and summarise the associations that were reported by the meta-analyses of summary level data, which already covered a wide space of diverse associations. Second, we did not evaluate the quality of individual studies included in the meta-analyses of summary level data, the impact that individual studies have on the overall heterogeneity, the magnitude of the associations, or the potential role that residual or unmeasured confounding could have on associations. Individual risk-of-bias evaluations are outside the scope of umbrella reviews, and it is the expectation that meta-analyses have already conducted these quality assessments. Third, we considered meta-analyses that included cohort and case-control studies, and our assessments did not prioritise reviews of certain study designs or look at differences across different study designs. Considering that certain non-Hodgkin's lymphoma subtypes are rare, case-control studies might often be the most realistic study design to evaluate exposure histories.
Fourth, although umbrella reviews provide a comprehensive summary of the associations reported in meta-analyses, the validity of the summary effect estimates depends on the quality of the individual meta-analyses. Although we attempted to standardise associations using a random effects DerSimonian and Laird estimator, we did not evaluate or re-conduct the literature searches for all potential associations between exposure and outcome. Different approaches can affect the width of the confidence intervals (ie, Wald v Hartung-Knapp-Sidik-Jonkman). In our evaluation, these differences were unlikely to affect the associations that were classified as highly suggestive or convincing. Given that the Hartung-Knapp-Sidik-Jonkman method has been found to outperform the standard DerSimonian and Laird method in certain scenarios, future meta-analyses should consider this approach in their analyses.68–70
Fifth, we did not calculate I2, 95% prediction intervals, Egger’s test, and excess significance test for non-significant and nominally significant associations. Given the large number of associations identified, we prioritised these calculations for associations where these values were necessary to determine the strength of associations using the previously established classification system.19 Other tests might be more appropriate (eg, Peter’s test v Egger’s test to examine small study effects71) and I2 values should not be used to make inferences about heterogeneity, because it does not measure heterogeneity directly but rather the proportion of total variability due to variability between studies.72 However, we used the same approaches as previous umbrella reviews.25 61
Sixth, when summary effect estimates of multiple exposure contrast levels were reported, we also focused on the risk estimates comparing ever versus never exposure (or comparing the highest v lowest levels of exposures). Although we did not consider all potential contrast levels and dose-response relations, our objective was to provide a universal overview of the associations between examined risk factors and non-Hodgkin's lymphoma. Specific dose-response relations might nevertheless exist for certain associations, and they would need to be examined on a case-by-case basis.
Seventh, we only identified the nominally statistically significant associations among the thousands of associations reported in InterLymph meta-analyses of individual participant data. Eight, by excluding non-English language reviews, we could have missed additional potential associations; however, we used the same approach as previous umbrella reviews that focused on risk factors for health outcome(s).60 73
Ninth, meta-analyses of individual participant data and meta-analyses of summary level data can have different strengths and limitations, and our evaluation did not focus on comparing the potential quality of these types of studies. We also did not focus on the impact of different methods, populations, or other characteristics when comparing the consistency of the results between the two study types. Tenth, umbrella reviews are also not intended to provide information about the likelihood that associations are causal. Lastly, when multiple meta-analyses of summary level data evaluated the same exposures and outcomes, we selected the association based on the largest number of included studies. Although this approach does not ensure that the highest quality meta-analyses are selected, this methodology has been used by previous umbrella reviews.25 73–75
Conclusion
In this large scale umbrella review, we identified dozens of meta-analyses evaluating associations between environmental risk factors and non-Hodgkin's lymphoma. However, the vast majority of meta-analyses of summary level data were low quality and presented either non-significant or weak evidence. When the same associations were evaluated in meta-analyses of summary level data and meta-analyses of individual participant data, only half were in the same direction, had the same level of statistical significance, and had overlapping 95% confidence intervals. Although several associations, primarily those for risk factors related to autoimmune and infectious diseases, presented either highly suggestive or convincing evidence, these findings highlight the need for improving not only primary studies but also evidence synthesis in evaluations of environmental risk factors and of non-Hodgkin's lymphoma.