Article Text

Original research
Prediction of severe immune-related adverse events requiring hospital admission in patients on immune checkpoint inhibitors: study of a population level insurance claims database from the USA
  1. Mark Kalinich1,
  2. William Murphy1,2,3,
  3. Shannon Wongvibulsin3,4,
  4. Vartan Pahalyants1,2,3,
  5. Kun-Hsing Yu5,
  6. Chenyue Lu5,
  7. Feicheng Wang5,
  8. Leyre Zubiri6,
  9. Vivek Naranbhai6,7,
  10. Alexander Gusev7,
  11. Shawn G Kwatra4,
  12. Kerry L Reynolds6 and
  13. Yevgeniy R Semenov3
  1. 1Harvard Medical School, Boston, Massachusetts, USA
  2. 2Harvard Business School, Boston, Massachusetts, USA
  3. 3Department of Dermatology, Massachusetts General Hospital, Boston, Massachusetts, USA
  4. 4Department of Dermatology, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
  5. 5Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
  6. 6Department of Oncology, Massachusetts General Hospital Cancer Center, Boston, Massachusetts, USA
  7. 7Department of Medicine, Dana-Farber Cancer Institute, Boston, Massachusetts, USA
  1. Correspondence to Dr Yevgeniy R Semenov; YSEMENOV{at}
  • MK and WM are joint first authors.

  • KLR and YRS are joint senior authors.

  • KLR and YRS are joint first authors.


Background Immune-related adverse events (irAEs) are a serious side effect of immune checkpoint inhibitor (ICI) therapy for patients with advanced cancer. Currently, predisposing risk factors are undefined but understanding which patients are at increased risk for irAEs severe enough to require hospitalization would be beneficial to tailor treatment selection and monitoring.

Methods We performed a retrospective review of patients with cancer treated with ICIs using unidentifiable claims data from an Aetna nationwide US health insurance database from January 3, 2011 to December 31, 2019, including patients with an identified primary cancer and at least one administration of an ICI. Regression analyses were performed. Main outcomes were incidence of and factors associated with irAE requiring hospitalization in ICI therapy.

Results There were 68.8 million patients identified in the national database, and 14 378 patients with cancer identified with at least 1 administration of ICI in the study period. Patients were followed over 19 117 patient years and 504 (3.5%) developed an irAE requiring hospitalization. The incidence of irAEs requiring hospitalization per patient ICI treatment year was 2.6%, rising from 0% (0/71) in 2011 to 3.7% (93/2486) in 2016. Combination immunotherapy (OR: 2.44, p<0.001) was associated with increased odds of developing irAEs requiring hospitalization, whereas older patients (OR 0.98 per additional year, p<0.001) and those with non-lung cancer were associated with decreased odds of irAEs requiring hospitalization (melanoma OR: 0.70, p=0.01, renal cell carcinoma OR: 0.71, p=0.03, other cancers OR: 0.50, p<0.001). Sex, region, zip-code-imputed income, and zip-code unemployment were not associated with incidence of irAE requiring hospitalization. Prednisone (72%) and methylprednisolone (25%) were the most common immunosuppressive treatments identified in irAE hospitalizations.

Conclusions We found that 3.5% of patients initiating ICI therapy experienced irAEs requiring hospitalization and immunosuppression. The odds of irAEs requiring hospitalization were higher with younger age, treatment with combination ICI therapy (cytotoxic T lymphocyte-associated 4 and programmed cell death protein 1 (PD-1) or programmed death-ligand 1 (PD-L1)), and lower for other cancers compared with patients on PD-1 or PD-L1 inhibitors with lung cancer. This evidence from the first nationwide study of irAEs requiring hospitalization in the USA identified the real-world epidemiology, risk factors, and treatment patterns of these irAEs which may guide treatment and management decisions.

  • Immunotherapy

Data availability statement

Data may be obtained from a third party and are not publicly available. The data are licensed unidentifiable insurance claims data from a national insurer.

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See

Statistics from


Immune checkpoint inhibitors (ICIs) are medications increasingly used to treat cancer that modulate the endogenous immune response. These medications block interaction of checkpoint proteins on tumor cells binding to T-cells, and include inhibition of programmed cell death protein 1 (PD-1), programmed death-ligand 1 (PDL-1), and cytotoxic T lymphocyte-associated 4 (CTLA-4) thus allowing immune activation.1–3 ICIs strengthen antitumor immunity, resulting in enhanced progression free survival and in many cases also overall survival in numerous cancer types.4 Expanding indications for ICIs have rapidly increased ICI use among patients with advanced malignancies, as the percentage of US patients with cancer eligible for ICI therapy has risen from 1.5% in 2011 to 38.5% in 2019.5 6

Activation of the immune system by ICIs can also result in complications of treatment known as immune-related adverse events (irAEs).7 irAEs commonly affect the skin, liver, gastrointestinal tract, and endocrine organs, and although the majority are mild, irAEs may range in severity from mild to life threatening and may require hospitalization with immunosuppression.3 8–13 irAEs are stratified by a clinical grading system which guides treatment decisions including whether to continue therapy, suspend therapy, or treat with immunosuppression.3 14–18 irAEs represent a considerable source of morbidity and mortality for the patient due to the adverse event itself, holding or discontinuing ICI therapy, and possible blunting of the ICI stimulated immune response through systemic immunosuppression.11 19 20

Predicting which patients are at risk of severe irAEs is challenging due to multiple factors: wide variability and lack of standardization in clinical definition of irAEs, lack of a specific International Classification of Disease (ICD) code to denote irAEs, and significant discordance among providers in classifying irAEs in clinical practice.10 21 22 Additionally, the data required to use the Common Terminology Criteria for Adverse Events grading system are frequently unavailable in Insurance Claims databases. Further, reporting of irAEs in clinical trials of ICIs has been shown to be inconsistent and suboptimal, indicating a need for standardized methodology to assess irAEs.23 Understanding which patients are at high risk prior to initiation of therapy would allow for early diagnosis and treatment of irAEs.24 Although there have been efforts to model the risk of irAEs among different classes of ICI therapy, previous studies have focused on clinical trial data,23 used single center data,24 or did not report detailed patient demographics for risk factors.25–27 Here, we propose a definition of irAE requiring hospitalization as hospitalization with new or escalated immunosuppression within 2 years of ICI therapy initiation, and identify factors associated with risk of irAEs requiring hospitalization using an Aetna national claims database from the USA.


Using unidentifiable Aetna insurance national claims data from January 2011 to December 2019, all patients receiving ICI treatment were identified by Current Procedural Terminology (CPT) procedure codes, and separated into three treatment groups, PD-1 or PD-L1, CTLA-4, and combination (CTLA-4 and PD-1/PD-L1) therapy. Combination therapy was defined as receiving ICI in two classes on the same day. Patient cancer diagnoses were identified using ICD codes, and stratified into major cancer groups: melanoma, lung cancer, renal cell carcinoma (RCC), bladder cancer, colon cancer, head and neck squamous cell carcinoma, Hodgkin’s lymphoma, gastric cancer, liver cancer, cervical cancer, breast cancer, prostate cancer, or Merkel cell carcinoma. ICD codes denoting a “personal history,” “cancers in situ,” or “benign” conditions were removed by searching the ICD code text for those strings. Patients with only one cancer diagnosis in the month preceding their first ICI treatment and who had at least three diagnosis codes with that cancer over the study period were included in the study population to minimize contribution from ICD coding errors. Patients with a primary cancer diagnosis of breast and prostate cancer were excluded, as these indications were not Food and Drug Administration (FDA) approved (except those with microsatellite instability-high) for the majority of the study duration28–30). For the analysis, cancers were grouped into melanoma, lung cancer, RCC, and other, which included bladder cancer, colon cancer, head and neck squamous cell carcinoma, Hodgkin’s lymphoma, gastric cancer, liver cancer, cervical cancer, or Merkel cell carcinoma. Demographic data, including age, gender, region, zip-code-imputed income, and zip-code-imputed unemployment from 2010 census data, were calculated for each patient. Charlson Comorbidity Index (CCI) score without contribution from cancer (as all patients had advanced cancer) was calculated for each patient using ICD codes prior to initiation of immunotherapy.31

irAEs requiring hospitalization were defined as any inpatient hospitalization associated with commencement of a new immunosuppressive drug not present in a claim in the 14 days prior to admission, or a dose escalation of an immunosuppressive medication that was present in a claim in the 14 days prior to admission (list of medications in online supplemental table 1) within 2 years after initiation of ICI. Combination ICI was defined as administration of two ICIs administered on the same day, and were codified into Nivolumab combination therapy (Nivolumab and any other ICI) and pembrolizumab combination therapy (pembrolizumab and any other ICI). All occurrences of combination therapy were with these two medications. Inpatient hospitalization was defined as place of service being coded as inpatient, with length of stay defined as the discharge date minus the admission date. Medication type and dose were identified by Healthcare Common Procedure Coding System (HCPCS) and National Drug Code (NDC) code. For each hospitalization, new immunosuppressive medications or a dose escalation of prior immunosuppressive medications were identified, and the highest treatment dose given of each was codified. When dosing was “up to” a certain dose, the maximum dose was used.

Supplemental material

Study outcomes

The primary study outcome is incidence of irAE,requiring hospitalization as defined as a hospitalization with new or dose escalation of immunosuppression within 2 years of ICI initiation. The secondary outcomes are hospitalizations without immunosuppression, intensive care unit (ICU) admission, and immunosuppressant treatment in irAE hospitalizations.

Statistical analysis

Analyses were performed in R V.3.6.3 (R Statistical Software). Continuous variables were compared with a t-test, and categorical variables were compared with the Pearson’s χ2. Linear regressions were performed on continuous variables, and logistic regressions performed on categorical variables. Where data were non-normal (eg, income), variables were normalized using the scale function in R.


There were 68.8 million patients identified in the national database. Fourteen thousand three hundred seventy-eight patients were identified as having received an ICI administration, an identified primary cancer, and complete demographic information. A summary of demographic characteristic is reported in table 1. The most commonly identified cancer for patients receiving an ICI was lung cancer (N=7393, 51.4%), followed by melanoma (N=3157, 22.0%), RCC (N=1486, 10.3%), and other cancers (N=2342, 16.3%) a group which includes bladder cancer, colon cancer, head and neck squamous cell carcinoma Hodgkin’s lymphoma, gastric cancer, liver cancer, cervical cancer, and Merkel cell carcinoma (table 1). The cumulative follow-up time in years after ICI commencement in the 14 378 ICIs recipients was 19 177 (median follow-up, 927 days for patients with irAE, 736 for patients without irAE), and the total number of irAE admissions identified during those years was 504. The overall incidence rate of irAEs requiring hospital admission per patient year was 2.6%, ranging from 0% in 2011 to 3.7% in 2016 (figure 1, table 2). The most common ICI drug exposure was to pembrolizumab, with 7574 (39.5%) patient years, followed by nivolumab with 7367 (38.4%) patient years, and ipilimumab 1561 (8.1%) patient years (table 2).

Table 1

Demographic, treatment, and outcome characteristics of patients with and without severe immune-related adverse event (irAE)

Figure 1

Incidence of immune-related adverse event (irAE) hospitalizations and total hospitalizations in patients on ICI therapy. CRC, colorectal cancer; HNSCC, head and neck squamous cell carcinoma; Merkel, Merkel Cell Carcinoma; RCC, renal cell carcinoma.

Table 2

Immune checkpoint inhibitor usage and immune-related adverse event (irAE) incidence over time

The incidence of irAEs requiring hospitalization as defined by hospitalization with new or escalated immunosuppression within 2 years of ICI initiation was 504/14 378 patients (3.5%) (table 2). irAEs requiring hospitalization were identified in 372 (3.3%) patients on PD-1 therapy, 12 (1.1%) on PD-L1 therapy, 42 (3.9%) on CTLA-4 therapy, and 78 (7.3%) on combination CTLA-4 and PD-1 or PD-L1 therapy. The average time from start date of ICI treatment to irAE requiring hospitalization was 168.2 days (range: 1–722). Seven thousand five hundred eighty-seven (53%) patients were hospitalized in 16 053 hospitalizations within 2 years of immunotherapy initiation. The total number of patients that were hospitalized more than once was 3888 (27%). Patients with irAE requiring hospitalization had more total hospitalizations than those without irAE requiring hospitalization in the 2 years after ICI initiation (3.1 vs 1 hospitalizations, p<0.001). Length of stay was greater for patients with irAEs requiring hospitalization than those without irAE requiring hospitalization (6 vs 3.1 days, p<0.001). Patients with irAE requiring hospitalization were more likely to be in the ICU than those without (0.06 vs 0.02 ICU visits per patient, p<0.001).

Multivariable modeling

Regressions were performed on the incidence of irAEs requiring hospitalization, all cause hospitalizations, and ICU stay (tables 3–5). In each regression, female patients with lung cancer on PD-1/PD-L1 therapy were used as the reference group.

Table 3

Multivariate regression results for incidence of severe immune-related adverse event

Table 4

Multivariate regression results for incidence of hospitalization

Table 5

Multivariate regression results for incidence of intensive care unit admission

Severe irAE incidence regression (table 3): compared with the reference group, combination ICI therapy (anti-PD-1/PD-L1 and CTLA-4) was associated with increased odds of irAE requiring hospitalization (OR: 2.44, p<0.001). Older patients (OR 0.98 per additional year, p<0.001), patients with other cancers (OR 0.50, p<0.001), patients with melanoma (OR 0.71, p=0.01) and patients with RCC (OR 0.71, p=0.03) were associated with decreased odds of a irAE requiring hospitalization than the reference group.

Hospitalization incidence regression (table 4): compared with the reference group, anti-CTLA-4 therapy (OR: 2.34, p<0.001), combination ICI therapy (OR: 1.70, p<0.001), and higher non-cancer CCI (OR: 1.06, p<0.001) were associated with increased odds of all cause hospitalization. Patients with melanoma were associated with decreased odds of all cause hospitalization compared with the reference group (OR: 0.55, p<0.001). Region was also associated with all cause hospitalization, notably decreased in the Pacific region (OR: 0.69, p<0.001).

ICU stay incidence regression (table 5): compared with the reference group, older patients were associated with decreased odds of all cause admission to the ICU (OR: 0.97 per additional year, p<0.001). Patients with an irAE hospitalization (OR: 2.60, p<0.001), higher non-cancer CCI (OR: 1.07, p=0.01), and higher zip code average income (OR: 1.19, p=0.01) were associated with increased odds of all cause ICU admission than the reference group.

Immunosuppressant use in hospitalizations

Of the immunosuppressants identified in online supplemental table 1), prednisone (72%) and methylprednisolone (25%) accounted for the majority of immunosuppressant medications found in irAE hospitalizations. The remaining identified immunosuppressants each accounted for less than 1% immunosuppressive medications identified during an irAE hospitalization: azathioprine, cyclosporine, everolimus, infliximab, methotrexate, mycophenolate, sirolimus, and tacrolimus (table 6).

Table 6

Number of immune-related adverse events hospitalizations with administration of immunosuppressants


ICIs have shown great promise in treating a variety of advanced cancers. However, activation of the immune system during treatment frequently leads to immune-related adverse events in many patients. This study describes the experience of ICI use and the incidence of irAEs requiring hospitalization for patients in a national Aetna insurance database, and proposes an algorithm to identify and study irAEs requiring hospitalization using claims data. The results of this study can be used to identify patients at higher risk of being admitted with irAE and enable analysis of other large claims databases to compare experience across payors and institutions.

Our study showed that the absolute incidence of irAEs requiring hospitalization in the study population increased over time from 2011 to 2019, a finding that is consistent with the increased use of ICI over that time period. We demonstrate that combination therapy is associated with increased odds of irAE requiring hospitalization, which is in agreement with prior findings that combination therapy32 and CTLA-4 therapy23 33–35 are associated with higher incidence of irAEs relative to PD-1 or PD-L1 treatment. The incidence of irAEs requiring hospitalization in this study was 3.5% overall, with 3.3% for patients receiving PD-1, 1.1% for patients receiving PD-L1, 3.9% for patients receiving CTLA-4 therapy, and 7.3% for patients on combination therapy. These figures are lower compared with early estimates of clinical trial data, which reported high-grade irAEs in 6.3% of patients with PDL-1, 7.1% of patients taking PD-1, 21.5% of patients taking CTLA-4, and 54.8% in CLTA-4 and PD-1 combination therapy.34 Similarly, a meta-analysis of phases II and III clinical trials showed incidence of grade 3 or 4 immune-related adverse events for atezolizumab, nivolumab, pembrolizumab, and ipilimumab of 15.1%, 14.1%, 19.8%, and 28.6%, respectively.36 However, a recent publication identified a similar rate (3.6%) of high-grade (grade 3+) irAEs in a single-center experience with PD-1 therapy.24 The lower rate found in our population relative to clinical trial data may be representative of less toxic ICI treatment regimens or reflect real-world treatment patterns and identification of high-grade events outside of clinical trial settings. Additionally, our study would not include irAE admissions where immunosuppression is not indicated for treatment, such as endocrinopathies. In our study, average hospitalization length of stay for irAE patients was 6 days, which is consistent with previous study results.32 Our study reports that patients with severe irAEs were more likely to have an ICU admission (OR 2.60, p<0.001), which is not a widely reported outcome in large scale ICI studies.34

As ICI indications have expanded and use of ICIs has continued to grow, the percentage of patients with cancer eligible for ICI therapy has been estimated at up to 38.5% in 2019, representing up to 233 790 potential US ICI patients treated with standard of care therapy alone.6 If, as in our study population, 3.5% of patients receiving ICI therapy experience irAEs requiring hospitalization, that would represent approximately 8200 hospitalizations if all eligible patients received therapy—a population that is expected to grow.6 This increasing incidence of irAEs requiring hospitalization necessitates greater knowledge and training among emergency department, primary care, internal medicine, and specialty providers to accurately diagnose and treat severe immune-related adverse events.37 If these irAEs are not treated appropriately, there is risk of substantially increased morbidity and mortality.26

Additionally, these data show that older age is protective of both irAEs requiring hospitalization and ICU stay. Previous studies have shown mixed results between age and the risk of irAE in ICI recipients, with alternate studies finding no association between age and irAEs,7 higher incidence with older patients38 and higher incidence with younger patients.39 With regards to the likelihood of ICU stay, our findings are similar to a single center study showing that patients <70 years old have a higher likelihood of an ICU stay as well as longer ICU stays than older patients.38 This may be due to relatively less severe irAEs, immune senescence in older patients, differing goals of care, more cautious treatment in the elderly, lower proportion of combination ICI therapy in the elderly, or a combination of all. Male gender was not predictive of irAE, hospitalization, or ICU stay in our study. A study reviewing PD-1 therapy found a greater incidence of all grade irAEs in women, but no gender difference in high-grade irAEs, which is more similar to the irAE definition in this study.40 This study also showed that severe irAEs are more frequent among patients with lung cancer than patients with RCC, melanoma, or other primary cancers. The difference in incidence may be due different provider experience using ICI therapy among these cancer types. Although previous studies have shown differences in type of irAEs for different primary cancers,33 the current analysis of irAEs requiring hospitalization defines the overall likelihood of developing an irAE requiring hospitalization by primary cancer.

We show that by far the most frequent immunosuppressive treatments used with patients on ICIs in this study are prednisone (72%) and methylprednisolone (25%), with limited use of other immunosuppressants. This is consistent with guidance that grade 3+irAEs should be treated with prednisone or methylprednisolone, and other immunosuppressants such as infliximab should be reserved for those who do not respond to initial therapy.3 This result signifies that few (3%) hospitalizations for severe irAEs require immunosuppressive medication other than prednisone or methylprednisolone. These data imply that in our population, refractory irAEs requiring second line immunosuppression are not common, and incidence of such refractory toxicities is likely low.

This analysis is limited by a retrospective study design, lack of comprehensive mortality data, and inability to review chart-level data to determine clinician interpretation of suspected irAEs. As a result, our definition of severe irAEs is likely overly strict and limited to patients with more severe events than what has been previously reported in literature. In particular, this definition of severe irAE used in this analysis would not include low-grade toxicities that did not result in hospitalization with new or escalated immunosuppression, and as such the results may not be generalizable to low-grade irAE and the overall number is likely underestimated. Additionally, the definition of severe irAE in this analysis is impacted by regional, hospital system, and individual provider capabilities and practice patterns; for example, the ability of a hospital to provide emergency care for an irAE in the inpatient setting. Also, as our inclusion criteria involve selecting for patients with cancer diagnosis codes in a post-treat matter, it may incur collider bias. In this first, population-level analysis of immunotherapy toxicities in the USA, we describe a method of querying large, insurance claims databases for suspected high-grade irAEs and identify the incidence, risk factors, and outcomes associated with severe irAEs. We further identified patient factors that can be used to predict the likelihood of severe irAEs and lay the methodological basis for future research on this topic utilizing insurance claims data. Additionally, we described that patients with an identified irAE hospitalization have more total hospitalizations in the 2 years after starting ICI (3.1 vs 1 hospitalizations), and the length of stay for irAE hospitalizations is double that for non-irAE hospitalizations (6 vs 3.1 days). This, coupled with the increasing incidence of ICI use, underscore the importance of understanding the likelihood of and factors related to severe irAEs and large, population-level databases will enable researchers to answer important questions regarding risk factors and outcomes for severe irAEs that cannot be answered in clinical trials or with individual studies. It is critical that we build on this study to further refine queries and that open-access is granted to replicate these important findings across other databases.

Data availability statement

Data may be obtained from a third party and are not publicly available. The data are licensed unidentifiable insurance claims data from a national insurer.

Ethics statements

Ethics approval

The Harvard Medical School Institutional Review Board granted blanket approval for the use of the de-identified claims database.


The authors thank Susan Churchill of the Department of Biomedical Informatics in the Blavatnik Institute at Harvard Medical School and Kathe Fox of Aetna for providing assistance with claims data access.


Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.


  • MK and WM contributed equally.

  • Contributors MK and WM contributed equally to this manuscript. KLR and YRS contributed equally to this manuscript. MK, WM, SW, VP, and CL performed analyses, contributed to study design, and drafted the manuscript. K-HY, FW, LZ, VN, AG, SK, KLR, and YRS contributed to study design, and manuscript review.

  • Funding This work was supported by the National Institutes of Health: 5T32GM007309, T32GM007753, and F30CA224588 awarded to Wongvibulsin, S and Kalinich, M. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Yu, KH is supported in part by the Blavatnik Center for Computational Biomedicine Award.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.