Article Text

Download PDFPDF

1266 Utilizing predictive modeling to risk stratify patients to low versus high grade immune checkpoint inhibitor therapy-related pneumonitis
  1. Antonious Hazim,
  2. Jacob Shreve,
  3. Irene Riestra Guiance,
  4. Damian McGlothlin,
  5. Gordon Ruan,
  6. Keith Mcconn,
  7. Robert Haemmerle,
  8. Konstantinos Leventakos,
  9. Ashley Egan and
  10. Svetomir Markovic
  1. Mayo Clinic, Rochester, MN, USA
  • Journal for ImmunoTherapy of Cancer (JITC) preprint. The copyright holder for this preprint are the authors/funders, who have granted JITC permission to display the preprint. All rights reserved. No reuse allowed without permission.


Background Immune checkpoint inhibitor therapy-related (ICI) pneumonitis is a potential serious complication for patients with cancer. We have previously shown that modeling can be used to predict the risk of death from ICI pneumonitis.1 Further predictive modeling to risk stratify patients with ICI pneumonitis is needed.

Methods A database of cancer patients diagnosed with ICI pneumonitis seen at Mayo Clinic from 2014–2022 was utilized for exploratory data analysis. Within this cohort, we isolated clinical variables from before ICI pneumonitis diagnoses to determine if we could model the propensity for developing low grade (1–2) versus high grade (3–4) pneumonitis at the time of immunotherapy initiation. Those clinical variables included age, sex, weight, common laboratory values, immunotherapy treatment, cancer type, and baseline pulmonary function tests (PFTs). We used a gradient boosting machine learning technology, Xgboost2 to conduct binary classification. Given the relatively small cohort size for AI analysis (n = 170), modeling was conducted with 1,000-fold bootstrapping to minimize dependence on data arrangement and k-fold cross validation to minimize model overfitting. Model reverse engineering was done with Shapley statistics3 to determine which features had the largest contribution. Once identified, only those highly weighted features were used for logistic regression analysis providing more reproducible predictions by decreasing model variance.

Results 170 patients with ICI pneumonitis were included (median age 67; range 25–87). The severity of ICI pneumonitis was as follows: grade 1 (n=16, 9%), grade 2 (n=86, 51%), grade 3 (n=57, 34%), and grade 4 (n=11, 6%). 47 patients (28%) had another ICI toxicity. Median overall survival was 2.5 years (95%, CI: 1.8-NR). A higher grade of ICI pneumonitis was associated with inferior survival (HR 2.0, 95% CI 1.5–2.8, p<0.001). Our approach resulted in a low versus high grade pneumonitis binary classification model with an area under the curve of the receiver operator characteristic of 0.74 (figure 1). The features most predictive of whether a patient would develop high grade pneumonitis were baseline DLCO obtained from PFTs, hemoglobin concentration, monocyte count, total white blood cell count, and immunotherapy choice.

Conclusions We demonstrate that commonly available clinical data can be used to risk stratify patients to low versus high grade ICI pneumonitis. Further effort is needed to produce clinical models able to provide clinician decision support when evaluating patients with ICI toxicities. Investigation is underway which uses a large cancer data set to independently validate this model and to predict who will develop immunotherapy toxicities.


  1. Hazim A, et al. Utilizing predictive modeling to identify patients at high risk of death from immune checkpoint inhibitor therapy-related pneumonitis. Journal of Clinical Oncology. 2023;41(16_suppl):1552–1552.

  2. Chen T, He T, Benesty M, Khotilovich V, Tang Y, Cho H, Chen K, Mitchell R, Cano I, Zhou T. Xgboost: extreme gradient boosting. R package version 0.4–2 , 2015;1(4):1–4.

  3. Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Advances in neural information processing systems , 2017; 30 .

Ethics Approval This study was approved by the Mayo Clinic IRB.

Abstract 1266 Figure 1

Area under the curve of the receiver operator characteristic (AUC-ROC) from modeling propensity of low grade versus high grade immune checkpoint inhibitor therapy-related pneumonitis

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.