Article Text

Download PDFPDF

Original research
Novel platform leveraging electronic medical record (EMR) to triage patients admitted with high-grade immune-related adverse events (irAEs) to the immune-toxicity (ITOX) service
  1. Osama Abu-Shawer1,
  2. Prabhsimranjot Singh1,2,3,
  3. Eric Yenulevich2,3,
  4. Amanda Brito1,2,3,
  5. Jian Ni3,
  6. Raja-Elie E Abdulnour1,2,3,
  7. Shilpa Grover1,2,3,
  8. Michael Manos2,
  9. Peter Bowling2,
  10. Nicole R LeBoeuf1,2,4,
  11. Patrick Ott1,2,3,
  12. F Stephen Hodi1,2,3,
  13. Joseph Jacobson1,2,3 and
  14. Osama Rahma1,2,3
  1. 1Harvard Medical School, Boston, Massachusetts, USA
  2. 2Oncology, Dana Farber Cancer Institute, Boston, Massachusetts, USA
  3. 3Internal Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
  4. 4Dermatology, Brigham and Women's Hospital, Boston, Massachusetts, USA
  1. Correspondence to Dr Osama Rahma; osamae_rahma{at}


Background The incidence of high-grade immune-related adverse events (irAEs) due to immune checkpoint inhibitors (ICIs) is increasing due to the rapid expansion of indications for their use. There is an urgent need for a feasible approach of identifying patients with high-grade irAEs to ensure early detection and proper management of this unique set of toxicities.

Methods We established one of the first inpatient services that are specifically devoted to mitigating irAEs. The service uses a multidisciplinary approach with consulting service from experts in managing irAEs. We are leveraging the electronic medical record (EMR) to triage patients who are admitted to the hospital and have received or are currently receiving ICIs. A list of patients with ICI exposure is generated daily by EMR and then curated manually to identify patients with potential irAEs.

Results A total of 129 patients with high-grade irAEs were admitted between June 2018 and June 2019. The most common irAEs were colitis (32%), pneumonitis (30%), and hepatitis (14%). Eighty five per cent of the patients had grade 3 irAEs and 15% had grade 4–5. About half of the patients had received ICI monotherapy; 30% had received combination of ICIs and non-ICIs; and 19% had received a combination of ICIs. Only 9% of patients had steroid-refractory irAEs requiring other immunosuppressive agents. The average length of stay for irAE-related admission was 11 days with a readmission rate due to recurrent irAEs of 26% within a year.

Conclusion We demonstrated the feasibility of using the EMR to accurately triage patients with suspected irAEs to a dedicated immune-toxicity service. Our model is adaptable in major academic centers and could have a major impact on quality of care and future clinical research addressing irAEs.

  • active
  • immunotherapy
  • autoimmunity

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See

View Full Text

Statistics from


Immunotherapy has recently taken cancer therapy into a new era due to the expansion of immune checkpoint inhibitors (ICIs) activities and indications.1–3 As the field of cancer immunotherapy rapidly evolves, greater understanding of the mechanisms of ICI-induced toxicities is needed. Several mechanisms have been implicated including direct binding of the antibodies to cytotoxic T lymphocyte-associated antigen 4 (CTLA-4) on normal tissue (eg, pituitary gland), antigen cross-reactivity between tumors and healthy tissue, increased humoral response of pre-existing autoantibodies, and the induction of pro-inflammatory cytokines.4 5 The patterns, incidence, and severity of immune-related adverse events (irAEs) vary between programmed death-ligand 1 (PD-L1), programmed death-1 (PD-1), and CTLA-4 inhibitors with higher incidence of grade 3–4 irAEs using CTLA-4 antibodies as single agents (30%–40%) or in combination with PD-1 antibodies (50%) compared with single agent PD-1 or PD-L1 inhibitors (10%–20%).6–9 However, the real-world data (RWD) revealed even higher incidence of specific irAEs (eg, pneumonitis) compared with what has been reported in clinical trials. This highlights the importance of collecting RWD as patient characteristics differ between the general population and patients on trials.10 As the field of immunotherapy moves toward combinatorial regimens, the incidence of irAEs is expected to increase, which is concerning as severe irAEs can lead to treatment interruption, discontinuation and can be fatal.11

Realizing the unmet need to identify and appropriately treat patients with irAEs, the Immune Toxicity Work Group at Dana-Farber Cancer Institute (DFCI) and Brigham and Women’s Hospital (BWH) was established. This work group consists of experts in the field of immunotherapy and medicine subspecialists (gastroenterology, pulmonology, endocrinology, dermatology, rheumatology, nephrology, cardiology, and neurology) with expertize in managing toxicities in oncology patients. Subsequently, we developed and implemented clinical management guidelines of irAEs based on the published American Society of Clinical Oncology (ASCO)and National Comprehensive Cancer Network (NCCN) guidelines which were modified as per the recommendations of our toxicity experts.12 13 The Immune Toxicity Work Group launched the immune-toxicity (ITOX) service in June 2018, an inpatient service that is devoted to treating patients who are admitted with irAEs. In order to rapidly detect and properly treat patients with high-grade irAEs, we leveraged the electronic medical record (EMR) platform, Epic, to identify patients with potential irAEs and triage them to the ITOX service. Here, we describe our unique experience including the methodology used, the patterns of irAEs observed, the characteristics of toxicity management, treatment course, and outcomes.


ITOX service structure

An automated daily list of all patients who have received ICIs, have a cancer diagnosis, and were either admitted to inpatient medical oncology or evaluated in the EMR is generated in Epic. This list is then reviewed each morning by a physician assistant (PA), and patients admitted for potential irAEs are then triaged to the ITOX service (online supplemental figure 1). ITOX service is one out of 13 inpatient oncology services at DFCI/BWH. The ITOX service is staffed by two PAs and a medical oncologist and supported by specialists from all medicine subspecialties with expertize in the management of relevant irAEs.

Supplemental material

Data collection and analysis

We performed a retrospective chart review that was approved by the Institutional Review Board (IRB) at DFCI and BWH to report our experience during the first year since the inception of ITOX. We included all cancer patients who were treated with any type of ICI (ipilimumab, tremelimumab, pembrolizumab, nivolumab, atezolizumab, avelumab, or durvalumab) as a part of their standard of care treatment or on clinical trial, as single agents or in combination with other therapies, and were admitted to BWH due to high-grade irAEs between June 2018 and June 2019. Clinical data including patients and tumor characteristics such as primary tumor, current cancer treatment regimens, concurrent or recent radiotherapy exposure, prior cancer treatment were extracted from the charts. The admission data including number and length of irAE-related admissions, and the admitting inpatient services (ITOX, non-ITOX, or intensive care unit (ICU)) were collected. IrAE data included type(s) of irAEs, Common Terminology Criteria for Adverse Events (CTCAE) V.5.0 grade of irAE, imaging and pathology findings (if any), systemic steroids and/or immunosuppressive therapy administration, and cause(s) of cancer treatment discontinuation (due to irAEs or not). If the grades of irAEs were not documented in the chart by the primary team, the data abstractor who is an oncologist or medical specialist graded the irAEs using the NIH CTCAE V.5.0. In the absence of alternative diagnoses, irAEs were confirmed pathologically or clinically by marked response to steroids and/or other immunosuppressive agents. The designation of ‘multiple irAEs’ was defined as having irAEs involving ≥2 organs at the time of admission. The data were reviewed by a second medical reviewer to ensure its quality and stored in a REDCap database.

Biospecimen collection

The ITOX service established an IRB-approved biospecimen banking protocol to collect blood and tissue samples from patients at the time of suspected irAE. Patients eligible for this protocol were identified by reviewing the ITOX inpatient list daily by the clinical coordinators. The patients were then approached during their hospitalization and provided with information on the study; if a patient was willing to participate, the informed consent is obtained, and specimens collected as appropriate.


Patients characteristics

A unique 129 patients who received at least one course of ICIs at DFCI were admitted to inpatient medical oncology with high-grade irAEs between June 2018 and June 2019. The clinical characteristics of the patients are summarized in table 1. Half of the patients were men with a median age of 65 years. The most common tumor types were thoracic (30%), genitourinary (24%), skin (18%), breast (9%), gastrointestinal (8%), head & neck (5%), endocrine (3%), and others (1%) (figure 1). Half of the patients (51%) received ICI monotherapy (anti-PD-1 86%, anti-PD-L1 11%, anti-CTLA-4 3%), a one-third (30%) of the patients received a combination of ICI and non-ICI therapy, and 19% of the patients received a combination of ICIs (anti-PD-1 and anti-CTLA-4) (figure 2). In 13% of patients, prior treatment regimens included ICIs (anti-PD-1 monotherapy or in combination with anti-CTLA-4). Twenty-three per cent of patients had been exposed to radiotherapy concurrently with ICI (5%) or within a year prior to the initiation of ICI (17%). Around 90% of patients discontinued ICI treatment as a result of either toxicity (81%), progression of the disease (14%), or death (3%).

Figure 1

Tumor type. Others include glioblastoma multiforme and sarcoma.

Figure 2

Treatment modality. ICI, immune checkpoint inhibitor.

Table 1

The clinical characteristics of patients

The clinical patterns and management course of irAEs

There was a total of 194 irAE-related admissions between June 2018 and June 2019, 72% of admissions were appropriately triaged to the ITOX service and the rest to the other inpatient services (table 2). The most common types of irAEs were colitis/enteritis (32%), pneumonitis (28%), and hepatitis (13%) (figure 3). Twenty-five per cent of patients had multiple irAEs at the time of admission (figure 4). Most patients (85%) had severe (CTCAE Grade 3) irAEs, while 11% of the patients had life-threatening (CTCAE Grade 4) irAEs, and only 4% of the patients developed fatal (CTCAE Grade 5) irAEs (figure 5). Of fatal irAEs, the most common toxicity was pneumonitis which occurred in four out of five cases, and there was one case of myocarditis. Of cases defined as life-threatening, patients presented with pneumonitis (8)colitis (5), and encephalitis (1). Most patients with irAEs received steroid immunosuppression (98%). Of those receiving steroid immunosuppression, methylprednisolone was given most frequently (80%) and steroid dose at initiation was greater than or equal to 1 mg/kg/day in 92%. Around 9% of the patients had steroid-refractory irAEs and were treated with non-steroid immunosuppressants (Infliximab, intravenous immunoglobulin (IVIG), mycophenolate mofetil, and vedolizumab). Eight per cent of the patients required admission to the ICU and the average length of hospital stay for all patients was 11 days. The readmission rate due to irAEs within a year was 26% (table 2). Gastroenterology and pulmonology were the most frequently consulted medical subspecialists (online supplemental figure 2).

Figure 3

Immune-related adverse events (irAEs). Others include encephalitis, Lambert Eaton syndrome, and polymyalgia rheumatica.

Figure 4

Number of immune-related adverse events (irAEs) based on treatment modality. ICI, immune checkpoint inhibitor.

Figure 5

Grade of irAEs based on treatment modality. ICI, immune checkpoint inhibitor; irAEs, immune-related adverse events.

Table 2

Immune-related adverse events


For the many cancer patients treated with ICIs, irAEs represent a serious challenge and there is an imminent need to fully understand the patterns of these toxicities and improve their management. Establishing specialized clinical services to ensure early diagnosis and proper management of irAEs can improve the quality of care for patients while also generating data for future research in this field.

We report a 1-year experience of an inpatient service devoted to the care and management of patients with irAEs. We also demonstrate for the first time the feasibility of leveraging the EMR to triage those patients to a specialized toxicity service in a semiautomated system with an accuracy rate of 71%. The distribution and patterns of the reported irAEs on the ITOX service is reflective of what is expected in the inpatient setting with colitis, hepatitis, and pneumonitis cases accounting for most toxicities and most patients responding to steroids with less than 10% requiring other immune suppressive agents.

There have been several attempts on the national level to develop programs devoted to treat patients with irAEs. Our partners at Massachusetts General Hospital established the Severe Immunotherapy Complications program which uses the same EMR tool to triage patients with irAEs. The ITOX service at Johns Hopkins University (JHU) published a report about their experience in the Journal of the National Comprehensive Cancer Network.14 However, since the ITOX service at JHU is mainly a consulting service on an outpatient basis, their report included mainly patients with low-grade irAEs and fewer patients with high-grade irAEs.15

Serious irAEs require prompt immunosuppressive therapy—delays in which may be dangerous. Patients who experience irAEs may seek care from clinicians across specialties, ranging from medical oncology practitioners to primary care, emergency medicine, hospital medicine, and medical subspecialists. Certain irAEs may present with vague symptoms and be particularly challenging to identify for healthcare providers unaccustomed to managing them. The early detection of high-grade irAEs is crucial to facilitate timely initiation of appropriate therapy for these serious adverse events and prevent their long-term complications. Therefore, establishing inpatient services devoted to managing irAEs may improve early detection and proper management. These services will also be helpful in capturing RWD which will advance our knowledge about this increasingly important set of unique toxicities.

There are several limitations to our approach including the remaining need for manual triaging process and the fact that our cohort consists of patients with high-grade irAEs treated at a major academic cancer center where experts in both immunotherapy and immunotoxicity are available, which may not be available in other centers. In addition, establishing such toxicity service requires a lot of resources and funding. Hence, the limitation of adapting this approach elsewhere exists.

Our next steps are to create validated clinical definitions of the most common high-grade irAEs (colitis, pneumonitis, and hepatitis) using the clinical data, diagnostic results, and the patterns of treatment response to improve the accuracy in diagnosing and managing these conditions. We also aim to leverage the wealth of the available data of the patients who developed high-grade irAEs and those who did not experience high-grade irAEs to build a prediction model to identify the patients who are at higher risk of developing high-grade irAEs which will assist oncologists in choosing the most appropriate treatment regimen for these patients when immunotherapy and other modalities are both feasible. The knowledge gained from these projects will be essential to guide the daily practice in both the academic and community settings. In addition, we aim to explore the pathobiology of high-grade irAEs using the available biospecimens obtained at the time of toxicity and before initiating steroids in most cases. This approach may uncover novel therapeutic targets to prevent and treat irAEs.

As cancer immunotherapy continues to evolve with novel single agents and combinations, the burden of irAEs will continue to rise. Therefore, generating easily interpretable clinical definitions of different types of irAEs and building models to detect and predict the occurrence of irAEs are urgently needed to equip healthcare providers with the best strategies to rapidly recognize, diagnose, and manage this increasingly important set of toxicities. Identifying clinical and laboratory-based factors associated with irAEs may also lead to preventive measures to decrease the rate of toxicities and guide future immunotherapy drug development. We believe that our model to identify and triage patients with irAEs is a novel platform that, strengthened by continued improvement, could be adaptable at other major academic centers.


View Abstract


  • Twitter @OsamaRahma2

  • Contributors OA-S, PS, AB, SG, R-EEA, NRL, OR contributed to data collection, data analysis, interpretation of the results and writing of the manuscript. MM, PB, EY, JN co-write the manuscript and data collection. PO, FSH, JJ, OR contributed to supervision, interpretation of the results and final provision of the manuscript.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement Data are available upon reasonable request. All data relevant to the study are included in the article or uploaded as supplementary information.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.