Article Text

Download PDFPDF

Delayed immune-related events (DIRE) after discontinuation of immunotherapy: diagnostic hazard of autoimmunity at a distance
  1. Marcus A. Couey1,a,
  2. R. Bryan Bell1,b,
  3. Ashish A. Patel1,c,
  4. Meghan C. Romba2,d,
  5. Marka R. Crittenden3,e,
  6. Brendan D. Curti1,f,
  7. Walter J. Urba1,g and
  8. Rom S. Leidner1,h
  1. Aff1 0000 0004 0456 863Xgrid.240531.1Robert W. Franz Cancer CenterProvidence Portland Medical Center 2N35 North Pavilion, 4805 N.E. Glisan St 97213 Portland OR USA
  2. Aff2 grid.415337.7Providence Neurological Specialties-WestProvidence St. Vincent Medical Center 9135 Southwest Barnes Road, Suite 461 97225 Portland OR USA
  3. Aff3 0000 0004 0455 9389grid.420050.3The Oregon Clinic, Radiation Oncology 4805 NE Glisan St. Garden Level 97213 Portland OR USA
  1. a Marcus.Couey{at}
  2. b Richard.Bell{at}
  3. c Ashish.Patel{at}
  4. d Meghan.Romba{at}
  5. e Marka.Crittenden{at}
  6. f Brendan.Curti{at}
  7. g Walter.Urba{at}
  8. h Rom.Leidner{at}


Background The risk of delayed autoimmunity occurring months or years after discontinuation of immunotherapy is frequently asserted in the literature. However, specific cases were rarely described until 2018, when a wave of reports surfaced. With expanding I-O indications in the adjuvant/neoadjuvant curative setting, growing numbers of patients will receive limited courses of immunotherapy before entering routine surveillance. In this context, under-recognition of DIRE could pose a growing clinical hazard.

Methods The aim of this study was to characterize DIRE through identification of existing reports of delayed post-treatment irAE in cancer patients treated with immunotherapy. We performed a PubMed literature review from 2008 through 2018 to determine the median data safety reporting window from existing I-O clinical trials, which we then applied to define the DIRE cutoff, and collated all qualifying reports over the same time span. DIRE was defined as new immune-related adverse events (irAE) manifesting ≥90 days after discontinuation of immunotherapy.

Results Median duration of I-O clinical trials data safety reporting was 90 days (82% ≤ 90 days). DIRE cutoff was thus set as ≥90 days post-immunotherapy. We identified 23 qualifying cases; 21 by literature review and 2 from our institution. Median off-treatment interval to DIRE was 6 months (range: 3 to 28). Median cumulative immunotherapy exposure was 4 doses (range: 3 to 42). Involvement included endocrine, neurologic, GI, pulmonary, cardiac, rheumatologic and dermatologic irAE.

Conclusions As immunotherapy indications expand into the curative setting, often with brief exposure and potentially sequenced with multimodality treatments, it will be necessary to recognize an emerging diagnostic complex, which we have termed delayed immune-related events (DIRE). Clinical vigilance has the potential to reduce morbidity from diagnostic delay, as irAE are generally manageable with prompt initiation of treatment – or from misdiagnosis - as misattribution can lead to unnecessary or harmful interventions as we describe. DIRE should therefore figure prominently in the differential diagnosis of patients presenting with illnesses of unclear etiology, irrespective of intervening treatments or interval post-immunotherapy, both of which can confound diagnosis. Increased recognition will rest on delineation of DIRE as a clinical diagnostic entity.

  • Immunotherapy
  • Checkpoint inhibitor
  • Costimulatory agonist
  • Delayed toxicity
  • Immune-related adverse events
  • Abbreviations:
    Delayed-immune related events
    Dose-limiting toxicity
    Guillain-Barré syndrome
    Graft versus host disease
    Head and neck squamous cell carcinoma
    Immune-related adverse event
    Monoclonal antibody
    Non-small cell lung cancer
    Serious adverse event
  • Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

    View Full Text

    Statistics from


    Two recent cases of severe autoimmune illness in patients treated by our institution’s Head and Neck Oncology Department were the impetus for this study (Additional file 1: Institutional Case Series). Both cases were diagnosed months to years after brief exposure to immunotherapy in previous neoadjuvant surgical window trials. In Case No. 1, the relapsing remitting course of neurologic deficits roughly two years after a one week course of immunotherapy (anti-OX40 agonist mAb), led to diagnostic disputes among consulting specialists and resulted in the placement of an Ommaya reservoir based on an erroneous diagnosis of leptomeningeal carcinomatosis, ultimately requiring transfer through three hospital systems to arrive at a conclusive diagnosis of neurosarcoidosis. We found a prevailing assertion in the literature that new autoimmune illness, presenting months to years after discontinuation of immunotherapy, has been well-described. And yet, on tracing the citation trail from 39 review articles, we were able to identify only a single case report (cited by several reviews), describing a patient with delayed dermatologic hypersensitivity reaction (swelling and >erythema of the upper extremities with pruritus) diagnosed 76 days after the last dose of ipilimumab [1]. This prompted us to ask, to what extent are post-immunotherapy immune-related adverse events (irAE) being reported in the literature, what barriers exist to recognition, and to what extent have the hazards of misdiagnosis been described.


    The aim of this study was to characterize DIRE through identification of existing reports of delayed post-treatment irAE in cancer patients treated with immunotherapy. Literature review was conducted in two phases. In the first phase, we queried existing clinical trials to determine a temporal cutoff by which to define DIRE. In the second phase, we applied this cutoff to identify relevant case reports over the same period, and included 2 cases from our institution.

    Defining temporal cutoff for DIRE

    PubMed search of English language reports from Jan 1, 2008 to Dec 31, 2018 was conducted using first-pass Boolean filtering followed by automated titles keyword filtering (Additional file 2: Supplementary Methods). Entries were then divided into two groups: 1) I-O clinical trials, or 2) irAE or toxicity-related case reports. The text, supplement and on-line protocol (when available) for each confirmed I-O clinical trial was manually reviewed to identify the duration of serious adverse event (SAE) reporting. The median SAE reporting duration, thus determined, was taken as the temporal cutoff to define DIRE.

    Literature search for clinical cases

    We next performed full text keyword search of all identified entries (trials and case reports), using: “after,” “delay,” “time,” “onset,” “days,” “week,” and “month.” Articles that described irAE after immunotherapy discontinuation were manually reviewed, including recursive bibliography search for any additional reports. Identified DIRE cases were confirmed by consensus reading of at least two investigators. Cases in which an irAE had been previously diagnosed (e.g. colitis first noted on-treatment, then recurring post-treatment), were considered recrudescent and excluded.


    Determining a temporal cutoff for DIRE (Fig. 1)

    PubMed Boolean filter and sequential automated titles keyword filter resulted in 3600 and 1489 entries, respectively (Fig. 1a). Of these, 194 were I-O clinical trials, of which 127 specified a discrete duration of SAE reporting in the report or via on-line protocol (Fig. 1b). The duration of SAE reporting following the last dose of immunotherapy was 90 days or less in 82% of I-O clinical trials (range 28 to 100 days). Extension of the SAE reporting window to 90 or 100 days appears to be a more recent trend, accounting for only 7% (1/15) of pre-2015 trials identified. The median I-O trials SAE reporting window (90 days), thus determined, was taken as the temporal cutoff to define DIRE cases the literature search which followed.

    Fig. 1

    Serious adverse event (SAE) reporting. a Literature review to identify immuno-oncology clinical trials. b Clinical trials SAE reporting duration after discontinuation of immunotherapy

    Literature search for DIRE cases (Fig. 2)

    Literature search identified 367 case reports, case series and review articles in which the title suggested relevance to irAE or I-O toxicity. These were combined with the 194 I-O clinical trials identified by preceding search, for full-text keyword screening of n = 561 reports (Fig. 2a). We identified 21 cases of DIRE using a definition of autoimmune sequelae newly diagnosed ≥90 days following discontinuation of immunotherapy [219]. Only one case could be confirmed from an I-O trial, reflecting the lack of granularity inherent to conventional SAE reporting (eg. timing of SAE onset relative to first or last treatment dose) [15]. Notably, over half the cases came from 2018 (11 of 21). Two local cases are described in this report, bringing the total to 23 DIRE cases (Table 1). Literature search additionally identified 16 suspected DIRE cases, primarily from I-O clinical trials (14/16), which could not be confirmed or excluded due to lack of sufficient detail and are included in the online supplement (Additional file 3: Table S1).

    Fig. 2

    DIRE cases. a Literature review to identify DIRE cases – immune-related adverse events presenting ≥90 days after discontinuation of immunotherapy

    DIRE Cases

    Characteristics of DIRE cases (Table 1)

    The median interval to DIRE diagnosis was 6 months post-immunotherapy (range 3 to 28 months). Target organ system involvement (Fig. 2b) included: endocrine (7 patients), cutaneous (5), neurologic (5), pulmonary (3), cardiac (3), gastrointestinal (2), rheumatologic (1) and ophthalmologic (1). Interestingly, over half of the DIRE cases occurred following a brief immunotherapy course of ≤4 doses (Fig. 2c: median 4 doses, range 3 to 42). Immunotherapy exposure included pembrolizumab, nivolumab, ipilimumab, tremelimumab plus PF-3512676 (TLR9 agonist) and MEDI6469 (anti-OX40 mAb agonist). In 5 cases, patients received both anti-PD1 and anti-CTLA-4, sequentially or concurrently. Three patients experienced 2 or more DIRE, while a distinctly separate group of patients, roughly 50% (12/23), experienced prior on-treatment irAEs - frequently the proximal cause of immunotherapy discontinuation (9/12) - of which most were managed with corticosteroids (7/12), with the addition of infliximab for cases of colitis (3/12).

    Melanoma predominated (15 cases), followed by non-small cell lung cancer (NSCLC) (4), HPV-associated head and neck squamous cell carcinoma (HNSCC) (2), cutaneous squamous cell carcinoma (1) and not specified (1; likely melanoma, clinical trial) [15]. The majority of DIRE cases occurred in the recurrent/metastatic setting (18/23), but three cases were reported following adjuvant melanoma treatment; we identified two cases following neoadjuvant surgical window I-O trials in HNSCC. Subsequent treatment following immunotherapy included: BRAF inhibitor for a melanoma patient (to which Guillain-Barré syndrome was erroneously attributed), and multimodality standard of care (surgery followed by risk-adapted radiation +/− chemotherapy) for the two HNSCC patients, both of which developed protracted neurologic DIRE, with adrenal crisis included in the DIRE complex in case No. 2 (Table 1; Additional file 1: Institutional Case Series).

    Suspected DIRE cases – incomplete reports

    There were 16 additional suspected DIRE cases identified by literature search, which although likely representing bona fide examples, could not be included due to insufficient reported details [2026]. (Additional file 4: Clinical Trial AEs Suspicious for DIRE) Target organ system involvement included endocrine (6 patients), cutaneous (6), gastrointestinal (3), genitourinary (1), hematologic (1), rheumatologic (1) and ophthalmologic (1). Immunotherapy exposure included pembrolizumab, nivolumab, ipilimumab and gp100. Melanoma predominated (15 cases) of which 20% were adjuvant (3/15); the sixteenth case was metastatic NSCLC.


    The variable temporality of on-treatment irAE is well-characterized [2737]. However, off-treatment autoimmune illness, manifesting months to years after discontinuation of immunotherapy, have occasionally been alluded to in the literature, but probably represent an under-recognized phenomenon [3842]. In 2013, the first such report involving a case of vitiligo manifesting 9 months after discontinuation of pembrolizumab appeared in abstract form in Deutschen Dermatologischen Gesellschaft (case No. 9, Table 1) [8]. Through 2017, a handful of reports described cases of post-immunotherapy autoimmune illness, but focused primarily on target organ manifestations, rather than the fact of delayed onset following an extended interval off-treatment and the diagnostic challenges this most likely posed [3, 13, 1619]. By the close of 2018, however, a wave of new reports had surfaced, some explicitly emphasizing the significance of newly manifest irAE emerging long after discontinuation of immunotherapy, a clinical diagnostic complex we have termed DIRE (delayed immune-related events).

    To our knowledge, this is the first study to collate existing scattered reports of substantially delayed irAE, manifesting at prolonged intervals after discontinuation of immunotherapy. Over half of all cases occurred following short courses of immunotherapy of ≤4 doses, and the majority of cases were reported in 2018 (Table 1). There is sound mechanistic plausibility to support these observations. For instance, PD-1 receptor occupancy on T cells plateaus at approximately 80% up to 90 days after a single dose of nivolumab, despite a serum half-life of only 12–20 days. After three doses, occupancy remains at 40% for more than 8 months after the last dose [43]. Just as durable clinical responses following immunotherapy appear to be independent of dose and duration of treatment, so too, immune-mediated toxicity would be expected to display variable onset relative to treatment.

    Obstacles to assessment of the true frequency and extent of DIRE are inherent in current I-O clinical trials reporting convention. Issues such as limited follow up periods and incompleteness of irAE reporting were previously described by Chen et al. in a systematic review of I-O clinical trials [44]. Some trial protocols explicitly excluded reporting of adverse events occurring > 30 days after last dose, or reporting of any adverse events after initiation of another cancer treatment [4549]. Importantly, irAE are routinely reported relative to the start of treatment, without any related information regarding the end of treatment [21, 5054]. We were only able to confirm a single case of DIRE in an I-O clinical trial, despite rather simple criteria we proposed, and a careful manual review of all published trials reports. This was a case of grade 2 uveitis occurring 157 days after end of study treatment (TLR9 + tremelimumab), which was couched in a DLT table that caught our eye on manual reading of the report (case No. 16, Table 1), and actually not within the searchable text [15].

    The fact that our literature search was able to identify cases dating back to 2013 suggests that DIRE is not a new phenomenon. Indeed, we identified 39 review articles that posited the existence of delayed irAE post discontinuation of treatment [29, 31, 34, 3842, 44, 5584]; however, only two of these reviews provided specific citations, both to the same report describing a case of delayed dermatologic hypersensitivity reaction starting 76 days following final dose of ipilimumab [34, 66]. This particular example would not have posed a substantial diagnostic challenge, nor qualified as DIRE based on a ≥ 90 day cutoff. It may be that clinical anecdotes were in circulation as a basis for the widespread assertions we encountered in the literature, but the lack of citations to any extant reports suggest an under-reporting effect, likely deriving from clinical reluctance to recognize autoimmunity at a distance, in favor of misattribution to more proximal events or treatments.

    Two recent cases of severe and substantially delayed post-treatment irAE occurring in patients treated by our institution’s Head and Neck Oncology Department are described in this report. These serve as among the first detailed examples of DIRE following neoadjuvant immunotherapy, and describe the diagnostic uncertainty posed by otherwise healthy individuals being followed for surveillance, months to years following remote (and brief) immunotherapy exposure in the neoadjuvant clinical trials context. We were unable to find analogous reports in the literature, indicating a diagnostic hazard which is predicted to increase with new I-O approvals in the curative setting (adjuvant/neoadjuvant treatment) [21, 8592]. Current diagnostic challenges are reminiscent of early experience in allogeneic bone marrow transplantation, prior to delineation of graft versus host disease (GVHD) as a clinical diagnostic complex. Diagnostic misattribution to the effects of intercurrent chemotherapy, radiation, disease recurrence or sepsis, were reported as common confounding factors [93, 94]. Clinical awareness, therefore has the potential to avert morbidity/mortality from misdiagnosis, by preventing unnecessary and potentially harmful interventions, (as in the neurosarcoidosis case we describe of Ommaya reservoir placement on the basis of an erroneous leptomeningeal carcinomatosis diagnosis) – and from diagnostic delay, given that these conditions are generally manageable with prompt initiation of immune suppressive therapy.

    As contemporary examples of diagnostic hazard, our literature search identified two reports, one of immune-related colitis manifesting 23 months after completion of pembrolizumab, in which the patient was initially treated with neostigmine based on an erroneous diagnosis of Ogilvie’s syndrome, failed to respond, and then underwent right-sided colectomy, which unfortunately revealed correct diagnosis (Case No. 6, Table 1) [5]. A case of Guillain-Barré syndrome (GBS) manifesting 3 months post-pembrolizumab, was erroneously attributed to subsequent treatment with dabrafenib (case No. 22, Table 1) [18]. Only one other case of GBS has been associated with dabrafenib, in a 2015 abstract, again post-pembrolizumab [95], whereas the association of checkpoint blockade with GBS is well-recognized [96, 97]. Clinical confounding, akin to experience prior to categorization of GVHD, attests to the need for characterization of DIRE as a clinical diagnostic entity. These cases illustrate several hazards of diagnostic misattribution, including unnecessary/invasive procedures, delay in the proper management of an autoimmune illness, and abandonment of an otherwise beneficial therapy (eg…BRAF inhibitors).

    We would highlight three important limitations to this study. First, it is impossible to prove direct causality between immunotherapy and delayed autoimmunity, particularly from case reports. With rare exception, autoimmune sequelae of immunotherapy remain diagnoses-of-exclusion in clinical practice. The lack of a temporal association or dose-dependent relationship, which might otherwise enhance credulity, lends to a cautious skepticism which only further empiric observation will dispel or reinforce. Second, there is a heterogeneous level of detail regarding diagnosis and clinical management in the case reports thus far available. As clinical awareness increases, we anticipate that a growing emphasis will be placed on diagnostic algorithms, management strategies, and possibly unique DIRE associations to specific drugs. Third, we cannot accurately begin to gauge the frequency or true extent of DIRE given clinical trial reporting conventions which favor attribution of irAE to the most temporally proximal treatment/process and reporting irAE relative only to start of treatment but not end of treatment.


    With expanding I-O indications in the curative disease setting, either as adjuvant/neoadjuvant therapy, or in combination with multimodality approaches, growing numbers of patients will be exposed to immunotherapy before transitioning to routine clinical surveillance. In this context, it will be necessary to recognize an emerging clinical diagnostic complex, which we have termed DIRE (delayed immune-related events), manifesting months to years after discontinuation of immunotherapy and representing a substantive diagnostic hazard. In our experience, diagnostic misattribution is clinically reinforced by several confounding factors: 1) a brief and remote immunotherapy exposure; 2) intervening treatments with overlapping toxicities; 3) a protracted diagnosis-by-exclusion process; 4) reduced vigilance in the post-treatment setting. DIRE syndrome should therefore figure prominently in the differential diagnosis of patients presenting with unexplained illnesses, irrespective of post-immunotherapy interval. The clinical hazards of diagnostic misattribution include inappropriate invasive procedures (unnecessary colectomy or Ommaya reservoir placement, as in cases described) and delay to start of treatment for autoimmune conditions that are often readily managed with prompt initiation of immune suppressive therapy. Changes to I-O clinical trial reporting convention could unmask the true incidence of DIRE, and include: the standardization of irAE reporting duration; collection of safety data regardless of whether a new cancer therapy is started; publication of irAE that emerge after the formal study period; and reporting of time-to-onset of irAE in relation to both treatment start and end.


    Research support provided by Providence Portland Medical Foundation.


    Not applicable.

    Authors’ contributions

    MAC and RSL collected and interpreted the data and were major contributors to writing the manuscript. RBB, AAP, MCR, MRC, BDC, WJU contributed patient data and contributed to manuscript editing. All authors read and approved the final manuscript.

    Availability of data and materials

    The data and references supporting the conclusions of this article are included within the main text and additional files.


    Ethics approval and consent to participate

    The study was conducted under institutional review board approval at Providence Portland Medical Center, Oregon. Waiver of consent was obtained for retrospective chart review.

    Consent for publication

    No personal identifying information was included in the manuscript, and therefore no consent was required.

    Competing interests

    RBB receives research funding from the Oral and Maxillofacial Surgery Foundation, BMS, Abbvie, Safeway Foundation, Providence Portland Medical Center Foundation, receives institutional support from BMS, MedImmune, Prometheus, Merck, and is a member of the speakers bureaus for Merck and BMS, MRC receives institutional research support from Nanobiotix, Jounce, Celldex, Mavupharma and BMS, BDC receives institutional research support from MedImmune/AstraZeneca, BMS, Viralytics, and Gallectin Therapeutics, and serves as consultant to BMS, Eisai, Alligator, and Iovance, WJU has received renumeration from MedImmune and Leidos Biomedical Research, serves on the board of directors for Leidos, and serves on the advisory board for Bionical EMAS, RSL receives institutional research support from Bristol Myers Squibb and Medimmune/AstraZeneca, and serves as a consultant to Merck and Regeneron.

    Delayed-immune related events
    Dose-limiting toxicity
    Guillain-Barré syndrome
    Graft versus host disease
    Head and neck squamous cell carcinoma
    Immune-related adverse event
    Monoclonal antibody
    Non-small cell lung cancer
    Serious adverse event


    1. 1.
    2. 2.
    3. 3.
    4. 4.
    5. 5.
    6. 6.
    7. 7.
    8. 8.
    9. 9.
    10. 10.
    11. 11.
    12. 12.
    13. 13.
    14. 14.
    15. 15.
    16. 16.
    17. 17.
    18. 18.
    19. 19.
    20. 20.
    21. 21.
    22. 22.
    23. 23.
    24. 24.
    25. 25.
    26. 26.
    27. 27.
    28. 28.
    29. 29.
    30. 30.
    31. 31.
    32. 32.
    33. 33.
    34. 34.
    35. 35.
    36. 36.
    37. 37.
    38. 38.
    39. 39.
    40. 40.
    41. 41.
    42. 42.
    43. 43.
    44. 44.
    45. 45.
    46. 46.
    47. 47.
    48. 48.
    49. 49.
    50. 50.
    51. 51.
    52. 52.
    53. 53.
    54. 54.
    55. 55.
    56. 56.
    57. 57.
    58. 58.
    59. 59.
    60. 60.
    61. 61.
    62. 62.
    63. 63.
    64. 64.
    65. 65.
    66. 66.
    67. 67.
    68. 68.
    69. 69.
    70. 70.
    71. 71.
    72. 72.
    73. 73.
    74. 74.
    75. 75.
    76. 76.
    77. 77.
    78. 78.
    79. 79.
    80. 80.
    81. 81.
    82. 82.
    83. 83.
    84. 84.
    85. 85.
    86. 86.
    87. 87.
    88. 88.
    89. 89.
    90. 90.
    91. 91.
    92. 92.
    93. 93.
    94. 94.
    95. 95.
    96. 96.
    97. 97.
    View Abstract


    • Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    • Electronic supplementary material The online version of this article (10.1186/s40425-019-0645-6) contains supplementary material, which is available to authorized users.

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.