ReviewDevelopment and implementation of a proficiency testing program for Luminex bead-based cytokine assays
Introduction
Enzyme-linked immuno-assays have revolutionized our ability to rapidly quantify critical biological mediators such as cytokines, chemokines, hormones, and signal transduction proteins. Traditionally, these assays are performed in 96-well plates using an enzyme-linked monoclonal antibody to cleave a substrate and produce a color change. Although these assays are quite powerful, they have been limited to one dimension — detection of a single analyte per well (50–100 μL sample). With the creation of 100 color-coded fluorescent bead sets by Luminex, each of which can be conjugated with a unique specific reactant (antibody, substrate, etc.), biomarker analysis can now be done with a multiplex approach.
Custom-made or commercially available Luminex bead array assays can be partnered with Luminex bead readers, data analysis software, and instrument validation/calibration kits to generate comprehensive immune monitoring and discovery technology. The power of this system is that up to 100 unique analytes can be quantified in a single well of a 96-well plate (25–50 μL of sample). The automated dual laser or CCD camera flow-based array reader identifies each analyte based on a unique fluorescent bead signature and quantifies fluorescence intensity of the reporter associated with that bead set. This multiplex approach to biomarker analysis has become widely used over the last decade for low- to high-throughput analysis of small volume samples. This assay platform has a broad range of applications, with commercial and lab-developed Luminex-based assays (e.g., mouse, rat, human and non-human primate cytokine panels) being used in basic science discovery, pre-clinical/translational and clinical trial immune monitoring laboratories.
Despite the high-level of integration of Luminex bead-based multiplex assays in pre-clinical and clinical research applications over the past 10 years, there has been no comprehensive analysis of the variables that impact assay performance, nor a national or international proficiency testing program for laboratories performing Luminex-based assays. Efforts to identify inter-laboratory variables which impact assay performance have been a long-standing effort within the Cancer Immunotherapy Consortium (CIC) and NIAID/NIH immune monitoring programs, and have led to implementation of assay harmonization, and optimization across a number of immune assay platforms (van der Burg et al., 2011) as well as development of proficiency testing programs (Jaimes et al., 2011). Luminex assays in particular are complex and subject to variability due to such factors as assay manufacturer and lot number, kit components, antibody pairs/clones, analyte standards, assay execution, instrumentation and data analysis/interpretation (Khan et al., 2004, Djoba Siawaya et al., 2008, Nechansky et al., 2008, Butterfield et al., 2011, Scott et al., 2011). To address these issues, a collaborative effort between the NIH/NIAID and the CIC of the Cancer Research Institute (CRI) was initiated to specifically assess outcome variation of Luminex bead-based cytokine assays performed in immune monitoring laboratories around the world and to develop an external quality assurance (EQA) program to monitor on-going laboratory performance.
The two-pronged mission of this joint NIAID/CIC Luminex proficiency initiative is to 1) identify variables that significantly impact outcomes of Luminex-based assays; and 2) establish a routine proficiency testing program for this assay platform to facilitate assay quality improvement and harmonization among participating laboratory sites. A central oversight laboratory is critical for achieving the later point. The focus of this manuscript is on the development and implementation of an international EQA program for Luminex bead-based cytokine assays.
Section snippets
Program development
As a first-step in developing a Luminex EQA program, the NIH/NIAID-sponsored External Quality Assurance Program Oversight Laboratory (EQAPOL) at Duke University developed and implemented a data gathering survey in December 2010. The survey was developed based on draft questions from the Steering Committee and run electronically through a web survey tool. Survey participants were national and international laboratories identified by NIAID and CIC representatives as performing Luminex assays for
EP1
Twenty-five laboratories participated in EP1. All program participants received a de-identified custom 5-plex Luminex-bead assay kit and two test samples containing known amounts of the five target cytokines (IFNγ, TNFα, IL-6, IL-10 and IL-2). One test sample was culture supernatant from PMA/ionomycin-stimulated human PBMCs, and the other was human AB serum spiked with known concentrations of recombinant cytokines. These samples were created to contain high cytokine concentrations so that
Overall summary
The NIH/NIAID-supported EQAPOL at Duke University has developed and launched the first international EQA/proficiency testing program for Luminex bead-based human cytokine assays. This is the result of a collaborative effort between the EQAPOL, NIH/NIAID and CIC and currently monitors 25 US domestic and international sites with two scored EP panels per year.
Comprehensive scoring based on timeliness, protocol adherence, accuracy, and precision is performed with mixed effects model-based
Acknowledgments
Current and past members of the NIAID/CIC Luminex Steering Committee include: Dr. Patricia D'Souza, representing NIAID; Drs. Michael Kalos and Michael Pride, representing CIC; Dr. Lisa Butterfield, University of Pittsburg and Dr. Gregory Sempowski, Duke University. We are grateful for the guidance and leadership of Dr. Jim Lane (NIAID). The authors are grateful to Jeff Lovingood (EQAPOL Program Management), Ambrosia Garcia, Linda Walker, Sara Brown, Holly Alley and Jennifer Baker (EQAPOL
References (12)
- et al.
Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing
J. Immunol. Methods
(2011) - et al.
Statistical methods for the assessment of EQAPOL proficiency testing: ELISpot, Luminex, and Flow Cytometry
J. Immunol. Methods
(2014) - et al.
Interlaboratory reproducibility of female genital tract cytokine measurements by Luminex: implications for microbicide safety studies
Cytokine
(2011) - et al.
Implementation of Good Clinical Laboratory Practice (GCLP) guidelines within the External Quality Assurance Program Oversight Laboratory (EQAPOL)
J. Immunol. Methods
(2014) Controlling the false discovery rate: a practical and powerful approach to multiple testing
J. R. Stat. Soc. Ser. B Methodol.
(1995)- et al.
Multiplex serum biomarker assessments: technical and biostatistical issues
J. Transl. Med.
(2011)
Cited by (33)
Pre-pregnancy obesity is associated with greater systemic inflammation and increased risk of antenatal depression
2023, Brain, Behavior, and ImmunityBiomarker profile in stable Fontan patients
2020, International Journal of CardiologyOptimization and qualification of an Fc Array assay for assessments of antibodies against HIV-1/SIV
2018, Journal of Immunological MethodsCitation Excerpt :Here we describe the optimization and qualification of the Fc Array assay as it is performed at the Dartmouth Antibody Laboratory (dAbl) site at Dartmouth College. In addition to in-house experiments, dAbl participates in a Luminex proficiency testing program via the External Quality Assurance Program Oversight Laboratory (EQAPOL) at Duke University (Lynch et al., 2014). While the multiplexed cytokine quantitation assay used is not strictly analogous to the Fc Array assay, since it differs in bead, analyte, and detection reagent composition, it nonetheless offers a valuable external check on instruments and personnel in their ability to perform an assay utilizing similar principles and the same equipment to pass preset conditions.
How to: Measuring blood cytokines in biological psychiatry using commercially available multiplex immunoassays
2017, PsychoneuroendocrinologyCitation Excerpt :The observed differences between the platforms were unlikely to have resulted from variability within the samples themselves because we ensured that identical aliquots were used on both platforms, avoided extra cycles of freezing/thawing procedures, performed the multisite measurements within the same period, and limited the manipulations to an experienced operator. Nevertheless, a recent large multi-site study reported highly variable results despite assessment of identical samples with same batches of reagents and identical Luminex-based assays (Lynch et al., 2014). Therefore, we cannot totally exclude the operator on each platform as a source of the variability.
Variability of the IFN-γ ELISpot assay in the context of proficiency testing and bridging studies
2016, Journal of Immunological MethodsThe effects of age and gender on plasma levels of 63 cytokines
2015, Journal of Immunological MethodsCitation Excerpt :Although there are a number of WHO reference preparations for human cytokines (http://www.who.int/bloodproducts/ref_materials/), we still lack international calibrators for many cytokines (Meager, 2006). The manufacturers, thus, have to develop their own calibrators, which results in greater inter-manufacturer differences (Lynch et al., 2014; Dupuy et al., 2013). This makes it difficult to transfer reference intervals from one manufacturer to another without comparing results obtained with the two assays (Enroth et al., 2014).