UBC, a leading provider of pharmaceutical support services, convened a virtual gathering of experts for an invigorating discussion on the use of external comparators in clinical research and post-marketing programs. This discussion lead to the creation of an External Controls in Research Series that will be released in segments, whereby our experts respond to key questions relating to the what, why, and how of the use of external comparators.
The discussion included a group of experienced biopharmaceutical development professionals including epidemiologists, statisticians and data scientists exploring essential considerations in generating evidence on the safety and efficacy/effectiveness of treatments using external comparator groups in the study design.
In this External Controls in Research Series, we will be exploring various topics such as the historical decisions of regulators in accepting results from studies using external comparators; what factors should be considered when selecting optimal data source(s) to identify patients for the comparator group; and the future of external comparators in drug development. Comparing outcomes of patients in an appropriate external comparator cohort with outcomes of the study population allows researchers to accelerate evidence generation and achieve a range of clinical development objectives.
What is an external comparator and how are these being used in research?
Let us first start with a review of definitions to establish context for the rest of our conversation.
For our discussion today we are going to use the term “external comparator,” however you will also hear this concept being referred to as a “external control” or “synthetic control.” An external comparator is a cohort of patients, often assembled from real world data sources outside of a prospective investigational study (such as a randomized, controlled trial), which is used to compare to a cohort of patients who participated in an investigational study. The external comparator cohort is designed to mimic as closely as possible the characteristics of the patient cohort from the investigational study to which it is being compared. Furthermore, because these external patients may come from real world data, they typically are treated with standard of care therapies in usual clinical practice. The term “study population” will be used to refer to patients who have received the therapy under investigation.
In understanding why an external comparator might be selected instead of a traditional comparator such as placebo control or standard of care within a clinical trial, it is important to consider the limitations and challenges that can be associated with traditional comparators. For example, in life threatening illnesses with limited or no treatment options, it may be considered unethical to conduct a study with a placebo control arm. In rare diseases, small patient populations and reluctance to enroll in randomized studies are factors that would impair the achievement of patient enrollment and sufficient statistical power in studies designed with traditional controls. For some rare diseases, patients may be eager to enroll in a study of a new investigational product thereby limiting the number of patients available for a comparator arm. In this situation, those patients remaining in a comparator arm may be very different in demographic characteristics and disease presentation, thereby introducing potential bias.
Furthermore, the digitization of healthcare data has created a rich landscape of high-quality healthcare databases. Taken in combination with recent technological advancements in data interoperability, we can now assemble highly customized external comparator data sets that contain the healthcare experience of patients with characteristics that closely replicate those of the study populations. These customized comparator datasets provide an efficient approach in clinical research settings that would have previously only used a traditional comparator.
In this second segment of our External Controls in Research Series, a virtual gathering of experts on the what, why, and how of external comparators in clinical research and post-marketing, we explore some examples of how external controls have been used successfully for regulatory submissions.
What are some examples of regulators accepting data generated from studies using external comparators?
According to Hatswell et al. (2016), between 1999 and 2014, the EMA approved 44 indications without randomized controlled trial results and the FDA approved 60 indications. Single-arm trials incorporating external control arms as the comparison group are becoming more commonly accepted evidence in both regulatory approvals and health technology assessments (HTA).
An illustrative example is a recently conducted single-arm trial of Blincyto® (blinatumomab, Amgen Inc.) that utilized an external comparator to demonstrate standard of care outcomes in patients with Philadelphia (Ph)-positive leukemia (Rambaldi 2020). Where the originally approved indication in 2014 was for Ph-negative precursor B-cell relapsed or refractory acute lymphoblastic leukemia (ALL), the 2018 accelerated FDA approval and 2019 EMA approval resulted in a label expansion to include both the Ph-positive variation as well (Pulte 2018). The external historical control group was derived from medical chart reviews of patients who received standard of care, and used a weighted analysis of patient‐level data to establish effectiveness.
Bavencio® (avelumab, Merck KGA and Pfizer Inc), an IgG1 anti-PD-L1 antibody, received accelerated FDA and conditional EMA approval after comparison to historical controls for second line treatment of platinum-refractory locally advanced or metastatic urothelial carcinoma (mUC) (Baumfeld Andre 2019). In this example, the external controls were taken from a combination of an electronic healthcare database and a German cancer registry to establish the natural history of mUC.
We see drug developers using these approaches to accelerate research as detailed in the interview question above. Below are some select examples of recent FDA/EMA approvals which used external controls in the design of the studies provided as evidence:
|Drug||Regulatory Agency||Approval Date||Indication||Data Source(s) Used|
|2017||Merkel Cell Carcinoma (MCC)
Urothelial Carcinoma (UC)
Renal Cell Carcinoma (RCC)
|Acute Lymphoblastic Leukemia (ALL)||Historical control composed from large US and European cohorts|
|KYMRIAH (tisagenlecleucel)||EMA Accelerated approval||2018||Acute Lymphoblastic Leukemia (ALL)
Relapsed or refractory (r/r) large B-cell lymphoma
|Historical control datasets (blinatumomab and salvage chemotherapy)|
Non-Small Cell Lung Cancer (NSCLC)
Small Cell Lung Cancer (SCLC)
Renal Cell Carcinoma (RCC)
Classical Hodgkin Lymphoma (cHL)
Squamous Cell Carcinoma of the Head and Neck (SCCHN)
Hepatocellular Carcinoma (HCC)
Esophageal Squamous Cell Carcinoma (ESCC)
|Flatiron Health’s oncology database|
|VORAXAZE (glucarpidase)||FDA||2012||Indicated to reduce toxic plasma methotrexate concentration in adult and pediatric patients with delayed methotrexate clearance||Open-label compassionate-use study|
|YESCARTA (axicabtagene ciloleucel)||EMA Accelerated approval||2018||Relapsed or refractory (r/r) large B-cell lymphoma||Historical controls from SCHOLAR-1|
Some common themes emerge from a review of this table:
- Regulators are more likely to accept use of external control data when the disease is rare and/or the indication is for a disease with high unmet medical need, so it is not surprising that the majority of these approvals/label expansions are for oncology indications.
- The external controls came from a wide variety of sources: open label studies, historical controls from other randomized trials, and other secondary healthcare databases and chart reviews. This corroborates the general tenet of RWE described in a recent whitepaper from Duke-Margolis (Mahendraratnam Lederer et al, 2019) – that the data must be ‘fit for purpose’ and that there is no ‘perfect’ database to meet all external comparator needs; the right data must be chosen to address the particular research question at hand.
Please join us for the next segment where we will be answering: What are the critical factors that should be considered when selecting the optimal data source(s) for use as the external comparator?
UBC epidemiologists, clinicians, and biostatisticians support the design and execution of modernized solutions that generate evidence on the safety and effectiveness of biopharmaceutical products. For more information get in touch with our team here.
Baumfeld Andre E, Reynolds R, Caubel P, Azoulay L, Dreyer NA. Trial designs using real-world data: The changing landscape of the regulatory approval process. Pharmacoepidemiol Drug Saf. 2019. doi:10.1002/pds.4932
Hatswell AJ, Baio G, Berlin JA, Irs A, Freemantle N. Regulatory approval of pharmaceuticals without a randomised controlled study: analysis of EMA and FDA approvals 1999-2014. BMJ Open. 2016;6(6):e011666. doi:10.1136/bmjopen-2016-011666
Mahendraratnam Lederer, N., et al. Determining Real World Data’s Fitness for Use and the Role of Reliability. Duke-Margolis Center for Healthcare Policy. Sept 26, 2019. https://healthpolicy.duke.edu/publications/determining-real-world-datas-fitness-use-and-role-reliability. Accessed 11-3-2020.
Pulte ED, Vallejo J, Przepiorka D, et al. FDA Supplemental Approval: Blinatumomab for Treatment of Relapsed and Refractory Precursor B-Cell Acute Lymphoblastic Leukemia. Oncologist. 2018;23(11):1366-1371. doi:10.1634/theoncologist.2018-0179
Rambaldi A, Ribera JM, Kantarjian HM, et al. Blinatumomab compared with standard of care for the treatment of adult patients with relapsed/refractory Philadelphia chromosome-positive B-precursor acute lymphoblastic leukemia. Cancer. 2020;126(2):304-310. doi:10.1002/cncr.32558