Abstract
Typical regimens for advanced metastatic stage IIIB/IV non-small cell lung cancer (NSCLC) consist of multiple lines of treatment. We present an adaptive reinforcement learning approach to discover optimal individualized treatment regimens from a specially designed clinical trial (a “clinical reinforcement trial”) of an experimental treatment for patients with advanced NSCLC who have not been treated previously with systemic therapy. In addition to the complexity of the problem of selecting optimal compounds for first and second-line treatments based on prognostic factors, another primary scientific goal is to determine the optimal time to initiate second-line therapy, either immediately or delayed after induction therapy, yielding the longest overall survival time. A reinforcement learning method called Q-learning is utilized which involves learning an optimal policy from patient data generated from the clinical reinforcement trial. Approximating the Q-function with time-indexed parameters can be achieved by using a modification of support vector regression which can utilize censored data. Within this framework, a simulation study shows that the procedure can extract optimal strategies for two lines of treatment directly from clinical data without relying on the identification of any accurate mathematical models. In addition, we demonstrate that the design reliably selects the best initial time for second-line therapy while taking into account the heterogeneity of NSCLC across patients.
Disciplines
Clinical Trials
Suggested Citation
Zhao, Yufan; Kosorok, Michael R.; Zeng, Donglin; and Socinski, Mark A., "Reinforcement Learning Strategies for Clincal Trials in Non-small Cell Lung Cancer" (August 2009). The University of North Carolina at Chapel Hill Department of Biostatistics Technical Report Series. Working Paper 13.
http://biostats.bepress.com/uncbiostat/art13