  Informed selection of drug candidates for laboratory experimentation provides
an efficient means of identifying suitable anti-cancer treatments. The
advancement of artificial intelligence has led to the development of
computational models to predict cancer cell line response to drug treatment. It
is important to analyze the false positive rate (FPR) of the models, to
increase the number of effective treatments identified and to minimize
unnecessary laboratory experimentation. Such analysis will also aid in
identifying drugs or cancer types that require more data collection to improve
model predictions. This work uses an attention based neural network
classification model to identify responsive/non-responsive drug treatments
across multiple types of cancer cell lines. Two data filtering techniques have
been applied to generate 10 data subsets, including removing samples for which
dose response curves are poorly fitted and removing samples whose area under
the dose response curve (AUC) values are marginal around 0.5 from the training
set. One hundred trials of 10-fold cross-validation analysis is performed to
test the model prediction performance on all the data subsets and the subset
with the best model prediction performance is selected for further analysis.
Several error analysis metrics such as the false positive rate (FPR), and the
prediction uncertainty are evaluated, and the results are summarized by cancer
type and drug mechanism of action (MoA) category. The FPR of cancer type spans
between 0.262 and 0.5189, while that of drug MoA category spans almost the full
range of [0, 1]. This study identifies cancer types and drug MoAs with high
FPRs. Additional drug screening data of these cancer and drug categories may
improve response modeling. Our results also demonstrate that the two data
filtering approaches help improve the drug response prediction performance.
