  Osteosarcoma is the most common primary bone cancer whose standard treatment
includes pre-operative chemotherapy followed by resection. Chemotherapy
response is used for predicting prognosis and further management of patients.
Necrosis is routinely assessed post-chemotherapy from histology slides on
resection specimens where necrosis ratio is defined as the ratio of necrotic
tumor to overall tumor. Patients with necrosis ratio >=90% are known to have
better outcome. Manual microscopic review of necrosis ratio from multiple glass
slides is semi-quantitative and can have intra- and inter-observer variability.
We propose an objective and reproducible deep learning-based approach to
estimate necrosis ratio with outcome prediction from scanned hematoxylin and
eosin whole slide images. We collected 103 osteosarcoma cases with 3134 WSIs to
train our deep learning model, to validate necrosis ratio assessment, and to
evaluate outcome prediction. We trained Deep Multi-Magnification Network to
segment multiple tissue subtypes including viable tumor and necrotic tumor in
pixel-level and to calculate case-level necrosis ratio from multiple WSIs. We
showed necrosis ratio estimated by our segmentation model highly correlates
with necrosis ratio from pathology reports manually assessed by experts where
mean absolute differences for Grades IV (100%), III (>=90%), and II (>=50% and
<90%) necrosis response are 4.4%, 4.5%, and 17.8%, respectively. We
successfully stratified patients to predict overall survival with p=10^-6 and
progression-free survival with p=0.012. Our reproducible approach without
variability enabled us to tune cutoff thresholds, specifically for our model
and our data set, to 80% for OS and 60% for PFS. Our study indicates deep
learning can support pathologists as an objective tool to analyze osteosarcoma
from histology for assessing treatment response and predicting patient outcome.
