Deep Convolutional Neural Networks for Histological Image Analysis in Gastric Carcinoma Whole Slide Images
In this paper, histopathological whole slide images of gastric carcinoma are analyzed using deep learning
methods. A convolutional neural network architecture is proposed for two classification applications in H&E stained tissue images, namely, cancer classification based on immunohistochemistry (IHC) into classes Her2/neu+ tumor, Her2/neu- tumor and non-tumor, and necrosis detection based on existence of necrosis into classes necrotic and non-necrotic. The studies in  and  explored computer-aided classification using graphbased methods and necrosis detection by textural approach respectively, which are extended using deep convolutional neural networks. Performance is quantitatively compared with established handcrafted image features, namely Haralick GLCM, Gabor filter-banks, LBP histograms, Gray histograms, RGB histograms and HSV histograms followed by classification by random forests, another well-known machine learning algorithm.
Convolutional neural networks (CNN) have recently gained tremendous attention in general image analysis [3-5]. There has also been an emergence of deep learning in digital histopathology for diverse
classification and detection problems [6-8]. The prime motivation behind this work is that no previous study has explored deep learning for the specified goals in gastric cancer WSI. Automated cancer classification can assist pathologists in computer-aided diagnosis in H&E stained WSI without the requirement of IHC staining, thereby reducing preparation and inspection times, and decreasing inter- and intra-observer variability. Necrosis detection can play an important role in prognosis, as larger necrotic areas indicate a smaller chance of survival and vice-versa. Moreover, most deep learning studies have used smaller image sizes mainly due to memory restrictions of GPU, however, we consider larger regions in order to preserve context i.e. neighborhood information and tissue architecture at higher magnification. Further, this method is independent of nuclei segmentation, hence its performance is not limited by segmentation performance as in  (evaluation details in ).
Firstly, standard data augmentation techniques are applied on the available gastric cancer WSI dataset and
thousands of images of size 512x512 are generated. Different CNN architectures are empirically studied to observe the behavior of variation in model characteristics (network depth, layer properties, training parameters, etc.) by training them from scratch on a representative subset of whole data for cancer classification. One of these is the Imagenet model , however it doesnâ€™t perform desirably on the representative dataset. The self-designed CNN architecture with best classification rates is selected. Later, the proposed CNN is also applied for necrosis detection. Performance is compared with state of the art methods using handcrafted features and random forests. For evaluation, randomized three-fold stratified shuffle split and leave-one-patient-out cross validations are used.
Conclusion: A self-designed CNN architecture is proposed for image analysis (cancer classification based on IHC and necrosis detection) in H&E stained WSI of gastric cancer. Quantitative evaluation shows that deep learning methods mostly compare favorably to state of the art methods, especially for necrosis detection. In future the aim is to expand the current WSI dataset and to improve the CNN architecture for optimal performance.
 H. Sharma, N. Zerbe, I. Klempert, S. Lohmann, B. Lindequist, O. Hellwich, P. Hufnagl, Appearance-based necrosis detection using textural features and SVM with discriminative thresholding in histopathological whole slide images, IEEE 15th International Conference on Bioinformatics and Bioengineering 2016, 1-6
 Y. LeCun, B. Yoshua , H. Geoffrey, Deep learning, Nature 2015, 521(7553):436-44.
 A.Krizhevsky, I. Sutskever, G. E. Hinton, Imagenet classification with deep convolutional neural networks, Advances in neural information processing systems, 2012, 1097-110.
 Y. LeCun, B. Boser, J. S. Denker, , D. Henderson, R. E. Howard ,W. Hubbard , L.D. Jackel, Backpropagation applied to handwritten zip code recognition, Neural computation 1989 , 1(4): 541-551.
 A. Cruz-Roa, A. Basavanhally, F. Gonzalez, H. Gilmore, M. Feldman, S. Ganesan, N. Shih, J. Tomaszewski, A. Madabhushi, Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks, International Society for Optics and Photonics , SPIE Medical Imaging 2014, 904103-904103
 D. C. Cirecsan, A. Giusti, L.M. Gambardella, J. Schmidhuber, Mitosis detection in breast cancer histology images with deep neural networks, Springer, Medical Image Computing and Computer-Assisted Intervention (MICCAI 2013), 411-418
 J. Xu, X. Luo, , G. Wang, H. Gilmore, A. Madabhushi, A Deep Convolutional Neural Network for Segmenting and Classifying Epithelial and Stromal Regions in Histopathological Images, Neurocomputing 2016
 H. Sharma, N. Zerbe, D. Heim, S. Wienert, H. Behrens, O. Hellwich, P. Hufnagl , A Multi-resolution Approach for Combining Visual Information using Nuclei Segmentation and Classification in Histopathological Images, Proceedings of the 10th International Conference on Computer Vision Theory and Applications 2015 (VISIGRA, 37-46, ISBN 978-989-758-091-8)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
4. In case of virtual slide publication the authors agree to copy the article in a structural modified version to the journal's VS archive.