MTWSI-Net: Towards Improved Multi-Task Whole Slide Image Classification with Contrastive Learning

Authors

  • Sean Hwang The Hotchkiss School

DOI:

https://doi.org/10.47611/jsrhs.v13i2.6464

Keywords:

Whole-Slide Images, Convolutional Neural Network, Cancer Classification

Abstract

Pathology is a digital technology for the capture and analysis of high-resolution Whole Slide Images (WSIs). WSI entails scanning glass pathology slides, typically containing tissue samples, into a digital format. This facilitates comprehensive digital viewing, analysis, and interpretation by pathologists. Despite the undeniable utility of this method, the inherent time-consuming and labor-intensive nature of traditional pathology image analysis, which is heavily reliant on expert pathologists, is well-known. Recent years have seen a surge in research aiming to address these challenges through the development of automated systems using machine learning approaches. While promising, such systems often exhibit bias towards specific datasets and struggle to transition effectively to real-world scenarios. For this reason, there is a need to establish a uniform machine learning training approach for generating more robust and consistent results. In this paper, I introduce a contrastive learning-based multi-task whole slide image classification system. The proposed system excels at extracting consistently reliable features for identical cancer categories, thereby enhancing accuracy in downstream tasks. Through extensive experiments, the results demonstrate that the proposed system outperforms pre-existing state-of-the-art machine learning models. I expect that the proposed system can significantly contribute to pathologists by offering valuable cancer screening capabilities in WSIs.

 

Downloads

Download data is not yet available.

References or Bibliography

Bansal, S. (2023, Jan 25). “Classification in machine learning: Types and methodologies”: Analytixlabs

https://www.analytixlabs.co.in/blog/classification-in-machine-learning/

Fran, C. (2017). Deep learning with depth wise separable convolutions. In IEEE conference on computer vision and pattern recognition (CVPR). https://doi.org/10.48550/arXiv.1610.02357

He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778). https://doi.org/10.48550/arXiv.1512.03385

Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700-4708). https://doi.org/10.48550/arXiv.1608.06993

Kaggle. (2020, Apr 20). “Metastatic Tissue Classification - PatchCamelyon”: Kaggle

https://www.kaggle.com/datasets/andrewmvd/metastatic-tissue-classification-patchcamelyon

Kuntz, S., Krieghoff-Henning, E., Kather, J. N., Jutzi, T., Höhn, J., Kiehl, L., ... & Brinker, T. J. (2021). Gastrointestinal cancer classification and prognostication from histology using deep learning: Systematic review. European Journal of Cancer, 155, 200-215.

Mooney P. (2017, Dec 19). “Breast Histopathology Images”: Kaggle

https://www.kaggle.com/datasets/paultimothymooney/breast-histopathology-images

Nicolas, K. (2019, Feb 7). “Histological images for MSI vs. MSS classification in gastrointestinal cancer, FFPE samples”: Zenodo

https://zenodo.org/records/2530835

Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L. C. (2018). Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4510-4520). https://doi.org/10.48550/arXiv.1801.04381

Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. https://doi.org/10.48550/arXiv.1409.1556

Sun, C., Xu, A., Liu, D., Xiong, Z., Zhao, F., & Ding, W. (2019). Deep learning-based classification of liver cancer histopathology images using only global labels. IEEE journal of biomedical and health informatics, 24(6), 1643-1651.

Tan, M., & Le, Q. (2019, May). Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning (pp. 6105-6114). PMLR. https://doi.org/10.48550/arXiv.1905.11946

Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., ... & Xiao, B. (2020). Deep high-resolution representation learning for visual recognition. IEEE transactions on pattern analysis and machine intelligence, 43(10), 3349-3364. https://doi.org/10.48550/arXiv.1908.07919

Xie, S., Girshick, R., Dollár, P., Tu, Z., & He, K. (2017). Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1492-1500).

https://doi.org/10.48550/arXiv.1611.05431

Yacouby, R., & Axman, D. (2020, November). Probabilistic extension of precision, recall, and f1 score for more thorough evaluation of classification models. In Proceedings of the first workshop on evaluation and comparison of NLP systems (pp. 79-91).

Yang, H., Chen, L., Cheng, Z., Yang, M., Wang, J., Lin, C., ... & Li, W. (2021). Deep learning-based six-type classifier for lung cancer and mimics from histopathological whole slide images: a retrospective study. BMC medicine, 19, 1-14.

Published

05-31-2024

How to Cite

Hwang, S. (2024). MTWSI-Net: Towards Improved Multi-Task Whole Slide Image Classification with Contrastive Learning. Journal of Student Research, 13(2). https://doi.org/10.47611/jsrhs.v13i2.6464

Issue

Section

HS Research Articles