ARTIFICIAL INTELLIGENCE AND NEXT GENERATION PATHOLOGY: TOWARDS PERSONALIZED MEDICINE

Keywords: Artificial Intelligence, Pathology, Deep Learning, neural networks, diagnostics, personalized medicine

Abstract

Introduction. Over the past few decades, thanks to advances in algorithm development, the introduction of available computing power, and the management of large data sets, machine learning methods have become active in various fields of life. Among them, deep learning possesses a special place, which is used in many spheres of health care and is an integral part and prerequisite for the development of digital pathology.

Objectives. The purpose of the review was to gather the data on existing image analysis technologies and machine learning tools developed for the whole-slide digital images in pathology.

Methods: Analysis of the literature on machine learning methods used in pathology, staps of automated image analysis, types of neural networks, their application and capabilities in digital pathology was performed.

Results. To date, a wide range of deep learning strategies have been developed, which are actively used in digital pathology, and demonstrated excellent diagnostic accuracy. In addition to diagnostic solutions, the integration of artificial intelligence into the practice of pathomorphological laboratory provides new tools for assessing the prognosis and prediction of sensitivity to different treatments.

Conclusions: The synergy of artificial intelligence and digital pathology is a key tool to improve the accuracy of diagnostics, prognostication and personalized medicine facilitation

Downloads

Download data is not yet available.

References

Acs B, Rantalainen M, Hartman J. Artificial intelligence as the next step towards precision pathology. J Intern Med. 2020;288(1):62-81. DOI: 10.1111/joim.13030.

https://doi.org/10.1111/joim.13030

Bera K, Schalper KA, Rimm DL, Velcheti V, Madabhushi A. Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology. Nat Rev Clin Oncol. 2019; 16(11):703-715. DOI:10.1038/ s41571-019-0252-y

https://doi.org/10.1038/s41571-019-0252-y

Bizzego A, Bussola N, Chierici M, Maggio V, Francescatto M, Cima L, Cristoforetti M, Jurman G, Furlanello

C. Evaluating reproducibility of AI algorithms in digital pathology with DAPPER. PLoS Comput Biol. 2019; 15(3):e1006269. DOI: 10.1371/journal.pcbi.1006269.

https://doi.org/10.1371/journal.pcbi.1006269

Bychkov D, Linder N, Turkki R, Nordling S, Kovanen PE, Verrill C, Walliander M, Lundin M, Haglund C, Lundin J. Deep learning based tissue analysis predicts outcome in colorectal cancer. Sci Rep. 2018; 8(1): 3395. DOI: 10.1038/s41598-018-21758-3.

https://doi.org/10.1038/s41598-018-21758-3

Calderaro J., Kather J.N. Artificial intelligence-based pathology for gastrointestinal and hepatobiliary cancers. Gut. 2020. DOI: 10.1136/gutjnl-2020-322880.

https://doi.org/10.1136/gutjnl-2020-322880

Chen PC, Liu Y, Peng L. How to develop machine learning models for healthcare. Nat Mater. 2019; 18(5):410-414. DOI: 10.1038/s41563-019-0345-0.

https://doi.org/10.1038/s41563-019-0345-0

Cheng J, Liu Y, Huang W, Hong W, Wang L, Zhan X, Han Z, Ni D, Huang K, Zhang J. Computational Image Analysis Identifies Histopathological Image Features Associated With Somatic Mutations and Patient Survival in Gastric Adenocarcinoma. Front Oncol. 2021; 11:623382. DOI: 10.3389/fonc.2021.623382.

https://doi.org/10.3389/fonc.2021.623382

Coudray N, Ocampo PS, Sakellaropoulos T, Narula N, Snuderl M, Fenyö D, Moreira AL, Razavian N, Tsirigos A. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018; 24(10): 1559-1567. DOI: 10.1038/s41591-018-0177-5.

https://doi.org/10.1038/s41591-018-0177-5

Cui M, Zhang DY. Artificial intelligence and computational pathology. Lab Invest. 2021; 101(4): 412- 422. DOI:10.1038/s41374-020-00514-0

https://doi.org/10.1038/s41374-020-00514-0

Ginsburg SB, Lee G, Ali S, Madabhushi A. Feature importance in nonlinear embeddings (FINE): applications in digital pathology.IEEE Trans Med Imaging. 2016; 35: 76-88. DOI: 10.1109/TMI.2015.2456188.

https://doi.org/10.1109/TMI.2015.2456188

Ibrahim A, Gamble P, Jaroensri R, Abdelsamea MM, Mermel CH, Chen PC, Rakha EA. Artificial intelligence in digital breast pathology: Techniques and applications. Breast. 2020; 49: 267-273. DOI: 10.1016/j. breast.2019.12.007.

https://doi.org/10.1016/j.breast.2019.12.007

Irshad H, Veillard A, Roux L, Racoceanu D. Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential. IEEE Rev Biomed Eng. 2014; 7: 97-114. DOI: 10.1109/RBME.2013.2295804.

https://doi.org/10.1109/RBME.2013.2295804

Kanavati F, Toyokawa G, Momosaki S, Takeoka H, Okamoto M, Yamazaki K, Takeo S, Iizuka O, Tsuneki

M. A deep learning model for the classification of indeterminate lung carcinoma in biopsy whole slide images. Sci Rep. 2021; 11(1):8110. DOI: 10.1038/s41598-021-87644-7.

https://doi.org/10.1038/s41598-021-87644-7

Kather J.N., Krisam J., Charoentong P., Luedde T., Herpel E., Weis C.A., Gaiser T., Marx A., Valous N.A., Ferber D., et al. Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study. PLoS Med. 2019;16:e1002730. DOI: 10.1371/journal.pmed.1002730;

https://doi.org/10.1371/journal.pmed.1002730

Krizhevsky A., Sutskever I., Hinton G.E. Imagenet classification with deep convolutional neural networks. Commun. ACM. 2017; 60:84-90. DOI: 10.1145/3065386.

https://doi.org/10.1145/3065386

Lancellotti C, Cancian P, Savevski V, et al. Artificial Intelligence & Tissue Biomarkers: Advantages, Risks and Perspectives for Pathology. Cells. 2021; 10(4):787. DOI:10.3390/cells10040787

https://doi.org/10.3390/cells10040787

LeCun Y., Bengio Y., Hinton G. Deep learning. Nature. 2015; 521(7553):436-444. DOI: 10.1038/ nature14539.

https://doi.org/10.1038/nature14539

Levine AB, Schlosser C, Grewal J, Coope R, Jones SJM, Yip S. Rise of the Machines: Advances in Deep Learning for Cancer Diagnosis. Trends Cancer. 2019;5(3):157-169. DOI: 10.1016/j.trecan.2019.02.002.

https://doi.org/10.1016/j.trecan.2019.02.002

Madabhushi A, Lee G. Image analysis and machine learning in digital pathology: Challenges and opportunities. Med Image Anal. 2016; 33:170-175. DOI: 10.1016/j.media.2016.06.037.

https://doi.org/10.1016/j.media.2016.06.037

Mills A.M., Gradecki S.E., Horton B.J. Diagnostic efficiency in digital pathology: a comparison of optical versus digital assessment in 510 surgical pathology cases. Am J Surg Pathol. 2018; 42(1): 53-59.

https://doi.org/10.1097/PAS.0000000000000930

Mobadersany P., Yousefi S., Amgad M. et al. Predicting cancer outcomes from histology and genomics using convolutional networks. Proc. Natl. Acad. Sci. USA. 2018; 115:e2970-e2979. DOI: 10.1073/pnas.1717139115.

https://doi.org/10.1073/pnas.1717139115

Mukhopadhyay S, Feldman MD, Abels E. et al. Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study). Am J Surg Pathol. 2018; 42(1): 39-52. DOI: 10.1097/PAS.0000000000000948.

https://doi.org/10.1097/PAS.0000000000000948

Niazi MKK, Parwani AV, Gurcan MN. Digital pathology and artificial intelligence. Lancet Oncol. 2019; 20(5):e253-e261. DOI: 10.1016/S1470-2045(19)30154-8.

https://doi.org/10.1016/S1470-2045(19)30154-8

Prewitt JMS. Picture Processing and Psychopictorics. Academic Press; New York: 1970. Object enhancement and extraction; pp. 75-149.

Purushotham S, Meng C, Che Z, Liu Y. Benchmarking deep learning models on large healthcare datasets. J Biomed Inform. 2018 Jul; 83:112-134. DOI: 10.1016/j.jbi.2018.04.007.

https://doi.org/10.1016/j.jbi.2018.04.007

Rashidi H.H., Tran N.K., Betts E.V., Howell L.P., Green R. Artificial Intelligence and Machine Learning in Pathology: The Present Landscape of Supervised Methods. Acad. Pathol. 2019; 6:2374289519873088. DOI: 10.1177/2374289519873088.)

https://doi.org/10.1177/2374289519873088

Retamero JA, Aneiros-Fernandez J, Del Moral RG. Complete Digital Pathology for Routine Histopathology Diagnosis in a Multicenter Hospital Network. Arch Pathol Lab Med. 2020; 144(2): 221-228. DOI: 10.5858/arpa.2018-0541-OA.

https://doi.org/10.5858/arpa.2018-0541-OA

Santo BA, Rosenberg AZ, Sarder P. Artificial intelligence driven next-generation renal histomorphometry. Curr Opin Nephrol Hypertens. 2020; 29(3): 265-272. DOI: 10.1097/MNH.0000000000000598.

https://doi.org/10.1097/MNH.0000000000000598

Schmitt M, Maron RC, Hekler A, et al. Hidden Variables in Deep Learning Digital Pathology and Their Potential to Cause Batch Effects: Prediction Model Study. J Med Internet Res. 2021; 23(2):e23436. DOI:10.2196/23436

https://doi.org/10.2196/23436

Simonyan K., Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv. 20141409.1556;

Sirinukunwattana K, Domingo E, Richman SD. et al. Image-based consensus molecular subtype (imCMS) classification of colorectal cancer using deep learning. Gut. 2021; 70(3): 544-554. DOI: 10.1136/ gutjnl-2019-319866.

https://doi.org/10.1136/gutjnl-2019-319866

Skrede O.J., De Raedt S., Kleppe A., Hveem T.S., Liestøl K., Maddison J., Askautrud H.A., Pradhan M., Nesheim J.A., Albregtsen F., et al. Deep learning for prediction of colorectal cancer out-come: A discovery and validation study. Lancet. 2020; 395: 350-360. DOI: 10.1016/S0140-6736(19)32998-8).

https://doi.org/10.1016/S0140-6736(19)32998-8

Srinidhi CL, Ciga O, Martel AL. Deep neural network models for computational histopathology: A survey. Med Image Anal. 2021; 67:101813. DOI: 10.1016/j.media.2020.101813.

https://doi.org/10.1016/j.media.2020.101813

Terranova N, Venkatakrishnan K, Benincosa LJ. Application of Machine Learning in Translational Medicine: Current Status and Future Opportunities. AAPS J. 2021

https://doi.org/10.1208/s12248-021-00593-x

(4):74. Published 2021 May 18. DOI:10.1208/s12248-021-00593-x

https://doi.org/10.1208/s12248-021-00593-x

Van Herck Y, Antoranz A, Andhari MD et al. Multiplexed Immunohistochemistry and Digital Pathology as the Foundation for Next-Generation Pathology in Melanoma: Methodological Comparison and Future Clinical Applications. Front Oncol. 2021; 11: 636681. DOI: 10.3389/fonc.2021.636681.

https://doi.org/10.3389/fonc.2021.636681

Woerl AC, Eckstein M, Geiger J et al. Deep Learning Predicts Molecular Subtype of Muscle-invasive Bladder Cancer from Conventional Histopathological Slides. Eur Urol. 2020; 78(2): 256-264. DOI: 10.1016/j.eururo.2020.04.023.

https://doi.org/10.1016/j.eururo.2020.04.023

Wulczyn E., Steiner D.F., Xu Z., Sadhwani A., Wang H., Flament-Auvigne I., Mermel C.H., Chen P.H., Liu Y., Stumpe M.C. Deep learning-based survival prediction for multiple cancer types using histopathology images. PLoS ONE. 2020; 15:e0233678. DOI: 10.1371/journal.pone.0233678;

https://doi.org/10.1371/journal.pone.0233678

Xu J, Janowczyk A, Chandran S, Madabhushi A. A high-throughput active contour scheme for segmentation of histopathological imagery. Med Image Anal. 2011; 15: 851-862. DOI: 10.1016/j.media.2011.04.002.

https://doi.org/10.1016/j.media.2011.04.002

Zarella MD, Bowman D, Aeffner F et al. A Practical Guide to Whole Slide Imaging: A White Paper From the Digital Pathology Association. Arch Pathol Lab Med. 2019; 143(2): 222-234. DOI: 10.5858/arpa.2018-0343-RA.

https://doi.org/10.5858/arpa.2018-0343-RA

Zhu W, Xie L, Han J, Guo X. The Application of Deep Learning in Cancer Prognosis Prediction. Cancers (Basel). 2020; 12(3): 603. DOI: 10.3390/cancers12030603.

https://doi.org/10.3390/cancers12030603


Abstract views: 401
PDF Downloads: 280
Published
2021-12-12
How to Cite
1.
Dudin O, Mintser O, Sulaieva O. ARTIFICIAL INTELLIGENCE AND NEXT GENERATION PATHOLOGY: TOWARDS PERSONALIZED MEDICINE . Proc Shevchenko Sci Soc Med Sci [Internet]. 2021Dec.12 [cited 2024Mar.29];65(2). Available from: https://mspsss.org.ua/index.php/journal/article/view/447