Добавил:
kiopkiopkiop18@yandex.ru t.me/Prokururor I Вовсе не секретарь, но почту проверяю Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз: Предмет: Файл:

Ординатура / Хирургия / Библиотека им академика М.И. Перельмана / Книга_117_библиотеки_им_акад_М_И_Перельмана

.pdf
Скачиваний:
2
Добавлен:
15.09.2026
Размер:
15 Мб
Скачать
☆
240
Table 2 HERNIA-20’s surgical approximation performance of DTC and its ablated forms
Model/input data Causal Noncausal
Trivial 12.5 12.5 Endoscopic vision semantic mask 64.5±9.67 70.1±5.17 ImageNet 70.6±4.77 76.6±4.04 System events 39.4±19.04 40.6±17.87 Raw endoscopic vision 41.4±8.91 47.1±10.10 Robot kinematics 52.3±8.75 65.9±8.41 Proposed DTC 84.1±4.11 87.6±3.91
R. S. R. Somula et al.
operations and measurements. We demonstrated DTC, a surgical state estimate method that simultaneously uses a wide range of inputs to make educated estima­tions about the ne-grained state of a RAS.The effectiveness of DTC was proved with HERNIA-20, a real-world RAS dataset with two temporal granularities of sur­gical states. Endoscope, robot kinematics, and system events will all go into DTC in order to provide a comprehensive picture. DTC’s surgical superstate approximation enhances the presentation of state-of-the-art approaches in grained state approxima­tion by as much as 16.3 percentage points when tested on a wide variety of different RAS environment. Through an ablation trial, we also demonstrated how important each type of input data is for achieving accurate surgical super(state) calculations. Though we focused on illustrative purposes, DTC’s design may be improved to enable more effective training and inference, as well as the introduction of correla­tion across hierarchical levels. Possible future uses in RAS include surgical auton­omy and collaborative control. Model Explainability Improvement enhanced the interpretability and transparency of AI models used in RAS classication by devel­oping new XAI techniques tailored for to medical data. Researchers can further explore advanced visualization methods, such as 3D heatmaps and attention mecha­nisms, to provide more intuitive explanations to surgeons and medical professionals.
References
1. Stringeld SB, Parry L, Eisenstein S, Horgan S, Kane CJ, Ramamoorthy SL (2017) Ten-year review of robotic surgery at an academic medical center. J Am Coll Surg 225(4):S79
2. Qin Y, Pedram SA, Feyzabadi S, Allan M, McLeod AJ, Burdick JW, Azizian M (2020) Temporal segmentation of surgical sub-tasks through deep learning with multiple data sources. IEEE Int Conf Robot Autom:371–377
3. Qin Y, Feyzabadi S, Allan M, Burdick JW, Azizian M (2020) Davincinet: joint prediction of motion and surgical state in robot-assisted surgery. arXiv. preprint arXiv:2009.11937
4. Qin Y, Allan M, Yue Y, Burdick JW, Azizian M (2021) Learning invariant representation of tasks for robust surgical state estimation. IEEE Robot Autom Lett 6(2):3208–3215
5. Yang G-Z, Cambias J, Cleary K, Daimler E, Drake J, Dupont PE, Hata N, Kazanzides P, Martel S, Patel RV etal (2017) Medical robotics—regulatory, ethical, and legal considerations for increasing levels of autonomy. Sci Robot 2(4):8638
Explainable AI (XAI)-Based Robot-Assisted Surgical Classication Procedure
6. Gao Y, Vedula SS, Reiley CE, Ahmidi N, Varadarajan B, Lin HC, Tao L, Zappella L, Bejar B, Yuh DD, et al. (2014) Jhu-isi gesture and skill assessment working set (jigsaws): a surgical activity dataset for human motion modeling. In: MICCAI Workshop: M2CAI. p.3
7. Padoy N (2019) Machine and deep learning for workow recognition during surgery. Minim Invasive Ther Allied Technol 28(2):82–90
8. Selvaggio M, Fontanelli GA, Ficuciello F, Villani L, Siciliano B (2018) Passive virtual xtures adaptation in minimally invasive robotic surgery. IEEE Robot Autom Lett 3(4):3129–3136
9. Chalasani P, Deguet A, Kazanzides P, Taylor RH (2018) A computational framework for complementary situational awareness in surgical assistant robots. In: IEEE Int Conf Robotic Comp. p.9–16
10. Attanasio A, Scaglioni B, Leonetti M, Frangi AF, Cross W, Biyani CS, Valdastri P (2020) Autonomous tissue retraction in robotic-assisted minimally invasive surgery–a feasibility study. IEEE Robot Autom Lett 5(4):6528–6535
11. Ito F, Jarrard D, Gould JC (2008) Transabdominal preperitoneal robotic inguinal hernia repair. J Laparoendosc Adv Surg Tech 18(3):397–399
12. Gibaud B, Forestier G, Feldmann C, Ferrigno G, Goncalves P, Haidegger T, Julliard C, Katic D, Kenngott H, Maier-Hein L etal (2018) Toward a standard ontology of surgical process models. Int J Comp Assist Radiol Surg 13(9):1397–1408
13. Harel D (1987) Statecharts: a visual formalism for complex systems. Sci Comput Program 8(3):231–274
14. Zia A, Hung A, Essa I, Jarc A (2018) Surgical activity recognition in robot-assisted radical prostatectomy using deep learning. In: A.F etal (eds) Med image comp and comp assist inter. Springer, pp273–280
15. Lea C, Vidal R, Hager GD (2016) Learning convolutional action primitives for ne-grained action recognition. In: IEEE Int Conf robotics and automation, pp1642–1649
16. Yu T, Mutter D, Marescaux J, Padoy N (2018) Learning from a tiny dataset of manual annotations: a teacher/student approach for surgical phase recognition. arXiv. preprint arXiv:1812.00033
17. Zia A, Zhang C, Xiong X, Jarc AM (2017) Temporal clustering of surgical activities in robot­assisted surgery. IJCARS 12(7):1171–1178
18. Krishnan S, Garg A, Patil S, Lea C, Hager G, Abbeel P, Goldberg K (2018) Transition state clustering: unsupervised surgical trajectory segmentation for robot learning. In: Robotics research. Springer, pp91–110
19. Zhang D, Xiao B, Huang B, Zhang L, Liu J, Yang G-Z (2018) A self-adaptive motion scaling framework for surgical robot remote control. IEEE Robot Autom Lett 4(2):359–366
20. Long Y-H, Wu J-Y, Lu B, Jin Y-M, Unberath M, Liu Y-H, Heng P-A, Dou Q (2020) Relational graph learning on visual and kinematics embeddings for accurate gesture recognition in robotic surgery. arXiv. preprint arXiv:2011.01619
21. Twinanda AP, Shehata S, Mutter D, Marescaux J, De Mathelin M, Padoy N (2016) Endonet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86–97
22. Mahmood T, Cho SW, Park KR (2022) DSRD-Net: dual-stream residual dense network for semantic segmentation of instruments in robot-assisted surgery. Expert Syst Appl 202:117420
23. Luongo F, Hakim R, Nguyen JH, Anandkumar A, Hung AJ (2021) Deep learning-based com­puter vision to recognize and classify suturing gestures in robot-assisted surgery. Surgery 169(5):1240–1244
24. Izzetoglu K, Aksoy ME, Agrali A, Kitapcioglu D, Gungor M, Simsek A (2021) Studying brain activation during skill acquisition via robot-assisted surgery training. Brain Sci 11(7):937
25. Qin Y, Allan M, Burdick JW, Azizian M (2021) Autonomous hierarchical surgical state esti­mation during robot-assisted surgery through deep neural networks. IEEE Robot Autom Lett 6(4):6220–6227
241
242
26. Shaei SB, Iqbal U, Hussein AA, Guru KA (2021) Utilizing deep neural networks and electro­encephalogram for objective evaluation of surgeon’s distraction during robot-assisted surgery. Brain Res 1769:147607
27. Fan X, Forsman M, Yang L, Lind CM, Kjellman M (2022) Surgeons’ physical workload in open surgery versus robot-assisted surgery and nonsurgical tasks. Surg Endosc 1-17
28. Peng J, Zhang C, Kang L, Feng G (2022) Endoscope FOV autonomous tracking method for robot-assisted surgery considering pose control, Hand-eye coordination and image denition. IEEE Transactions on Instrumentation and Measurement
29. Kurita T (2019) Principal component analysis (PCA). Computer Vision: A Reference Guide 1–4
30. Sinaga KP, Yang MS (2020) Unsupervised K-means clustering algorithm. IEEE Access 8:80716–80727
31. Bommala H, Aluvalu R, Mudrakola S (2023) Machine learning job failure analysis and predic­tion model for the cloud environment. High-Condence Computing 27:100165
32. Balaji P, Hung BT, Chakrabarti P, Chakrabarti T, Elngar AA, Aluvalu R (2023) A novel arti­cial intelligence-based predictive analytics technique to detect skin cancer. PeerJ Comput Sci 24(9):e1387
33. Goud BH, Shankar TN, Sah B, Aluvalu R (2023) Energy optimization in path arbitrary wire­less sensor network. Expert Syst 16:e13282
R. S. R. Somula et al.
Explainable AI Case Studies inHealthcare
VijayaKumarVakulabharanam, TrupthiMandhula, andSwathiKothapalli
Abstract This book chapter explores the concept of explainable articial intelli-
gence (Explainable AI) in healthcare, emphasizing its importance in readdressing the obstacles presented by black box AI models. The introduction highlights the adaptation of AI in healthcare is on the rise and the need for transparency and inter­pretability. The overview of Explainable AI provides insights into the methods and approaches employed to achieve explainability in AI models. The demonstrated importance of Explainable AI in healthcare highlights its potential to enhance patient outcomes and provide valuable support in clinical decision-making and ensure compliance with ethical and regulatory requirements. The methodology and approach for implementing Explainable AI in healthcare settings, including data collection and preprocessing, are discussed. Various Explainable AI techniques and models used in healthcare, their strengths, limitations, and interpretability levels are examined. Two case studies on retinopathy, skin cancer, and ICU mortality predic­tion diagnosis showcase the practical application of Explainable AI, illustrating how it enhances diagnostic accuracy, provides transparent insights into AI predictions, and fosters collaboration between clinicians and AI systems. In conclusion, Explainable AI plays a pivotal role in healthcare by ensuring transparency, interpret­ability, and trust in AI models, promoting responsible adoption, and improving patient care outcomes.
V. K. Vakulabharanam Department of CSE, Anurag University, Hyderabad, India e-mail: deansoe@anurag.edu.in
T. Mandhula Department of Articial Intelligence, Anurag University, Hyderabad, India e-mail: trupthi.ai@anurag.edu.in
S. Kothapalli (*) Department of Information Technology, Chaitanya Bharathi Institute of Technology, Hyderabad, India e-mail: kswathi_it@cbit.ac.in
Ltd. 2024 R. Aluvalu et al. (eds.), Explainable AI in Health Informatics, Computational Intelligence Methods and Applications,
https://doi.org/10.1007/978-981-97-3705-5_12
243© The Author(s), under exclusive license to Springer Nature Singapore Pte
244
Keywords Explainable articial intelligence · Transparency · Retinopathy · Skin cancer · ICU mortality prediction
V. K. Vakulabharanam et al.
1 Objective
The objective of this chapter is to provide an in-depth exploration of the role of explainable articial intelligence (Explainable AI) in the healthcare sector, demon­strated through insightful case studies. By tracing the historical evolution of AI in healthcare and emphasizing the need for transparency and accountability through Explainable AI, the chapter aims to address challenges and regulatory perspectives. Dening the principles and techniques of Explainable AI, it showcases the practical implementation of these concepts in real-world scenarios such as ICU mortality prediction, diabetic retinopathy detection, and skin cancer diagnosis, offering valu­able insights. Additionally, the chapter delves into current trends, promotes ethical considerations, and encourages collaborative efforts to leverage Explainable AI for responsible and impactful healthcare innovation. Ultimately, this chapter seeks to foster a deeper understanding of Explainable AI’s signicance, its potential for improving healthcare, and its ethical implications in an increasingly AI-driven med­ical landscape.
2 Introduction
The introduction of articial intelligence (AI) has brought about transformative changes across multiple elds, including healthcare, enabling signicant advance­ments in disease diagnosis, treatment planning, patient monitoring, and healthcare management. The lack of transparency and intricate nature of AI models present obstacles in comprehending and interpreting their decision-making mechanisms, which restricts their use in crucial healthcare applications. To tackle this problem, explainable articial intelligence (XAI) methods have emerged as a viable solution, aiming to offer transparent and interpretable AI models.
This chapter explores Explainable AI case studies in the context of healthcare, focusing on the application of Explainable AI techniques to enhance transparency, interpretability, and trust in AI-based healthcare systems. The main objective is to diminish the disparity between complex AI models and end-users, including health­care professionals, patients, and regulatory authorities.
The chapter begins with a comprehensive overview of Explainable AI, explain­ing the fundamental concepts, techniques, and evaluation metrics used in the eld. It emphasizes the importance of interpretability in healthcare [1], highlighting ethi­cal, legal, and societal implications of opaque AI models in sensitive healthcare decision-making processes [2].
Explainable AI Case Studies inHealthcare
245
To showcase the practical implementation of Explainable AI in healthcare, a series of case studies are presented. Each case study addresses a specic healthcare use case, such as diagnosis of diseases, treatment prediction, or forecasting patient risk. These case studies demonstrate the application of Explainable AI techniques in real-world scenarios, showcasing how transparency and interpretability can enhance decision-making, foster trust, and facilitate human–AI collaboration in healthcare settings.
Furthermore, the chapter provides comparative analysis of dissimilar Explainable AI techniques employed in case studies, evaluating their strengths, limitations, and applicability in various healthcare contexts. The comparative analysis aims to guide researchers and practitioners in selecting appropriate Explainable AI techniques, tailoring the approach to meet specic requirements and constraints of their health­care applications.
The discussion and interpretation of the case study results shed light on the insights gained from Explainable AI techniques, emphasizing the importance of transparent and interpretable models in improving clinical decision-making, enhancing patient safety, and fostering understanding of AI-driven healthcare systems.
Nevertheless, it is essential to recognize the constraints and difculties linked to Explainable AI in the healthcare domain. The chapter addresses these limitations, discussing issues such as the trade-off between interpretability and performance, scalability of Explainable AI techniques, data privacy concerns, and potential biases introduced by the interpretability process. Identifying and understanding these arguments are crucial for forthcoming research and expansion of Explainable AI methods in healthcare.
Lastly, the chapter outlines future directions and opportunities in Explainable AI for healthcare, exploring potential areas of improvement, novel techniques, and interdisciplinary collaborations. It discusses the integration of Explainable AI into clinical practice, regulatory guidelines for AI interpretability, and the potential of human-centered design approaches to enhance the usability and acceptance of Explainable AI systems in healthcare.
Overall, this chapter provides a wide range of understanding of Explainable AI case studies in healthcare, demonstrating their transformative potential and high­lighting the importance of interpretability in enabling safe, reliable, and ethical AI applications. By showcasing practical examples and discussing key challenges and future directions, this chapter intends to inspire further research and foster the adop­tion of Explainable AI in healthcare, ultimately beneting patients, healthcare pro­fessionals, and society at large.
In order to comprehensively explore the “Explainable AI case studies in health­care,” this chapter has been thoughtfully divided into several distinct sections. These sections have been strategically crafted to illuminate different dimensions and angles of the “Explainable AI case studies in healthcare,” providing readers with a widespread grasp of its intricacies. By delving into these sections, readers will embark on a journey that gradually unfolds the nuanced layers of “Explainable AI
246
case studies in healthcare.” To facilitate this exploration, the following sections delineate the path we will traverse:
1. Introduction: Brief description of the content and objectives of the chapter on
“Explainable AI case studies in healthcare.”
2. Background and Motivation: Introduction to Explainable AI’s role in medical
contexts, addressing challenges of AI opacity.
3. Overview of Explainable AI: Denitions, concepts, techniques, and visualization
methods for AI interpretability.
4. Case Study-1: ICU Mortality Prediction Using Machine Learning and
Explainable AI: Applying Explainable AI to enhance transparency in ICU mor­tality predictions.
5. Case Study-2: Diabetic Retinopathy Detection Using Explainable AI Techniques:
Showcasing the application of Explainable AI in enhancing diabetic retinopathy diagnosis.
6. Case Study-3: Skin Cancer Detection Using Explainable AI Techniques:
Illustrating Explainable AI’s impact on interpretable skin cancer diagnosis.
7. Conclusion: Summarizing ndings from case studies, discussing broader impli-
cations, and suggesting future directions.
V. K. Vakulabharanam et al.
3 Background andMotivation
3.1 Evolution ofArticial Intelligence inHealthcare
3.1.1 Historical Overview ofUse ofAI inHealthcare
The application of articial intelligence in healthcare has a rich history that dates back several decades. Early applications of AI in healthcare focused on expert sys­tems development and rule-based decision support systems. Expert systems utilized knowledge-based rules and algorithms to mimic the decision-making capabilities of human experts, explicitly in medical domains. These early AI systems showed promise in areas such as diagnosis, treatment planning, and medical decision sup­port (Table1).
These successful AI applications in healthcare have paved the way for advance research and development. They have demonstrated the potential of AI to augment healthcare professionals, improve diagnostic accuracy, enhance treatment planning, and optimize patient care.
By understanding the historical context and the milestones in the integration of AI in healthcare, we gain insights into the progress made and the challenges that have been overcome. This establishes the groundwork for investigating the capabili­ties of advanced AI techniques, including deep learning, reinforcement learning, and natural language processing, to tackle intricate healthcare challenges.
Explainable AI Case Studies inHealthcare
Table 1 Milestones in AI integration and applications in healthcare
Evolution of AI in healthcare Description Pros Cons
Early AI in healthcare
Expert systems and rule-based decision support systems, mimicked human expert decision-making Used explicit rules and algorithms Promising in diagnosis and decision support
Provided structured decision support The initial step toward automation Showed potential in medical domains
Lack of adaptability to complex scenarios Difculty in capturing nuanced decision-making Reliance on rigid knowledge representation Limited by data and computing power
[20]
Advancements in machine learning
Computer-aided diagnosis and image analysis
Shift toward supervised learning, large-scale data training for pattern recognition Enhanced accuracy and data-driven approaches
AI’s success in diagnosing diseases Application to medical image analysis Automated segmentation, feature extraction, and classication
Improved accuracy in diagnosis Efcient pattern recognition from vast datasets Potential for automation and augmentation
Early disease detection and improved outcomes Efcient and accurate image analysis Enhances diagnostic capabilities
Dependency on quality and quantity of data Possible bias if training data is skewed May not fully capture complex medical relationships [21]
Challenges in interpreting complex results Overreliance on AI without expert oversight Potential for false positives/negatives in diagnosis [21]
247
3.1.2 Advances inMachine Learning andDeep Learning Algorithms
Machine learning has arisen as a powerful tool in healthcare, which enables the development of predictive models, pattern recognition systems, and decision sup­port systems. This section provides an overview of machine learning and its rele­vance in healthcare, tracing the evolution of machine learning algorithms from traditional statistical methods to more complex models. It also explores the emer­gence and impact of deep learning in healthcare, leveraging neural networks and large-scale data. Additionally, it highlights key advancements in machine learning and deep learning techniques specic to healthcare, such as transfer learning, ensemble methods, and reinforcement learning.
Machine learning, which is a subset of AI, encompasses the creation of algo­rithms capable of learning from data and making predictions or decisions without the need for explicit programming. In healthcare, machine learning algorithms have been employed to analyze massive amounts of healthcare data, including electronic
248
V. K. Vakulabharanam et al.
health records, medical images, genomic data, and wearable sensor data. This data­driven approach allows for the extraction of meaningful insights, identication of patterns, and development of predictive models that can aid in diagnosis, treatment planning, and patient monitoring.
The evolution of machine learning algorithms can be traced from traditional sta­tistical methods, such as linear regression and logistic regression, to more advanced models. This progression has involved the development of algorithms such as deci­sion trees, support vector machines (SVM), and random forests, which can effec­tively manage intricate relationships and nonlinearities within the data.
Deep learning, a subset of machine learning, has gained substantial attention in recent years due to its capacity to automatically learn hierarchical representations from data. Deep learning models, particularly neural networks, consist of multiple layers of interconnected articial neurons that mimic the structure of the human brain. They excel at capturing complex patterns and features in data, making them well-suited for tasks such as image and speech recognition.
In healthcare, deep learning has made a substantial impact, especially in medical image analysis and diagnostics. Convolutional neural networks (CNNs), a type of deep learning architecture, have demonstrated remarkable performance in tasks such as detecting tumors in medical images, segmenting organs, and classifying abnormalities. Their ability to learn complex spatial and temporal relationships has opened new possibilities for automated analysis and interpretation of medi­cal images.
Furthermore, several advancements specic to healthcare have been made within the machine learning and deep learning domains. Transfer learning, for instance, allows pretrained models to be ne-tuned on healthcare-specic datasets, enabling the transfer of knowledge and accelerating model development. Ensemble methods combine multiple models to improve prediction accuracy and reduce uncertainty. Reinforcement learning, a branch of machine learning, has shown promise in opti­mizing treatment strategies, clinical decision-making, and resource allocation.
These advancements have expanded the capabilities of machine learning and deep learning in healthcare, enabling more accurate predictions, improved diagnos­tic accuracy, and enhanced treatment planning. However, challenges related to interpretability, scalability, and data quality still exist, and ongoing research aims to address these issues.
3.1.3 Impact ofAI onHealthcare Outcomes andEfciency
The integration of articial intelligence (AI) in healthcare has had a profound impact on healthcare outcomes and efciency. This section explores how AI tech­niques have improved accuracy and precision in disease diagnosis and prognosis, enhanced treatment planning and personalized medicine, optimized healthcare operations and resource allocation, and reduced medical errors, adverse events, and unnecessary healthcare costs. It also includes examples of real-world studies and success stories that showcase the positive impact of AI on healthcare outcomes and efciency.
Explainable AI Case Studies inHealthcare
249
AI techniques have demonstrated the potential to improve accuracy and preci­sion in disease diagnosis and prognosis. Machine learning models trained on large datasets can analyze patient information, such as medical records, imaging data, and genetic proles, to detect patterns and make truthful predictions. This can support in early detection of diseases, enable more targeted treatment approaches, and enhance patient outcomes.
AI-driven decision support systems have the potential to revolutionize treatment planning and personalized medicine. By leveraging patient data, including medical history, genetic information, and treatment response data, AI algorithms can pro­vide tailored recommendations and treatment plans. This can lead to more effective treatments, reduced adverse events, and improved patient satisfaction.
Optimizing healthcare operations and resource allocation is another area where AI algorithms have made a signicant impact. By analyzing data on patient ow, resource utilization, and staff schedules, AI can identify inefciencies and suggest improvements. This can lead to more streamlined workows, reduced wait times, and better allocation of resources, ultimately improving the overall efciency of healthcare delivery.
One of the most critical benets of AI in healthcare is the potential to reduce medical errors, adverse events, and unnecessary healthcare costs. AI algorithms can analyze patient data and identify potential risks or anomalies that may go unnoticed by human healthcare providers. By providing real-time alerts and decision support, AI can help healthcare professionals avoid errors, mitigate risks, and optimize treat­ment plans. This can result in improved patient safety, reduced healthcare- associated costs, and better utilization of healthcare resources.
Real-world studies and success stories provide concrete evidence of the positive impact of AI on healthcare outcomes and efciency. These studies showcase how AI has contributed to improved accuracy in diagnosing diseases such as cancer, reduced hospital readmission rates, and enhanced patient monitoring. They highlight the transformative potential of AI in addressing critical healthcare challenges and improving patient care.
While the impact of AI on healthcare outcomes and efciency is substantial, it is essential to address the limitations and challenges associated with the use of black box AI models in healthcare. These models lack transparency and interpretability, making it challenging to understand and trust their decisions. This raises concerns about the ethical, legal, and societal implications of opaque AI systems in health­care. Addressing these limitations is crucial to ensure responsible and ethical use of AI in healthcare settings.