Добавил:
Sekretar
kiopkiopkiop18@yandex.ru
t.me/Prokururor I Вовсе не секретарь, но почту проверяю
Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз:
Предмет:
Файл:Ординатура / Хирургия / Библиотека им академика М.И. Перельмана / Книга_117_библиотеки_им_акад_М_И_Перельмана
.pdf
260
https://t.me/med1917
V. K. Vakulabharanam et al.
4.4 Explainable AI Techniques andApproaches
The section provides an overview of various methods and approaches that have been
developed to enhance interpretability in AI models. The focus is on techniques that
generate explanations for AI decisions. This section covers several key methods:
• Rule-based explanations: Rule-based approaches provide explanations in the
form of interpretable rules that capture the decision-making logic of the AI
model. These rules can be easily understood and interpreted by humans, as they
follow a logical structure. Rule-based methods often involve extracting decision
rules from the model or learning rule sets directly from the data.
• Feature importance analysis: Feature importance analysis methods aim to iden-
tify the input features that have the most signicant inuence on the model’s
decisions. They quantify the contribution of each feature in determining the out-
put and provide a ranking or scoring mechanism. Feature importance analysis
helps users understand which features are driving the model’s decisions and can
aid in identifying key factors or patterns in the data.
• Model-agnostic techniques: Model-agnostic techniques are designed to provide
explanations for any type of AI model, regardless of its architecture or complex-
ity. Examples include Local Interpretable Model-agnostic Explanations (LIME)
and SHapley Additive exPlanations (SHAP). These methods approximate the
behavior of the black box model locally and generate explanations that are inter-
pretable and faithful.
• Model-specic approaches: Model-specic approaches are tailored to specic
types of AI models and leverage their inherent structures or mechanisms to pro-
vide explanations. For example, attention mechanisms in neural networks can
highlight the input features or regions that the model focuses on when making
decisions. These approaches exploit the unique characteristics of the model to
generate context-specic explanations.
The choice of Explainable AI technique depends on various factors, including
the type of AI model, the specic domain or application, and the desired level of
interpretability. Different techniques offer different trade-offs between simplicity,
accuracy, and exibility. The selection should be based on the specic requirements
of the application and the intended audience for the explanations.
It is important to note that Explainable AI techniques are constantly evolving,
with ongoing research and development to enhance their effectiveness and applicability. The section highlights the diverse range of methods available and provides a
foundation for readers to explore and choose the most suitable Explainable AI techniques for their own applications and AI models.
Explainable AI Case Studies inHealthcare
https://t.me/med1917
261
4.5 Evaluation andValidation ofExplainable AI
The section focuses on the challenges and considerations involved in assessing the
quality and effectiveness of Explainable AI methods. It addresses the need for robust
evaluation techniques to ensure that the explanations generated by Explainable AI
techniques are accurate, meaningful, and useful. The section may include the following aspects:
• Quality of explanations: Evaluation of Explainable AI methods involves assess-
ing the quality of the explanations generated by these techniques. This includes
examining the clarity, coherence, and relevance of the explanations. Evaluators
may consider criteria such as the comprehensibility of the explanations, their
delity to the underlying AI model, and their ability to capture the important fac-
tors that inuenced the AI’s decision-making.
• Usefulness and actionability: Explainable AI explanations should not only be
interpretable but also provide actionable insights to the users. Evaluators assess
the extent to which the aid of the explanation in decision-making, enable users to
understand the model’s behavior, and guide users toward more informed actions.
Usefulness can be measured by user feedback, decision accuracy, or decision
condence.
• Metrics and evaluation criteria: Evaluation of Explainable AI techniques often
involves the denition and application of metrics and evaluation criteria. These
metrics can be quantitative, such as accuracy or delity scores, or qualitative,
relying on subjective assessments from domain experts or end-users. The choice
of metrics depends on the specic goals of the Explainable AI application and
the context in which the explanations are used.
• User studies and feedback: User studies play a crucial role in evaluating the
effectiveness and comprehensibility of Explainable AI explanations. Feedback
from users, such as domain experts or end-users, provides insights into the
usability, interpretability, and usefulness of the explanations. User studies can
involve surveys, interviews, or usability testing to gather feedback and improve
the Explainable AI techniques.
• Comparison to baseline models: Evaluation of Explainable AI methods often
involves comparing them to baseline models or alternative explanation tech-
niques. This helps determine whether the Explainable AI technique provides bet-
ter or more informative explanations than existing approaches. Comparison can
be done using objective measures or user preferences and can contribute to estab-
lishing the value of the Explainable AI technique.
It is important to consider that evaluation and validation of Explainable AI methods are ongoing research areas, and there is no one-size-ts-all approach. Different
Explainable AI techniques and applications may require tailored evaluation methodologies. Researchers and practitioners continually explore new evaluation techniques to ensure the reliability, trustworthiness, and usability of Explainable AI
explanations.
262
https://t.me/med1917
V. K. Vakulabharanam et al.
4.6 Current Trends andFuture Directions
The section provides an overview of the ongoing developments and emerging directions in the eld of Explainable AI.It highlights the dynamic nature of Explainable
AI research and the potential for future advancements. The section may cover the
following aspects:
• Improved interpretability of deep learning models: Deep learning models, known for
their complexity and black box nature, pose challenges for interpretability. Ongoing
research focuses on developing techniques to enhance the interpretability of deep
learning models. This includes methods such as attention mechanisms, layer-wise
relevance propagation, and network pruning techniques that enable the identication
of important features and decision-making processes within deep neural networks.
• Advancements in Explainable AI explainability techniques: The eld of
Explainable AI continues to evolve with the development of new explainability
techniques and approaches. Researchers explore innovative methods for generat-
ing more transparent and intuitive explanations, such as integrating natural lan-
guage processing techniques to provide textual justications for AI decisions or
leveraging visualization techniques to present explanations in a more intuitive
and understandable manner.
• Integration of Explainable AI in real-world applications: Explainable AI tech-
niques are increasingly being integrated into real-world applications across vari-
ous domains, including healthcare. Ongoing efforts focus on applying Explainable
AI in clinical decision support systems, medical imaging analysis, drug discov-
ery, and personalized medicine. The section may highlight specic examples of
successful integration of Explainable AI in healthcare applications, showcasing
how interpretability contributes to improved decision-making, patient outcomes,
and regulatory compliance.
• Interdisciplinary collaborations: The importance of interdisciplinary collabora-
tions is emphasized in advancing the eld of Explainable AI. Collaboration
between AI researchers, healthcare professionals, ethicists, and policymakers are
crucial for addressing the ethical, legal, and societal implications of Explainable
AI in healthcare. Such collaborations ensure that Explainable AI techniques are
developed and applied in a responsible, transparent, and ethically sound manner.
• Ethical and social considerations: The section may touch upon the ethical and
social considerations associated with Explainable AI in healthcare. It discusses
the need for addressing issues such as bias, fairness, privacy, and informed con-
sent when deploying Explainable AI models in healthcare settings. Ongoing
research and discussions in these areas aim to establish guidelines, regulations,
and best practices for the ethical and responsible use of Explainable AI in health-
care as shown in Fig.3.
By highlighting the current trends and future directions in Explainable AI research
and development, the section provides readers with insights into the dynamic nature
of the eld and the potential for transformative impact. It encourages researchers,
practitioners, and stakeholders to actively contribute to the advancement of
Explainable AI and its responsible integration into real-world applications.
Explainable AI Case Studies inHealthcare
https://t.me/med1917
Fig. 3 Future explainable AI in health care [22]
263
5 Case Study-1: ICU Mortality Prediction Using Machine
Learning andExplainable AI
5.1 Problem Statement
The problem statement is to develop a predictive model for ICU mortality. Early
identication of patients at high risk of mortality in the intensive care unit (ICU) can
help healthcare providers allocate resources and interventions more effectively,
leading to improved patient outcomes.
5.2 Data Analysis andModel Training
The dataset for this study includes clinical data from ICU patients, such as demographics, vital signs, laboratory results, medical history, and severity scores. The
data is collected from electronic health records (EHR) and other relevant sources.
Preprocessing steps are performed to handle missing values, remove outliers, and
normalize or scale the data.
5.3 Feature Engineering andSelection
Feature engineering techniques are applied to extract meaningful features from the
raw data. These includes calculating severity scores, deriving physiological parameters, and creating time-dependent variables. Feature selection methods such as correlation analysis and feature importance ranking are used to identify the most
relevant predictors for ICU mortality. The dataset is split into training and testing
264
ζπ
zh
()
()+()
()
][
https://t.me/med1917
sets, with cross-validation techniques applied during model training to assess
generalizability.
“Gradient boosting classier” is a machine learning algorithm that combines
multiple weak learners (decision trees) to create a strong predictive model. It is
known for its high accuracy and ability to handle complex relationships between
features [18].
V. K. Vakulabharanam et al.
5.4 Explainable AI Techniques Applied
LIME (Local Interpretable Model-agnostic Explanations) is a model-agnostic
Explainable AI technique that provides explanations for individual predictions to
improve the interpretability for the top-performing model.
LIME is based on
• Employing understandable representations of data instances that humans can
comprehend.
• Creating an interpretable (linear) model to estimate the behavior of the black box
model around a specic data instance.
• Introducing slight variations to the data instance to produce new samples, assign-
ing weights based on how closely they resemble the original instance.
• Training the interpretable model using these new samples and utilizing it to fur-
nish explanations for the predictions of the black box model.
Formally, considering a black box model denoted as “f,” a specic data instance
of interest labeled as “x,” and an explanatory model represented as “h,” [ 3] the problem of identifying a local surrogate model is same as optimization of the objective
function denoted as ζ(x):
xhHL fh
=
where πx is a kernel function that weighs a sample z based on its distance to the
instance of interest x, L is a loss function, and Ω is a complexity penalty. The explanation model h is chosen from a class H of interpretable models such as logistic,
linear, or decision tree models. The complexity term Ω(h) used to constrain the
number of modal parameters or tree depth by including a cost for greater complexity.
The loss function L quanties how accurately the explanation model approximates the black box model in the vicinity of instance x. The loss function L is
approximated by relating random perturbations to the instance of interest to generate a set of new samples z. The samples are weighted by the kernel πx(z) that penalizes the distance between x and z kernel. The process ow of LIME is as follows:
1. Create the perturbed data:
• Generate perturbed data by introducing small random variations to the original observations.
argmin ,,
Ω
x
3
(1)
Explainable AI Case Studies inHealthcare
https://t.me/med1917
2. Predict the output on the perturbed data:
• Make predictions using a model on the perturbed data to observe how the
model’s output changes with slight input variations.
3. Create discretized features:
• Discretize the continuous features into distinct categories or bins to simplify
the representation of the data.
4. Find the Euclidean distance of perturbed data to the original observation:
• Computer the Euclidean distance between the perturbed data points and the
original observation to quantify the extent of distortion.
5. Convert distance to similarity score:
• Transform the distance values into similarity scores, where smaller distances
correspond to higher similarities.
6. Select the top n features for the model:
• Choose the most relevant features by selecting the top “n” features that contribute signicantly to the model’s performance.
7. Create a linear model and explain the prediction:
• Develop a linear model that utilizes the selected features to make predictions.
Interpret the model’s coefcients to understand how each feature impacts the
predictions as shown in Fig.4.
265
Fig. 4 Process ow of LIME [4]
266
https://t.me/med1917
V. K. Vakulabharanam et al.
5.5 Interpretation andInsights
The AI techniques can identify key features that strongly inuence ICU mortality
predictions. The features, which include lactate levels, blood pressure, and heart
rate, can serve as valuable indicators for clinicians in assessing the severity and
prognosis of critically ill patients.
Enhanced Understanding The Explainable AI techniques provided interpretability, offering transparent explanations for individual predictions [5]. This helps
healthcare professionals gain insights into the reasoning behind the model’s predictions, increasing their trust and enabling them to make more informed decisions.
5.6 Conclusion
The case study demonstrates the effectiveness of the developed predictive model
and the value of Explainable AI techniques in ICU mortality prediction. The model
can achieve high accuracy and provided interpretable insights into the prediction
process. The integration of Explainable AI techniques enhanced transparency, facilitating clinicians’ understanding of the model’s decisions. These ndings have signicant implications for clinical decision-making and can support healthcare
professionals in delivering more targeted and timely care to critically ill patients.
The case study on ICU mortality prediction, employing machine learning and
Explainable AI with LIME, holds current value in enhancing ICU mortality forecasts and resource management. This approach brings transparency and interpretability to AI models, departing from traditional methods and paving the way for
broader AI integration in healthcare’s future. This envisions a future where machine
learning and Explainable AI, exemplied by LIME, not only yield accurate predictions but also empower clinicians with interpretable insights, transforming medical
decision-making practices [6].
6 Case Study-2: Diabetic Retinopathy Detection Using
Explainable AI Techniques
6.1 Problem Statement
Among individuals with diabetes, diabetic retinopathy stands out as a prominent
cause of vision loss and blindness. Timely intervention and treatment heavily rely
on the early detection and classication of diabetic retinopathy. However, traditional diagnostic methods are often time-consuming and prone to subjective
Explainable AI Case Studies inHealthcare
https://t.me/med1917
267
interpretations. This case study aims to leverage deep learning models and the
implementation of Explainable AI (XAI) techniques aims to enhance the accuracy,
transparency, and interpretability of diabetic retinopathy detection.
According to projections by the International Diabetes Federation (IDF), the
number of individuals with diabetes is estimated to reach 600 million by 2035 and
700 million by 2045 (see Fig.5). The symptoms of diabetic retinopathy are frequently noticed by individuals only after damage has already occurred, as depicted
in Fig.6, which shows the view from both healthy eyes and eyes affected by diabetic
retinopathy.
Fig. 5 Diabetes data report 2010–2045 from IDF [7]
Fig. 6 The healthy eye vision vs diabetic retinopathy affected eye vision
268
https://t.me/med1917
V. K. Vakulabharanam et al.
6.2 Data Analysis andModel Training
The study utilizes retinal fundus images as the input data for diabetic retinopathy
diagnosis. A comprehensive analysis of available datasets is conducted to gather a
representative and diverse collection of retinal images. This data is then preprocessed, including resizing, normalization, and augmentation, to enhance model performance and generalization.
The dataset consists of 2594 training images and 1068 testing images, which
have been split into a 70% training dataset and a 30% testing dataset (Table2).
The dataset contains grayscale images as shown in Figs.7 and 8.
6.2.1 Convolutional Neural Networks (CNNs)
CNNs are employed as the primary deep learning architecture for diabetic retinopathy classication. The chosen model is trained on preprocessed data using suitable
loss functions and optimization algorithms. The training process involves partitioning the data into training, validation, and testing sets, and iteratively rening the
model’s parameters to minimize classication error.
Table 2 Distribution of dataset of diabetic retinopathy (DR) [20, 21]
DR Train Test
Positive 1329 528
Negative 1265 540
Fig. 7 Fundus with no diabetic retinopathy
Explainable AI Case Studies inHealthcare
https://t.me/med1917
Fig. 8 Fundus with diabetic retinopathy
269
The CNN is a specialized form of articial neural network widely employed in
supervised learning for tasks involving image recognition and processing. By analyzing pixel data, CNNs excel in identifying and categorizing images. To ensure an
accurate comparison of important features, it has become imperative to delve into a
new discipline known as Explainable AI within the context of CNNs used for image
classication [8].
Explainable AI pertains to a eld within AI that emphasizes understanding and
visualizing the underlying logic behind predictions made by deep learning models.
It facilitates the identication of key image features that inuenced the classication
process. One notable technique within the realm of Explainable AI is Grad-CAM,
an acronym for gradient-weighted class activation mapping. Grad-CAM extends the
capabilities of another Explainable AI method called class activation mapping (CAM).
6.3 Explainable AI Techniques Applied
To address the interpretability challenge of deep learning models, Explainable AI
techniques are applied to the trained CNN model. The selected Explainable AI techniques include saliency maps, class activation mapping (CAM), and feature importance analysis. Saliency maps accentuate the crucial regions of the input image that
play a signicant role in inuencing the model’s decision. CAM provides spatial
localization of the disease-specic features in the retinal image. Feature importance
analysis identies the most inuential features or pixels that contribute to the model’s decision-making process.
Соседние файлы в папке Библиотека им академика М.И. Перельмана