Добавил:
Sekretar
kiopkiopkiop18@yandex.ru
t.me/Prokururor I Вовсе не секретарь, но почту проверяю
Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз:
Предмет:
Файл:Ординатура / Хирургия / Библиотека им академика М.И. Перельмана / Книга_5525_Библиотеки_им_академика_М_И_Перельмана.pdf
X
- •Foreword
- •Acknowledgments
- •Editor biographies
- •Yi Wang
- •X. Sharon Qi
- •List of contributors
- •1.2.3 Feature engineering and representation
- •1.2.4 Linear separability
- •1.2.5 Classical models
- •1.1 A brief introduction to AI
- •1.2 Machine learning basics
- •1.2.1 Learning paradigms
- •1.3 Artificial neural networks
- •1.3.1 Feed-forward neural networks
- •1.3.2 Recurrent neural networks
- •1.3.3 Convolutional neural networks
- •1.3.4 Attention
- •1.3.5 Training neural networks
- •1.3.6 Applications and use cases of deep learning
- •1.4 Model training and evaluation
- •1.4.1 Hyperparameters
- •1.4.2 Data split
- •1.4.3 Evaluation metrics
- •1.5 Generative models
- •1.5.1 Generative adversarial networks
- •1.5.2 Diffusion models
- •1.5.3 Applications and use cases
- •1.6 Ethical consideration and bias
- •1.6.1 Transparency and explainability
- •1.6.2 Bias and fairness
- •1.6.3 Data privacy violation
- •1.6.4 Risk and misuse
- •1.7 Summary
- •References
- •2.1 Introduction
- •2.1.2 Staff roles in radiation therapy
- •2.2 Overview of AI in radiation therapy
- •2.2.1 Patient evaluation and dose prescription
- •2.2.2 Treatment simulation
- •2.2.3 Contouring
- •2.2.4 Treatment planning
- •2.2.5 Quality assurance
- •2.2.6 Treatment delivery
- •2.2.7 Response assessment and toxicity management
- •2.3 Summary
- •3.1 Introduction
- •3.1.1 Introduction of clinical decision making and AI
- •3.1.2 The role of AI in clinical decision making
- •3.2 AI algorithms for clinical decision making
- •3.2.2 Radiomics
- •3.2.3 Data integration by AI
- •3.2.4 Interpretability of AI models
- •3.3 Application of AI in clinical decision making
- •3.3.1 Diagnosis and disease phenotyping
- •3.3.2 Personalized treatment
- •3.3.3 Treatment outcome and prognosis prediction
- •3.4 Challenges and future directions of AI in clinical decision making
- •3.4.1 Challenges and concerns
- •3.4.2 Future directions
- •3.5 Summary
- •References
- •4.1 Introduction
- •4.2 Imaging for treatment planning
- •4.2.1 CT simulation
- •4.2.2 4D-CT
- •4.2.3 PET/CT
- •4.2.4 MRI
- •4.3 Imaging for treatment guidance
- •4.3.1 Portal imaging
- •4.3.2 CBCT
- •4.3.3 CT-on-rail and CT-linac
- •4.3.4 MR-linac
- •4.3.5 PET-linac
- •4.4 Imaging for motion management
- •4.4.1 ExacTrac
- •4.4.2 Varian triggered imaging
- •4.4.3 4D-CBCT
- •4.4.4 Cine MRI
- •4.4.5 4D-MRI
- •4.4.6 Surface imaging
- •4.5 Imaging for treatment assessment
- •4.5.1 Contrasted CT
- •4.5.2 PET/CT
- •4.5.3 Functional MRI
- •4.6 Summary
- •5.1 Introduction to big data in radiation oncology
- •5.1.1 Overview of big data
- •5.1.2 Sources of big data in radiation oncology
- •5.1.3 Big data and AI in radiation oncology
- •5.2 Big data lifecycle in radiation oncology
- •5.2.1 Data aggregation and storage
- •5.2.2 Data sharing and security
- •5.4 The application of big data in radiation oncology
- •5.4.1 Medical image segmentation
- •5.4.2 Automatic treatment planning
- •5.4.3 Treatment response prediction
- •5.4.4 Quality assurance and patient safety
- •5.4.5 Clinical decision support
- •5.2.3 Data visualization
- •5.2.4 Knowledge creation and implementation
- •5.2.5 Data archiving and deletion
- •5.3 Big data analytics with AI
- •5.3.1 Data processing and integration
- •5.3.2 AI modeling
- •5.5 Challenges and future perspectives
- •5.6 Summary
- •Reference
- •6.1 The road to ART
- •6.1.1 3D conformal radiotherapy (3DCRT)
- •6.1.2 Intensity modulated radiotherapy (IMRT)
- •6.1.3 Image-guided radiotherapy (IGRT)
- •6.1.4 Adaptive radiotherapy (ART)
- •6.2 ART workflow and implementation
- •6.2.2 Current practice
- •6.2.3 Clinical impact
- •6.3 Considerations for implementing online ART
- •6.3.1 Time as a limiting factor
- •6.3.2 Implications for fast and reliable re-planning
- •6.3.4 Clinical considerations
- •6.4 Summary
- •7.1 Components of ART workflow
- •7.1.1 Simulation
- •7.1.2 Pre-planning
- •7.1.3 Online imaging and daily re-planning
- •7.1.4 Quality assurance
- •7.2 AI-driven ART
- •7.2.1 Simulation
- •7.2.2 Pre-planning
- •7.2.3 AI for delivery
- •7.3 Outlook and future directions
- •7.3.1 Real-time ART with AI
- •7.3.2 Dose escalation and functional adaption with AI
- •7.4 Summary
- •References
- •8.1 Introduction
- •8.2 Synthetic CT: deep learning methods
- •8.2.1 Conventional methods
- •8.2.2 U-Net
- •8.2.3 Generative adversarial networks
- •8.2.4 Denoising diffusion probabilistic model
- •8.3 Synthetic CT from CBCT
- •8.3.1 Noise and artifact reduction
- •8.3.2 Online dose calculation
- •8.3.3 Online image segmentation
- •8.4 Synthetic CT from MRI
- •8.4.1 Synthetic image accuracy
- •8.4.2 Dose calculation in MR-only radiation therapy
- •8.4.3 PET attenuation correction
- •8.4.4 Image registration
- •8.5 Discussion and outlook
- •8.6 Summary
- •References
- •9.1 AI-based image registration and segmentation for ART
- •9.1.1 Adaptive radiation therapy
- •9.2 Artificial intelligence
- •9.2.1 What is machine learning?
- •9.2.2 What is deep learning?
- •9.3 Deep learning: the basic components
- •9.3.1 Convolutional neural networks: looking at the picture
- •9.3.2 Pooling layers: keeping what matters most
- •9.3.3 Fully connected (dense) layers: bringing it all together
- •9.3.4 Activations
- •9.3.5 Loss: driving the model
- •9.3.6 Auto-encoders: remove the noise
- •9.3.7 Supervised versus unsupervised learning
- •9.3.8 Pre-trained convolutional neural networks
- •9.4 Image registration: bringing two images together
- •9.4.1 Registration similarity metrics
- •9.4.2 Types of registrations
- •9.5 AI-based image registration
- •9.5.1 Supervised learning
- •9.5.2 Unsupervised learning
- •9.5.3 Registration in ART
- •9.5.4 Commonalities in architectures
- •9.6 Image segmentation
- •9.6.1 Introduction: coloring by the numbers
- •9.6.2 Segmentation networks
- •9.6.3 Best practices
- •9.7 Summary
- •10.1 Introduction
- •10.1.1 Overview of chapter content
- •10.2 The landscape of AI-assisted dose prediction
- •10.2.1 Traditional machine learning for dose prediction
- •10.2.2 Deep learning-based dose prediction
- •10.2.3 Challenges in AI-assisted dose prediction
- •10.3 Re-planning workflows powered by AI
- •10.3.1 Deep learning for re-planning pipelines
- •10.4 Future directions of AI-assisted dose prediction and re-planning
- •10.5 Summary
- •11.1 Introduction
- •11.2.1 Imaging-based motion monitoring
- •11.2.2 Delivery system actions
- •11.2.3 Challenges for real-time ART implementation
- •11.3 AI in real-time ART workflows
- •11.3.1 Improving intrafraction motion monitoring through AI
- •11.3.2 Mitigating system latency through AI
- •11.4 AI for ART delivery: future directions
- •11.4.1 Management of non-respiratory motion
- •11.4.2 Training AI models with small or unpaired datasets
- •11.4.4 Biology-guided ART delivery
- •11.5 Summary
- •References
- •12.1 Introduction
- •12.2 Patient QA
- •12.2.1 Pre-planning QA
- •12.2.2 Pre-treatment plan QA
- •12.2.3 On-treatment QA
- •12.3 Treatment delivery systems and instruments
- •12.3.1 Machine commissioning
- •12.3.2 Machine QA
- •12.3.3 Dosimetry tool QA
- •12.4 Summary
- •References
- •13.1 Data resources for response modeling in radiotherapy
- •13.1.1 Clinical data
- •13.1.2 Imaging (radiomics)
- •13.1.3 Treatment planning (dosiomics)
- •13.1.4 Multiomics
- •13.2 Radiotherapy treatment outcome modeling
- •13.2.1 TCP/NTCP in radiotherapy
- •13.2.2 Clinical outcomes versus PROs
- •13.2.3 Machine learning response prediction
- •13.2.4 Explainability of ML response models
- •13.2.5 Sample use cases
- •13.3 AI response-based adaptive radiotherapy
- •13.3.1 Requirements and challenges
- •13.3.2 Prediction versus treatment optimization
- •13.3.3 Sample use cases
- •13.4 Challenges and recommendations
- •13.5 Summary
- •Acknowledgments
- •References
- •14.1 Overview of challenges in AI-driven ART
- •14.2 Data challenges
- •14.2.1 Data availability
- •14.2.2 Data quality
- •14.2.3 Data privacy
- •14.3 Technical challenges
- •14.3.2 Model robustness and generalizability
- •14.3.3 Model explainability and interpretability
- •14.4 Challenges associated with online and real-time workflows
- •14.4.1 Image quality
- •14.4.2 Dose calculation
- •14.4.3 Real-time ART
- •14.5 Operational challenges
- •14.5.1 Clinical validation
- •14.5.3 Staff training
- •14.5.4 User experiences
- •14.5.5 Quality management program
- •14.5.6 Financial challenges
- •14.6 Ethical, regulatory, and legal challenges
- •14.6.1 Ethical issues
- •14.6.2 Regulatory and legal issues
- •14.7 Summary
- •References
- •15.1 Clinical considerations for CT-based offline ART
- •15.1.1 Patient and site selection
- •15.1.2 Re-simulation
- •15.1.3 Re-planning
- •15.1.4 Plan summation and evaluation
- •15.1.6 Limitations and future directions
- •15.2 Clinical considerations for CBCT/CT-based online ART
- •15.2.2 Patient and site selection
- •15.2.3 Simulation
- •15.2.4 Pre-planning review
- •15.2.5 Reference planning
- •15.2.9 Limitations and future directions
- •15.3 Summary
- •References
- •16.1 Introduction
- •16.2 Overview of MRI-guided ART systems
- •16.3 MRI-guided ART workflow
- •16.4 AI applications for MRI-guided ART
- •16.4.1 Synthetic CT generation
- •References
- •16.4.2 Auto-segmentation
- •16.4.3 Image registration
- •16.4.4 Others
- •16.4.5 Future AI development and implementation
- •16.5 Summary
- •17.1 Functional PET-guided ART
- •17.1.1 PET-based functional imaging overview
- •17.1.2 From anatomy to function: the power of PET in radiation therapy
- •17.1.5 Conclusions and future prospects
- •17.2 Functional MRI-guided ART
- •17.2.1 From anatomy to function: the power of functional MRI in radiation therapy
- •17.2.4 Conclusion and future prospects
- •17.3 Summary
- •References
- •18.1 Proton ART
- •18.1.1 Clinical context and necessity
- •18.1.2 Patient populations
- •18.1.4 Rationale for AI in proton ART
- •18.2 AI in proton ART
- •18.2.1 Imaging
- •18.2.2 Deformable and rigid registration
- •18.2.3 Contour propagation
- •18.2.4 Dose calculations
- •18.2.5 Plan optimization
- •18.2.6 Other developments
- •18.3 Implementation of adaptive proton therapy
- •18.4 Summary
- •References
- •19.1 Designing clinical trials with AI
- •19.1.1 The essential role of clinical trials
- •19.1.2 Trial protocols and methodologies
- •19.1.3 AI-driven clinical trial design and execution
- •19.1.4 Incorporation of digital twins (DTs) in clinical trials
- •19.2 Implementation of AI in ongoing clinical trials
- •19.2.1 Integration with existing clinical trial frameworks
- •19.2.2 Quality assurance, compliance, and standardization
- •19.3 Case studies of AI in adaptive radiotherapy trials
- •19.3.1 Overview of guidance for advanced radiotherapy in clinical trials
- •19.3.2 AI in the radiotherapy clinical trial quality assurance processes
- •19.4 Ethical and regulatory considerations
- •19.4.1 Patient consent and data privacy
- •19.4.2 Bias, fairness, and transparency
- •19.4.3 Regulatory guidelines and compliance
- •19.5 Future directions and challenges
- •19.5.1 Emerging technologies and techniques
- •19.5.2 Alternative strategies
- •19.6 Conclusion
- •19.7 Summary
- •References
- •20.1 Risk management
- •20.1.1 Prospective risk assessments
- •20.1.2 Root cause analysis

Artificial Intelligence in Adaptive Radiation Therapy
[58] Zhu H, Zhu Q, Wang Z, Yang B, Zhang W and Qiu J 2023 Patient-specific quality assurance
prediction models based on machine learning for novel dual-layered MLC linac Med. Phys.
50 1205–14
[59] Tozuka R et al 2023 Improvement of deep learning prediction model in patient-specificQA
for VMAT with MLC leaf position map and patient’s dose distribution J. Appl. Clin. Med.
Phys.
24 e14055
[60] Li Q and Chan M F 2017 Predictive time-series modeling using artificial neural networks for
linac beam symmetry: an empirical study Ann. N. Y. Acad. Sci.
[61] Carlson J N K, Park J M, Park S Y, Park J I, Choi Y and Ye S J 2016 A machine learning
approach to the accurate prediction of multi-leaf collimator positional errors Phys. Med.
Biol.
61 2514–31
[62] Nakamura S et al 2023 Deep learning-based detection and classification of multi-leaf
collimator modeling errors in volumetric modulated radiation therapy J. Appl. Clin. Med.
Phys.
24 e14136
[63] Kida S et al 2018 Cone beam computed tomography image quality improvement using a
deep convolutional neural network Cureus
[64] Yang B, Liu Y, Zh u J, Dai J and Men K 2023 Deep learning framework to improve the
quality of cone-beam computed tomography for radio therapy scenarios Med. Phys.
7641–53
[65] Kurosawa T, Nishio T, Moriya S, Tsuneda M and Karasawa K 2020 Feasibility of image
quality improvement for high-speed CBCT imaging using deep convolutional neural
network for image-guided radiotherapy in prostate cancer Phys. Med.
[66] Isaksson M, Jalden J and Murphy M J 2005 On using an adaptive neural network to predict
lung tumor motion during respiration for radiotherapy applications Med. Phys.
[67] Pohl M, Uesaka M, Takahashi H, Demachi K and Bhusal Chhatkuli R 2022 Prediction of
the position of external markers using a recurrent neural network trained with unbiased
online recurrent optimization for safe lung cancer radiotherapy Comput. Methods Programs
Biomed.
[68] Bukovsky I et al 2015 A fast neural network approach to predict lung tumor motion during
respiration for radiation therapy applications BioMed Res. Int.
[69] Eisenhauer E A et al 2009 New response evaluation criteria in solid tumours: revised
RECIST guideline (version 1.1) Eur. J. Cancer
[70] Cha K H et al 2017 Bladder cancer treatment response assessment in CT using radiomics
with deep-learning Sci. Rep.
[71] Choi S J, Park K J, Heo C, Park B W, Kim M and Kim J K 2021 Radiomics-based model
for predicting pathological complete response to neoadjuvant chemotherapy in muscleinvasive bladder cancer Clin. Radiol.
[72] Xu Y et al 2019 Deep learning predicts lung cancer treatment response from serial medical
imaging Clin. Cancer Res.
[73] Liu K et al 2024 Development and validation of a deep learning signature for predicting
lymphovascular invasion and survival outcomes in clinical stage IA lung adenocarcinoma: a
multicenter retrospective cohort study Transl. Oncol.
[74] Zhang X et al 2024 Exploring non-invasive precision treatment in non-small cell lung cancer
patients through deep learning radiomics across imaging features and molecular phenotypes
Biomark Res.
222 106908
7 8738
25 3266–75
12 12
10 e2548
45 228–47
76 627.e13–621
42 101894
1387 84–94
50
80 84–91
32 3801–9
2015 489679
2-18

Artificial Intelligence in Adaptive Radiation Therapy
[75] Chen X et al 2017 Assessment of treatment response during chemoradiation therapy for
pancreatic cancer based on quantitative radiomic analysis of daily CTs: an exploratory study
PLoS One
[76] Kunkyab T et al 2023 Radiomic analysis for early differentiation of lung cancer recurrence
from fibrosis in patients treated with lung stereotactic ablative radiotherapy Phys. Med. Biol.
68 165015
[77] Dean J et al 2018 Incorporating spatial dose metrics in machine learning-based normal tissue
complication probability (NTCP) models of severe acute dysphagia resulting from head and
neck radiotherapy Clin. Transl. Radiat. Oncol.
[78] Gabryś H S, Buettner F, Sterzing F, Hauswald H and Bangert M 2018 Design and selection
of machine learning methods using radiomics and dosiomics for normal tissue complication
probability modeling of xerostomia Front. Oncol.
[79] Cunliffe A, Armato S G 3rd, Castillo R, Pham N, Guerrero T and Al-Hallaq H A 2015 Lung
texture in serial thoracic computed tomography scans: correlation of radiomics-based
features with radiation therapy dose and radiation pneumonitis development Int. J.
Radiat. Oncol. Biol. Phys.
[80] Chen S, Zhou S, Yin F F, Marks L B and Das S K 2007 Investigation of the support vector
machine algorithm to predict lung radiation-induced pneumonitis Med. Phys.
[81] Zhen X et al 2017 Deep convolutional neural network with transfer learning for rectum
toxicity prediction in cervical cancer radiotherapy: a feasibility study Phys. Med. Biol.
8246–63
12 e0178961
8 27–39
8 35
91 1048–56
34 3808–14
62
2-19

IOP Publishing
Artificial Intelligence in Adaptive Radiation Therapy
Yi Wang and X. Sharon Qi
Chapter 3
Artificial intelligence in clinical decision making
Xinyu Zhang, Jiang Zhang, Xinzhi Teng, Yuanpeng Zhang and Jing Cai
With the fast development of artificial intelligence (AI) technologies, their application in clinical decision making has been broadly explored. This chapter provides an
overview and fundamental understanding of AI in clinical decision making. It starts
with a brief introduction of clinical decision making and medical AI, followed by the
development of medical AI and its algorithms designed to handle various clinical data.
Specifically, radiomics, a common method to develop models from medical images,
and the algorithms to integrate diverse clinical data types and improve interpretability
of medical AI are introduced. Then, the applications of AI in various clinical scenarios
are listed, encompassing diagnosis and disease phenotyping, personalized treatment,
as well as treatment outcome and prognosis prediction. In the end, the existing
challenges and potential future directions for further developments of medical AI are
discussed. Overall, this chapter provides insights into the current state, major
applications, and future prospects of AI in clinical decision making.
3.1 Introduction
3.1.1 Introduction of clinical decision making and AI
Clinical decision making refers to the process in which the healthcare providers
make decisions when they are diagnosing and treating patients, aiming to provide
accurate diagnosis and optimal treatment to maximize benefits for patients. It
happens in the entire process of disease management involving several aspects:
Information acquisition: Enquire into the disease history of the patient, conduct
physical and laboratory examinations, and gather other related information
to understand the patient’s condition.
Problem identification and diagnosis: Identify potential health problems by
analysing the obtained information and make a diagnosis.
Treatment planning: Recommend appropriate treatment schemes according to
diagnosis, diseaseprogress, the healthcare provider’sexperienceand knowledge,
and other conditions (economic, patient’s preference, etc).
doi:10.1088/978-0-7503-6119-4ch3 3-1 ª IOP Publishing Ltd 2025. All rights,
including for text and data mining (TDM), artificial intelligence (AI) training, and similar technologies, are reserved.

Artificial Intelligence in Adaptive Radiation Therapy
Follow-up: Monitor disease progress and treatment effect and make adjustments
if needed.
Traditional clinical decision making is an exhaustive, comparative, and selective
process. After considering the basic conditions of patients, healthcare providers will:
‘(1) list all possible actions, (2) list all possible outcomes, (3) predict the probability
of each outcome from each action, and then (4) select the best action based on
outcome likelihood and outcome utility’ [1]. In practice, this process mostly relies on
the subjective experience and professional knowledge of healthcare providers,
leading to various and suboptimal decisions. Furthermore, owing to the development of modern technology, there is an explosively increasing volume and types of
medical information, encompassing high-resolution images, continuous physiological records, genome sequencing data, and so on. Effective interpretation of such
medical big data surpasses the capability of humans alone but can be achieved by
artificial intelligence (AI) using advanced machine learning or deep learning
algorithms, thereby making more personalized and accurate clinical decisions.
In recent decades, the application of AI in medicine has been explored broadly.
The topics vary from diagnostic support systems [2] and risk prediction models [3]to
personalized medicine [4] and outcome prediction [5]. They aim to harness the
potential of AI to facilitate accurate, effective, and personalized clinical decision
making using various AI techniques. In health data analytics, AI has inherent
advantages in the efficient processing of data with large amounts and variety, and in
objective decision making. Previous research also highlighted multiple benefits of AI
applications in healthcare, including accelerating the decision-making process [6, 7],
enhancing clinical decision-making capacity [8, 9], improving patient outcomes [10,
11], and so on. In all, AI has shown great potential in the medical field. As
recognized by healthcare providers, AI could serve as a powerful tool in clinical
practice and dramatically change the overall workflow of clinical decision making in
the future.
3.1.2 The role of AI in clinical decision making
3.1.2.1 Diagnostic decision support
Diagnosis is the first critical decision healthcare providers make during the process
of disease management. In 1998, the first commercial computer-aided diagnosis
(CAD) system was approved by the United States Food and Drug Administration
(FDA) for mammography. Subsequently, more commercial CAD systems for other
medical images, such as computer tomography (CT) and magnetic resonance
imaging (MRI), received FDA approval. To date, CAD is the most widely used
application of AI in real-world clinical settings, particularly in the departments
relying highly on images (radiology, pathology, gastroscopy, etc). Unlike computer
diagnosis that aims at replacing humans, CAD provides recommendations or
potential diagnoses to healthcare providers who make the final diagnosis. The
usefulness of CAD in disease detection and diagnosis has been confirmed by
3-2

Artificial Intelligence in Adaptive Radiation Therapy
previous research including for lung nodules [ 12, 13], calcifications [14, 15], intracranial aneurysms [16], fractures [17, 18], and so on. In addition, CAD can largely
accelerate the diagnosis process from minutes to seconds, which is critical for some
acute events, such as stroke and hemorrhage [6].
3.1.2.2 Patient profiling and precise medicine
Patient profiling involves gathering and analysing a variety of information on
patients to discover the characteristics that are relevant to disease conditions and
treatment response. Patient profiles include all the clinical, pathological, biological,
and other information, allowing AI to extract insights associated with disease
severity and classification. Many diseases, such as cancer, are heterogeneous and
contain subtypes yet to be discovered. In this regard, AI has been used in genomic
profiling and multi-omics integration for the discovery of new subtypes, contributing
to a deeper understanding of disease mechanisms and characteristics [19].
Furthermore, the capability of AI-based patient profiling in facilitating precise
medicine was also evaluated [20]. In addition, AI also plays an important role in new
drug development based on precise patient profiling [21].
3.1.2.3 Treatment assessment and prognosis prediction
The ultimate goal of clinical decision making is to improve the treatment outcome of
patients. With AI assessing treatment response and predicting prognosis, healthcare
providers are able to choose the appropriate therapeutics for patients and prevent
them from unnecessary toxicity. One current method to evaluate treatment response
is the response evaluation criteria in solid tumors (RECIST) based on tumor size
change. However, some studies noticed that tumors may change in density or
vascularization without obvious change in size [22]. For such changes that are less
perceptible to human eyes, radiomics has shown great potential by detecting the
texture changes of tumors on medical images for the prediction of treatment toxicity
[23], survival [24], metastasis [25], and recurrence [26].
3.2 AI algorithms for clinical decision making
3.2.1 Workflow of AI development in clinical decision making
The AI algorithms for clinical decision making are mostly developed by the datadriven approach where the associations between a particular clinical endpoint and
patient demographics are established in a quantitative manner. Personalized clinical
decisions can be made based on accurate predictions of individual clinical outcomes.
Several steps are generally involved during the development of AI algorithms,
including data acquisition, feature engineering, and model construction and
evaluation.
3.2.1.1 Data acquisition
The acquisition of data for the development of medical AI typically involves various
components. Routinely produced clinical data can be retrospectively exported from
3-3

Artificial Intelligence in Adaptive Radiation Therapy
the electronic medical record system (EMRS) as texts or tables. Imaging and
structured data are mostly exported from imaging consoles or radiotherapy treatment planning systems following the digital imaging and communications in
medicine (DICOM) standard. Some non-routine data, such as region-of-interest
(ROI), that are not used for treatment plan evaluation (e.g. peritumoral region [27]),
can be either manually drawn or automatically generated. Deep-learning-based
auto-segmentation can also be used to accelerate the ROI generation, with optional
manual adjustments.
3.2.1.2 Feature engineering
Feature engineering plays a crucial role in the workflow of AI, encompassing feature
extraction, removal of non-repeatable features, and selection of relevant and
independent features.
Feature extraction involves extracting reliable and meaningful quantitative
features from multi-level data. In the context of medical images, features are
extracted to capture intensity and texture characteristics, either by predefined
mathematical formulas within a defined volume of interest or deep learning
algorithms [28]. Additionally, geometric features can be utilized to quantify the
relative positions and shape of tumors in relation to surrounding organs [10]. For
radiation dose maps, quantitative features could include dose–volume-histogram
(DVH) features and dosiomics features, which encompass radiomic-based features,
and momentum-based features [29].
The removal of non-repeatable features eliminates features that cannot be
reproduced under the same settings. Assessment of feature repeatability often
involves utilizing test–retest cohorts or introducing perturbations to generate
pseudo-test–retest cohorts [30]. By removing non-repeatable features, the generalizability of the model is enhanced, ensuring more reliable and consistent performance [31].
Feature selection focuses on identifying independent features that significantly
contribute to the desired outcome for subsequent model construction. Accurate
selection of features plays a vital role in enhancing model performance by
incorporating only the most informative and discriminative features with a minimum risk of overfitting.
3.2.1.3 Model construction and evaluation
Constructing models involves selecting appropriate algorithms based on the selected
features and the specific clinical task. Common machine learning algorithms include
support vector machines, logistic regression, k-nearest neighbors, decision trees,
random forests, and extreme gradient boosting. Area under the receiver operating
characteristic curve (AUC), accuracy, F1 score, sensitivity, specificity, precision,
positive predictive value (PPV), and negative predictive value (NPV) are commonly
used to evaluate the performance of the model. Generalizability and imbalanced
data are two factors significantly impacting model performance. Generalizability
3-4

Artificial Intelligence in Adaptive Radiation Therapy
Figure 3.1. The process of model construction and evaluation.
Figure 3.2. Common workflow of radiomics.
refers to how well a model trained on certain clinical data performs on unseen data.
Techniques such as small-sample learning, manifold learning, and transfer learning
can improve the generalizability of models. On the other hand, imbalanced datasets
can be addressed through methods such as resampling or ensemble algorithms [32].
Figure 3.1 briefly illustrates the model construction and evaluation process.
3.2.2 Radiomics
Similar to general AI development, a typical workflow of radiomics involves data
acquisition, data preprocessing, feature extraction, and model development. The
process of data acquisition has been demonstrated in the previous section. Data
preprocessing involves enhancing data quality by harmonization and removing
irrelevant information, which can minimize bias and improve sensitivity. A large
number of quantitative handcrafted or deep learning features can then be extracted
from medical images. Finally, machine learning or deep learning models can be
constructed from the extracted radiomics features. To reduce the risk of overfitting
and enhance the model stability, several procedures can be adopted to reduce the
3-5

Artificial Intelligence in Adaptive Radiation Therapy
number of features based on variance, collinearity, and relevance to clinical before
model development. Figure 3.2 shows the common workflow of radiomics.
Radiomics feature mapping is a high-dimensional representation that visualizes
radiomics feature distribution at different locations of the i mage. It can facilitate
the explanations of the selected radiomics features and the final developed models
by identifying the regions that contribute significantly to the positive and negative
predictions. They can be further utilized for more intuitive clinical decision
making. For example, the size of the highlighted tumor subregion based on the
mapping of the radiomics feature discovered from the global value retains the
predictive value of treatment efficacy for adjuvant chemotherapy on patients with
locoregionally advanced nasopharyngeal carcinoma (NPC) [33]. It can also be
directly applied to image mapping tasks, such as lung functional map generation
from static CT images [34].
3.2.3 Data integration by AI
The individual clinical data of a patient is composed of various aspects of clinical
information including the following categories. (i) Electronic medical record (EMR)
data: patients’ basic information, medical history, diagnostic records, treatment
plans, etc. (ii) Medical imaging data: such as x-ray images, CT scans, MRI scans,
etc. (iii) Laboratory test data: laboratory test results of blood, urine, tissue samples,
etc. (iv) Vital signs data: physiological parameters of the patient such as heart rate,
body temperature, blood pressure, etc. Data integration aims to analyse data from
various sources, enabling more comprehensive personalized medical recommendations for clinical decision making. AI, through automating data extraction and
transformation as well as various advanced techniques, can enhance the process of
data integration.
Multi-omics involves the comprehensive analysis of two or more individual omics
disciplines, such as genomics, transcriptomics, proteomics, metabolomics, and
radiomics. It combines biological information from various levels and scales to
obtain more accurate prediction. On the other hand, multi-view in machine learning
refers to the fusion of data represented by multiple different feature sets [35]. For
example, each type of electroencephalogram signal features extracted using different
methods, such as wavelet packet decomposition (WPD), short-time Fourier transform (STFT), kernel principal component analysis (kernel PCA), can be considered
as a view. In comparison to the previous two methods, multi-modal machine
learning has a broader scope as it encompasses a wider range of data types. In the
clinical context, each source or form of information can be referred to as a modality
[36]. It can be diverse data describing the same patient (such as patient records,
medical images, lab reports, etc), or it can be imaging data generated by different
imaging devices (such as x-ray, CT, MRI, etc). Multi-modal machine learning aims
to build models that can handle and correlate multi-modal data, thereby leveraging
the complementary nature of different modalities. While the three concepts are not
exactly the same, they share similarities in terms of integrating diverse information.
Whether multi-omics, multi-view, or multi-modal integration is used, it goes beyond
3-6

Artificial Intelligence in Adaptive Radiation Therapy
simply stitching together different types of data, aiming to overcome the limitations
of individual data sources and modalities.
3.2.4 Interpretability of AI models
Model interpretability is the ability to explain and understand the internal
mechanisms and predictions of an AI model. The absence of interpretability of AI
model predictions hinders the understanding of its underlying mechanisms, thereby
the practical applications of medical AI. There are two major approaches to achieve
interpretability. The first approach involves reducing the intrinsic complexity of
machine learning models to enhance interpretability. Intrinsic interpretable machine
learning models can display the relationship between model inputs and outputs, such
as the explainable boosting machine (EBM) model. The second approach is post-hoc
interpretability, which involves conducting interpretability analysis after model
construction. Methods such as SHapley Additive exPlanations (SHAP) and local
interpretable model-agnostic explanations (LIME) fall into this category. The scope
of interpretability includes both global interpretability and local interpretability.
Global interpretability provides an overall view of the model’s features, weights,
parameters, or structure. Local interpretability explains the prediction results of
individual instances [37].
Instead of the interpretability of AI models, clinical practitioners often place more
emphasis on the interpretability of features, particularly on how features are related
to clinical objectives. The interpretability of individual features can provide meaningful explanations for the predicted results. Certain features of AI models may have
biological significance themselves. For example, the interpretability of radiomics
features can be enhanced by exploring their associations with tumor heterogeneity.
Feature importance is a common method to interpret features by revealing the
weights and magnitudes of features that are globally or locally interpretable in
complex models [38]. A widely adopted and intuitive approach is correlation
analysis, which assesses the significance of features by calculating the correlation
coefficients between the features and the target. In addition, post-hoc interpretability
methods such as SHAP can also analyse the importance of features by calculating
their contributions to the model predictions, as shown in figure 3.3.
A fuzzy rule describes a fuzzy logical relationship. It consists of fuzzy conditions
and a fuzzy conclusion and is typically structured in an ‘IF–THEN’ form. The fuzzy
conditions describe the state of the input variables, while the fuzzy conclusion
describes the state of the output variable. Fuzzy rules are interpretable because they
use natural language terms (e.g. ‘high’, ‘medium’, ‘low’) and have intuitive logical
reasoning relationships. The fuzzy model conducts fuzzy reasoning based on fuzzy
rules, and then transforms fuzzy output into specific operations. The classical
Takagi–Sugeuo–Kang (TSK) fuzzy model determines the parameters of the conclusion part of the fuzzy rule by parameter estimation [39]. The TSK fuzzy model is
widely used in the field of AI due to its good nonlinear approximation ability and
strong interpretability.
3-7

Artificial Intelligence in Adaptive Radiation Therapy
Figure 3.3. Example of SHAP plots based on the breast cancer dataset (an open-source dataset in Python’s
scikit-learn library). (a) Waterfall plot for local interpretation . Th e x-axis represents SHAP values and the
y-axis repres ents feature names and their corresponding values in an individual sample. (b) Summary plot
for global interpretation. The x-axis represents SHAP values and the y-axis repres ents feature names.
The importance of features decreases sequentially from top to bottom.
3.3 Application of AI in clinical decision making
3.3.1 Diagnosis and disease phenotyping
Early disease detection aims to promptly identify diseases, enabling timely intervention and management. AI, particularly in conjunction with medical imaging, has
demonstrated substantial potential in disease detection. In recent years, COVID-19
has had a profound impact on global public health, for which medical imaging is
frequently employed to detect suspected COVID-19 cases. Numerous AI models
based on chest x-ray images have been developed for automated diagnosis and
enhanced accuracy in lung disease classification. For instance, an interpretable TSK
fuzzy system has been developed to leverage radiomics features extracted from chest
x-ray images to detect COVID-19, which achieved a high level of classification
accuracy while preserving interpretability [40]. Additionally, a two-step feature
3-8
Соседние файлы в папке Библиотека им академика М.И. Перельмана
