<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Comparison of artificial intelligence algorithms and expert approach in risk classification in nephrology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dawid Pawuś</string-name>
          <email>dawid.pawus@student.po.edu.pl</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Szczepan Paszkiel</string-name>
          <email>s.paszkiel@po.edu.pl</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tomasz Porażko</string-name>
          <email>tomasz.porazko@usk.opole.pl</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Departament of Internal Medicine and Nephrology, Institute of Medical Sciences, University of Opole</institution>
          ,
          <addr-line>Oleska 48 Street, Opole, 45-052</addr-line>
          ,
          <country country="PL">Poland</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Departament of Nephrology with Dialysis Unit, Opole University Hospital</institution>
          ,
          <addr-line>Witosa 26 Street, Opole, 46-020</addr-line>
          ,
          <country country="PL">Poland</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>University of Technology</institution>
          ,
          <addr-line>Prószkowska 76 Street, 45-758 Opole</addr-line>
          ,
          <institution>Faculty of Electrical Engineering</institution>
          ,
          <addr-line>Automatic Control and Informatics</addr-line>
          ,
          <country country="PL">Poland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This study presents a comparative analysis of various artificial intelligence (AI) and machine learning (ML) algorithms for risk classification in idiopathic membranous nephropathy (IMN), a complex kidney disease. The research evaluates seven different models, including K-Nearest Neighbors, Decision Trees, Random Forests, Support Vector Machines, Adaptive Boosting, LightGBM, and Multilayer Perceptron. The results reveal that ensemble methods, particularly Random Forests, achieve the highest precision in classifying IMN risk levels, highlighting their potential in improving diagnostic accuracy and patient management in nephrology. The study underscores the importance of model selection and fine-tuning to optimize AI applications in clinical settings, providing a basis for future advancements in AI-driven nephrology.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Historically, nephrology has relied on manual analysis, which presents challenges when
dealing with complex data sets, often leading to diagnostic errors and suboptimal treatment
choices. The ongoing advancements in numerical algorithms and artificial intelligence offer new
opportunities to enhance kidney health monitoring. This progress allows for greater diagnostic
accuracy and more precise treatment strategies. The synergy between expert medical
knowledge and the automation capabilities of algorithms is paving the way for systems that can
effectively address complex nephrological challenges.</p>
      <p>Glomerular diseases, a subset of kidney conditions, specifically target the glomeruli— tiny
structures in the kidneys that filter blood and produce urine. These diseases can arise from
various causes, including infections, autoimmune disorders, hypertension, diabetes, and other
metabolic conditions.</p>
      <p>This article provides a comparative approach to different AI algorithms that can be used in
risk classification of patients with a nephrological disease called idiopathic membranous
nephropathy (IMN). The concept is to create an extended and multi-task expert system that
would be tasked with supporting nephrologists’ decisions in their daily work in treating patients
with kidney diseases. The risk classification module is therefore crucial from the perspective of
the domain expert, who can determine the further course of action based on the patient’s
assignment to a specific group. The range of algorithms ranges from simple linear approaches to
complex and advanced gradient solutions. The expertise of nephrologists is also leveraged along
with advances in engineering. Focusing on specific applications, our goal is to show how these
advances can impact the standards of patient care, ultimately improving the outcomes of
traditional approaches. Figure 1 provides a general outline of the methodology, scope of the
study and the approach used to address the problem.</p>
      <p>The next section will provide a detailed literature review and an overview of the state of the
art.</p>
    </sec>
    <sec id="sec-2">
      <title>2.State of the art and related works</title>
      <p>This literature review examines the use of automation, artificial intelligence, and classification
systems in the field of nephrology. It delves into how these advanced technologies streamline
processes, increase diagnostic precision, and improve patient outcomes. Through a critical
analysis of the current literature, the goal is to uncover trends and identify gaps, thereby guiding
future research toward innovative solutions in the field of nephrology.</p>
      <p>Advancements in artificial intelligence, innovation, and transformative technologies are
pivotal in nephrology and dialysis [2–4]. Additionally, the future prospects of AI and modern
technologies in managing kidney diseases are extensively reviewed [5, 6]. Research focusing on
numerical models and machine learning techniques also holds considerable importance [7–9].</p>
      <p>A key area in nephrology research is the integration of acute kidney injury (AKI) with
AIdriven predictive algorithms [10, 11]. Another significant focus includes the development of
predictive models in the context of personalized medicine [12]. AI-based clinical applications in
nephrology are explored in works by [13] and [14]. Furthermore, ethical considerations
surrounding AI applications are discussed in [15] and [16].</p>
      <p>Recent research underscores the integration of AI and machine learning within nephrology.
For instance, [17] develops short-term prognosis prediction models for severe AKI patients
undergoing PIRRT (Prolonged Intermittent Renal Replacement Therapy), utilizing algorithms
such as Naive Bayes and Random Forest, and highlighting the critical role of serum electrolyte
management. Another study [18], introduces Sugeno's fuzzy inference system for regression
problems involving numerous variables and limited data, demonstrating superior performance
over traditional methods.</p>
      <p>In addition, [19] presents health-disease phase diagrams (HDPDs) for visualizing disease
onset probabilities, while [20] develops CKD.Net, a hybrid model that achieves high accuracy in
predicting CKD stages. Other significant contributions include [21], which focuses on precise
kidney volume measurement using AI, and [22], which addresses PRCC (Papillary Renal Cell
Carcinoma) stage classification. Furthermore, [23] showcases the importance of machine
learning in predicting AKI and diagnosing PDAC (Pancreatic Ductal Adenocarcinoma).</p>
      <p>A study derived and validated an ML risk score for predicting diabetic kidney disease
(DKD) progression using biomarker and electronic patient data [24]. Research into interpretable
ML for early AKI prognosis emphasizes model interpretability benefits [25]. ML has also been
utilized to predict primary nephrotic syndrome pathology without biopsy and identify hub
genes in membranous nephropathy [26, 27]. A model for predicting idiopathic membranous
nephropathy prognosis is discussed in [28]. ML models predicting rituximab underdosing in
membranous nephropathy show high accuracy, sensitivity, and specificity [29]. Another study
reports a machine learning framework for diagnosing membranous nephropathy from
wholeslide images, achieving a 97.32% F1-score [30].</p>
      <p>A belief rule-based system for diagnosing primary membranous nephropathy shows
significant reliability with 98% sensitivity, 96.9% specificity, 97.8% accuracy, and an AUC of 0.93
[31]. A predictive model for long-term renal function impairment post-minimally invasive
partial nephrectomy has a concordance index of 0.75 [32]. The use of AI and ML in dialysis is
reviewed, focusing on diagnostics, prognosis, and treatment optimization [33]. Guidelines for
proper application and transparent reporting of ML models in biomedical research emphasize
best practices [34]. Recent literature highlights the crucial role of clinical prediction models in
modern healthcare, emphasizing challenges and the need for transparent reporting to assess
their quality [35]. The literature underscores the importance of understanding diagnostic and
prognostic prediction models, addressing issues such as model development, validation, and
sample size considerations to improve clinical decision-making [36–38], as well as valuable
research [39, 40].</p>
    </sec>
    <sec id="sec-3">
      <title>3. Structure, research scope and methodology in the problem of automatic risk classification</title>
      <p>This section explores the development of an expert system for diagnosing and treating
idiopathic membranous nephropathy, focusing specifically on the risk classification module.
The system is structured as a hierarchical decision tree that integrates clinical data, diagnostic
criteria, and therapeutic guidelines to assist nephrologists in managing IMN.
3.1.</p>
      <sec id="sec-3-1">
        <title>General overview of system modules</title>
        <p>The expert system consists of several key components, which are shown in Figure 2 and briefly
described below:
1. Diagnostic Module – the diagnosis of (IMN) is confirmed through a combination of
patient history, diagnostic tests, and kidney biopsy. The evaluation also considers the
likelihood of progression to stage 5 chronic kidney disease (CKD5) by analyzing
glomerular filtration rate, levels of proteinuria, and serum albumin concentrations.
2. Risk Stratification – patients are classified into four distinct risk categories – low,
intermediate, high, and very high – based on factors such as estimated glomerular
filtration rate (eGFR) and proteinuria levels. Each category is associated with specific
management strategies tailored to the risk profile.
3. Therapeutic Module – treatment recommendations vary from conservative
management to more aggressive immunosuppressive therapies, depending on the risk
category. Options include ACE inhibitors or ARBs, rituximab, calcineurin inhibitors,
cyclophosphamide, and corticosteroids.
4. Treatment Effectiveness Assessment Module and Treatment Continuation Module –
patient response to treatment is re-evaluated after six months. Based on clinical
indicators, the treatment plan may be continued, modified, or altered. Protocols are
provided for deciding on the appropriate course of action.
5. Follow-up Module – guidelines are provided for the long-term monitoring and
management of patients who achieve partial or complete remission, including strategies
for addressing treatment resistance and managing relapses.
6. User Interface – the system includes a user-friendly graphical interface designed for ease
of use by healthcare professionals.</p>
        <p>In this article, we focus solely on the Risk Stratification Module (see Fig. 2) of the expert
system, which plays a crucial role in assigning patients to specific risk groups for targeted
management. The comparative analysis involves various AI algorithms, from basic linear
methods to advanced gradient-based solutions, alongside traditional expert approaches.
The details will be explained in the following sections of the article.</p>
        <p>The remaining components of the system – such as diagnostic, therapeutic, and followup
modules – will be explored in future research. This initial focus on risk classification aims to
demonstrate how AI advancements can enhance traditional nephrological practices and
improve patient outcomes.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Input-output model of the classification system</title>
        <p>This subsection details the process of modeling the classification system, presenting the input
variables and their corresponding output classifications. The classification model processes
clinical parameters to categorize IMN patients into risk groups using a Multi Input Single Output
(MISO) framework. The authors used the information provided in the guidelines in [41]. The 11
inputs to this model, detailed below, include a range of variables:
1. eGFR (Estimated Glomerular Filtration Rate) – a measure of kidney function estimating
how well the kidneys filter blood.
2. Proteinuria – the level of protein present in the urine.
3. Serum Albumin Concentration – the concentration of albumin in the blood.
4. Response to ACEi/ARB Treatment – the percentage reduction in proteinuria after 6
months of treatment with ACE inhibitors or ARBs.
5. Serum anti-PLA2R Concentration – the level of anti-PLA2R antibodies in the serum.
6. Urinary α1-microglobulin Concentration – the concentration of α1-microglobulin in the
urine.
7. Urinary IgG Concentration – the concentration of IgG in the urine.
8. Urinary β2-microglobulin Concentration – the concentration of β2-microglobulin in the
urine.
9. Selectivity Index – the ratio of different urinary protein components indicating the
selectivity of proteinuria.
10. Nephrotic Syndrome Symptoms – the presence of severe symptoms associated with
nephrotic syndrome (binary value).
11. Rapid Renal Function Impairment – a swift decline in kidney function not attributable to
other diseases (binary value).</p>
        <p>The classification model uses machine learning to provide accurate and reliable risk
assessments. Risk categories are defined by specific clinical criteria, and integrating machine
learning techniques significantly increases the model’s capabilities:
1. Low Risk
• eGFR &gt; 60 ml/min/1.73 m²
• Proteinuria &lt; 3.5 g/d
• Serum albumin &gt; 30 g/l OR
• eGFR &gt; 60 ml/min/1.73 m²
• Proteinuria &lt; 3.5 g/d or a reduction &gt; 50% after 6 months of ACEi/ARB treatment
2. Moderate Risk
• eGFR &gt; 60 ml/min/1.73 m²
• Proteinuria &gt; 3.5 g/d and no reduction &gt; 50% after 6 months of ACEi/ARB treatment OR
• Does not meet high risk criteria
3. High Risk
• eGFR &lt; 60 ml/min/1.73 m² and/or Proteinuria &gt; 8 g/d for 6 months OR
• eGFR &gt; 60 ml/min/1.73 m²
• Proteinuria &gt; 3.5 g/d and no reduction &gt; 50% after 6 months of ACEi/ARB treatment, plus
one of the following:
a. Serum albumin &lt; 2.5 g/dl
b. Serum anti-PLA2R &gt; 50 RU/ml
c. Urinary β2-microglobulin &gt; 40 μg/min
d. Urinary IgG &gt; 1 μg/min
e. Urinary β2-microglobulin &gt; 250 mg/d
f. Selectivity Index &gt; 0.20
g. Very High Risk
h. Life-threatening nephrotic syndrome symptoms OR
• Rapidly progressive renal impairment not caused by other diseases.</p>
        <p>Machine learning algorithms are excellent at identifying complex interactions between
multiple input variables that may not be apparent with rule-based logic alone. This leads to a
more nuanced understanding of a patient’s risk profile. The guidelines above provide a
framework for categorizing data, but they cannot account for every possible combination of lab
results and other factors. Nor could a rule-based system easily provide a way to determine which
output category values fall into. This gives AI and ML methods an advantage in these types of
tasks.</p>
        <p>Machine learning models leverage historical patient data to identify patterns and correlations
that enhance the precision of risk classification predictions. This approach, driven by data,
refines decision boundaries and reduces the likelihood of misclassification. A key benefit of
machine learning models is their capacity to adapt and become more accurate as new data is
introduced. Furthermore, certain machine learning models offer insights into the probability of
data belonging to specific classes.</p>
        <p>The next section will describe in detail the considered algorithms.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4.Overview of algorithms used in the study</title>
      <p>In any problem where automatic classification of collected data is needed, selecting the right AI
models and numerical algorithms is a key step in developing a robust classification system.
Seven AI and ML-based models were selected and tested to provide the best solution to the task.
The models feature different algorithms used, such as tree-based methods, ensemble techniques,
support vector machines, and neural networks. By using different methods, a comprehensive
evaluation and comparison is provided. It also provides researchers with an answer as to which
model performs best in classifying the risk of IMN patients. Below is a brief description of each
algorithm:</p>
      <p>K-Nearest Neighbors (KNN) is a straightforward, non-parametric method used for
both classification and regression. It classifies a data point by considering the most
common class among its  nearest neighbors in the feature space. While KNN is simple
to grasp and implement, it can become computationally heavy with larger datasets.
Decision trees (DT) offer a flexible approach to machine learning for both classification
and regression tasks. They partition data into subsets based on feature values, creating a
tree-like structure of decisions. Though easy to interpret, decision trees can overfit the
data if not properly managed through pruning.</p>
      <p>Random forests (RF) are an ensemble learning method that builds and combines
multiple decision trees to achieve more accurate and stable predictions. By using
different subsets of data and features to construct each tree, random forests enhance
generalization and help reduce overfitting.
4. Support Vector Machines (SVMs) are effective classifiers that determine the optimal
hyperplane for separating classes in the feature space. They work well in
highdimensional settings and can address both linear and non-linear classification problems
through kernel functions.
5. Adaptive Boosting (AdaBoost) is an ensemble technique that merges several weak
classifiers into a strong one. It adjusts the weights of misclassified instances during each
iteration, placing greater emphasis on harder-to-classify examples. Despite its
simplicity, AdaBoost can be sensitive to noisy data.
6. LightGBM is a gradient boosting framework designed for efficiency and scalability,
particularly with large datasets. It uses tree-based learning algorithms and includes
optimizations to improve both speed and memory efficiency.
7. The Multi-layer Perceptron (MLP) Classifier is a type of neural network with multiple
layers of neurons. It is adept at capturing complex patterns in data and can be used for
classification and regression. However, MLPs require careful tuning of hyperparameters
and can involve lengthy training processes.</p>
      <p>This chapter briefly introduces seven different AI and ML models for their usefulness in
classifying the risk of IMN patients. The models reviewed include K-Nearest Neighbors,
Decision Trees, Random Forests, Support Vector Machines, Adaptive Boosting, LightGBM, and
the Multi-layer Perceptron Classifier. Each model offers unique strengths: KNN is
straightforward but computationally intense, DTs are interpretable but prone to overfitting. RFs
improve stability and generalization, SVMs excel in high-dimensional spaces and AdaBoost
focuses on hard-to-classify examples but can be sensitive to noise. LightGBM provides efficiency
and scalability for large datasets, and MLPs capture complex patterns but require extensive
tuning.</p>
      <p>The next chapter will detail the training process of these models and provide a discussion of
the results obtained from their application to the classification task.</p>
    </sec>
    <sec id="sec-5">
      <title>5.Training of models and discussion of achieved results</title>
      <p>In this section, we present the insights gained from the analysis and the results of classifying
nephrology patient data using various machine learning models described in Section 4.</p>
      <p>The original dataset included laboratory results relevant to IMN risk classification. To
mitigate class imbalance and improve model performance, synthetic data augmentation was
applied, generating new data points that mirror the distribution and features of the existing data.
For model training, 200 datasets were used, evenly distributed among the four risk categories:
low, medium, high, and very high, with 50 datasets in each category. An identical number of
datasets were allocated for testing. This approach ensured that the models had ample data for
training and a reliable set for evaluation.</p>
      <p>The comparison of precision scores (see Fig. 3) across various machine learning models in the
context of nephrology risk classification reveals important insights into their performance on
the dataset prepared and described in the preceding sections.</p>
      <p>By analyzing the results in Figure 3, we can discuss in detail the results and implications of
each classifier:
1. MLP Classifier – the MLP classifier achieved a high precision score of 0.96, indicating its
robustness in accurately predicting the positive class in the IMN risk classification task.
This model's architecture, which simulates the neural networks found in biological
brains, has proven effective in capturing the complex, non-linear relationships inherent
in the clinical dataset.
2. LightGBM – in contrast, the LightGBM model exhibited a notably lower precision score
of 0.11. This result is surprising given LightGBM's reputation for efficiency and high
performance in many classification tasks. The poor performance may suggest that the
specific characteristics of the nephrology dataset, or the hyperparameters used, do not
align well with the strengths of this gradient boosting framework. Further investigation
into feature importance and model tuning would be necessary to understand this
anomaly.
3. AdaBoost – Adaptive Boosting yielded a precision score of 0.89, demonstrating its
capability to enhance weak classifiers by focusing on misclassified instances. This
performance indicates that AdaBoost effectively leveraged the synthetic data
augmentation and was able to generalize well across the test dataset.
4. Support Vector Machine – the SVM classifier, with a precision score of 0.93, performed
robustly, confirming its strength in high-dimensional spaces, where it constructs
optimal hyperplanes to segregate different risk classes. This suggests that the SVM is
particularly well-suited to handle the complexity of the feature space derived from
nephrology patient data.
5. Random Forest – the RF model achieved the highest precision score of 0.98. This
ensemble method's exceptional performance underscores its ability to manage the
variability within the dataset by combining the predictions of multiple decision trees,
thereby enhancing overall predictive accuracy.
6. Decision Tree – the single DT model also performed well, with a precision score of 0.96.</p>
      <p>Despite its simplicity compared to ensemble methods, the decision tree's interpretability
and effectiveness in handling this particular dataset are evident from its high score.
7. K-Nearest Neighbors – KNN classifier attained a precision score of 0.88. While KNN is
often sensitive to the local structure of the data and can be affected by noise, its
performance in this scenario indicates a reasonable degree of success in classifying risk
levels among nephrology patients.</p>
      <p>In summary, the Random Forest model emerged as the most effective classifier in terms of
precision, followed closely by the Decision Tree and MLP classifiers. The unusually low
precision score of LightGBM warrants further exploration to identify potential causes and
corrective measures. These findings will inform future work in refining model selection and
optimization for nephrology risk classification tasks.</p>
      <p>The F1-score evaluation of different classifiers (see Fig. 4), as presented in the nephrology risk
classification study, provides deeper insights into the balance between precision and recall
across various models. Here, we discuss the performance of each classifier in terms of its
F1score, which is particularly useful in assessing the model's effectiveness in dealing with the
complexities of an imbalanced dataset:</p>
      <p>MLP Classifier – F1-score of 0.96 confirms strong capability in managing complex,
nonlinear classification, balancing precision and recall effectively
LightGBM – low F1-score of 0.16, suggesting significant struggles with both precision
and recall, making it less suitable for this task.</p>
      <p>Adaptive Boosting – F1-score of 0.84 reflects good performance, particularly in
enhancing classification of difficult instances in imbalanced data.</p>
      <p>Support Vector Machine – SVM scored 0.89 in F1, indicating strong performance with
well-balanced precision and recall, effectively separating risk classes.</p>
      <p>Random Forest – excelled with an F1-score of 0.99, showcasing superior performance by
combining multiple decision trees to minimize errors.</p>
      <p>Decision Tree – DT achieved a high F1-score of 0.94, demonstrating effective
classification by accurately partitioning the feature space.</p>
      <p>K-Nearest Neighbors – F1-score of 0.79 indicates moderate performance, reflecting
challenges in balancing precision and recall, particularly with imbalanced data.</p>
      <p>In conclusion, the Random Forest classifier once again proved to be the most effective model
in terms of the F1-score, closely followed by the MLP and Decision Tree classifiers. The
consistently low performance of LightGBM, as reflected in both precision and F1-score, warrants
further exploration. Overall, these results provide clear guidance on the most appropriate
machine learning models for nephrology risk classification tasks, with a particular emphasis on
the effectiveness of ensemble methods and neural network-based approaches.</p>
      <p>The recall scores (see Fig. 5) across various classifiers in the context of nephrology risk
classification provide key insights into each model's ability to identify relevant cases within the
dataset. Below is a summary of the performance for each classifier:
1. MLP Classifier – the MLP achieved a high recall score of 0.96, confirming its strong
ability to identify nearly all relevant cases, making it one of the most effective models in
this study.
2. LightGBM – the LightGBM model exhibited a low recall score of 0.25, indicating
significant issues with sensitivity and a tendency to miss a substantial number of
relevant cases.
3. Adaptive Boosting – AdaBoost scored 0.85 in recall, suggesting good sensitivity, as it
effectively identified most of the relevant instances in the dataset.
4. Support Vector Machine – the SVM achieved a recall score of 0.88, showing strong
sensitivity and a solid ability to correctly identify relevant cases, with few false
negatives.
5. Random Forest – with an exceptional recall score of 0.99, the Random Forest model
nearly perfectly identified relevant instances, making it highly reliable in this
classification task.
6. Decision Tree – the DT model recorded a high recall score of 0.93, demonstrating its
effectiveness in capturing most relevant cases and minimizing false negatives.
7. K-Nearest Neighbors – KNN classifier achieved a recall score of 0.81, indicating decent
sensitivity but missing some relevant instances, reflecting moderate recall performance.</p>
      <p>In summary, the Random Forest model again demonstrated the highest reliability with its
near-perfect recall score, followed closely by the MLP and Decision Tree classifiers. The low
recall score of LightGBM, similar to its performance in other metrics, suggests that it struggled
significantly with this specific task.</p>
      <p>The confusion matrices (see Fig. 6) presented in the provided figure summarize the
performance of four different machine learning algorithms – KNN, LightGBM, RF, and DT.
The results presented in Figure 6 clearly indicate that the RF algorithm in the classification
model achieved the best results in the course of the study. On the other hand, LightGBM,
similarly to the graphics presented in Figures 3-5, performed the worst, which is confirmed by
the result on the confusion matrix. In the case of the other two algorithms – KNN and DT, their
efficiency in the task of risk classification of patients with IMN is confirmed to be decent, but not
as good as for RF.</p>
    </sec>
    <sec id="sec-6">
      <title>6.Conclusions</title>
      <p>The comparative analysis of various artificial intelligence and machine learning algorithms for
the classification of idiopathic membranous nephropathy risk demonstrates the potential of
these technologies in enhancing traditional nephrological practices. The study evaluated seven
different AI models, including K-Nearest Neighbors, Decision Trees, Random Forests, Support
Vector Machines, Adaptive Boosting, LightGBM, and Multi-layer Perceptron Classifier.</p>
      <p>The results indicate that ensemble methods such as Random Forests outperform other
models, achieving a precision score of 0.98, demonstrating their robustness in handling the
variability within nephrological data. The MLP Classifier and Decision Tree also showed high
precision scores (0.96), suggesting their capability in capturing complex relationships within the
clinical dataset. In contrast, LightGBM's performance was unexpectedly low, with a precision
score of 0.11, indicating that further tuning and investigation into model parameters are
required for this specific application.</p>
      <p>The study highlights that AI models, particularly ensemble methods, can significantly
improve the accuracy of risk classification in nephrology, potentially leading to better patient
outcomes. However, the results also underscore the importance of selecting appropriate models
and fine-tuning them to the specific characteristics of medical datasets. Future research should
focus on optimizing these models and exploring their integration into clinical decision support
systems to assist nephrologists in managing kidney diseases more effectively.</p>
      <p>Overall, this work provides a foundation for the continued exploration and application of AI
in nephrology, emphasizing the need for further validation and refinement to achieve reliable
and clinically applicable tools.
[14] Chan, L.; Vaid, A.; Nadkarni, G. N. (2020). Applications of machine learning methods in
kidney disease: hope or hype?, Current Opinion in Nephrology and Hypertension, Vol. 29,
No. 3, 319–326
[15] Ho, C. W.-L.; Caals, K. (2021). A call for an ethics and governance action plan to harness
the power of artificial intelligence and digitalization in nephrology, Seminars in
Nephrology (Vol. 41), Elsevier, 282–293
[16] Miao, J.; Thongprayoon, C.; Suppadungsuk, S.; Garcia Valencia, O. A.; Qureshi, F.;
Cheungpasitporn, W. (2023). Ethical Dilemmas in Using AI for Academic Writing and
an Example Framework for Peer Review in Nephrology Academia: A Narrative Review,
Clinics and Practice, Vol. 14, No. 1, 89–105
[17] Wei, W.; Cai, Z.; Chen, L.; Yuan, W.; Fan, Y.; Rong, S. (2023). Short-term prognostic
models for severe acute kidney injury patients receiving prolonged intermittent renal
replacement therapy based on machine learning, BMC Medical Informatics and Decision
Making, Vol. 23, No. 1, 133
[18] Kusumadewi, S.; Rosita, L.; Wahyuni, E. G. (2023). Fuzzy linear regression based on a
hybrid of fuzzy C-means and the fuzzy inference system for predicting serum iron levels
in patients with chronic kidney disease, Expert Systems with Applications, Vol. 227,
120314
[19] Nakamura, K.; Uchino, E.; Sato, N.; Araki, A.; Terayama, K.; Kojima, R.; Murashita, K.;
Itoh, K.; Mikami, T.; Tamada, Y.; others. (2023). Individual health-disease phase diagrams for
disease prevention based on machine learning, Journal of Biomedical Informatics, Vol. 144,
104448
[20] Akter, S.; Ahmed, M.; Al Imran, A.; Habib, A.; Haque, R. U.; Rahman, M. S.; Hasan, M. R.;
Mahjabeen, S. (2023). CKD. Net: A novel deep learning hybrid model for effective,
realtime, automated screening tool towards prediction of multi stages of CKD along with
eGFR and creatinine, Expert Systems with Applications, Vol. 223, 119851
[21] Kim, D.-W.; Ahn, H.-G.; Kim, J.; Yoon, C.-S.; Kim, J.-H.; Yang, S. (2021). Advanced kidney
volume measurement method using ultrasonography with artificial intelligencebased
hybrid learning in children, Sensors, Vol. 21, No. 20, 6846
[22] Singh, N. P.; Bapi, R. S.; Vinod, P. (2018). Machine learning models to predict the
progression from early to late stages of papillary renal cell carcinoma, Computers in
Biology and Medicine, Vol. 100, 92–99
[23] Karar, M. E.; El-Fishawy, N.; Radad, M. (2023). Automated classification of urine
biomarkers to diagnose pancreatic cancer using 1-D convolutional neural networks,
Journal of Biological Engineering, Vol. 17, No. 1, 28
[24] Chan, L.; Nadkarni, G. N.; Fleming, F.; McCullough, J. R.; Connolly, P.; Mosoyan, G.; El
Salem, F.; Kattan, M. W.; Vassalotti, J. A.; Murphy, B.; others. (2021). Derivation and
validation of a machine learning risk score using biomarker and electronic patient data
to predict progression of diabetic kidney disease, Diabetologia, Vol. 64, 1504–1515
[25] Hu, C.; Tan, Q.; Zhang, Q.; Li, Y.; Wang, F.; Zou, X.; Peng, Z. (2022). Application of
interpretable machine learning for early prediction of prognosis in acute kidney injury,
Computational and Structural Biotechnology Journal, Vol. 20, 2861–2870
[26] Li, C.; Yao, Z.; Zhu, M.; Lu, B.; Xu, H. (2018). Biopsy-free prediction of pathologic type of
primary nephrotic syndrome using a machine learning algorithm, Kidney and Blood
Pressure Research, Vol. 42, No. 6, 1045–1052
[27]
[28]
[35]
[36]
[37]
[38]
[30]
[31]
[33]
[34]
[29]
[32]</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Kovesdy</surname>
            ,
            <given-names>C. P.</given-names>
          </string-name>
          (
          <year>2022</year>
          ).
          <source>Epidemiology of chronic kidney disease: an update 2022, Kidney International Supplements</source>
          , Vol.
          <volume>12</volume>
          , No.
          <issue>1</issue>
          ,
          <fpage>7</fpage>
          -
          <lpage>11</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Niel</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Bastard</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2019</year>
          ).
          <article-title>Artificial intelligence in nephrology: core concepts, clinical applications, and perspectives</article-title>
          ,
          <source>American Journal of Kidney Diseases</source>
          , Vol.
          <volume>74</volume>
          , No.
          <volume>6</volume>
          ,
          <fpage>803</fpage>
          -
          <lpage>810</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Himmelfarb</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Vanholder,
          <string-name>
            <surname>R.</surname>
          </string-name>
          ; Mehrotra,
          <string-name>
            <surname>R.</surname>
          </string-name>
          ; Tonelli,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>The current and future landscape of dialysis</article-title>
          ,
          <source>Nature Reviews Nephrology</source>
          , Vol.
          <volume>16</volume>
          , No.
          <volume>10</volume>
          ,
          <fpage>573</fpage>
          -
          <lpage>585</lpage>
          Copur,
          <string-name>
            <given-names>S.</given-names>
            ;
            <surname>Tanriover</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Yavuz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ;
            <surname>Soler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            ;
            <surname>Ortiz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Covic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Kanbay</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Novel strategies in nephrology: what to expect from the future?</article-title>
          ,
          <source>Clinical Kidney Journal</source>
          , Vol.
          <volume>16</volume>
          , No.
          <volume>2</volume>
          ,
          <fpage>230</fpage>
          -
          <lpage>244</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Pawuś</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ; Porażko,
          <string-name>
            <given-names>T.</given-names>
            ;
            <surname>Paszkiel</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          (
          <year>2024</year>
          ).
          <article-title>Automation and decision support in the area of nephrology using numerical algorithms, artificial intelligence and expert approachreview of the current state of knowledge, IEEE Access Rosner</article-title>
          ,
          <string-name>
            <given-names>M. H.</given-names>
            ;
            <surname>Berns</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. S.</surname>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Transforming nephrology</article-title>
          ,
          <source>Clinical Journal of the American Society of Nephrology: CJASN</source>
          , Vol.
          <volume>13</volume>
          , No.
          <volume>2</volume>
          ,
          <issue>331</issue>
          Galuzio,
          <string-name>
            <given-names>P. P.</given-names>
            ;
            <surname>Cherif</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          (
          <year>2022</year>
          ).
          <source>Recent Advances and Future Perspectives in the Use of Machine Learning and Mathematical Models in Nephrology, Advances in Chronic Kidney Disease</source>
          , Vol.
          <volume>29</volume>
          , No.
          <volume>5</volume>
          ,
          <fpage>472</fpage>
          -
          <lpage>479</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Narayan</surname>
            ,
            <given-names>S.; others. (2022).</given-names>
          </string-name>
          <article-title>A machine learning model for acute kidney injury prediction with novel kidney biomarkers</article-title>
          ,
          <source>2022 Second International Conference on Next Generation Intelligent Systems (ICNGIS)</source>
          , IEEE,
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Anand</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Verma</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2024</year>
          ).
          <article-title>Artificial intelligence in nephrology</article-title>
          ,
          <source>Artificial Intelligence in Clinical Practice, Elsevier</source>
          ,
          <fpage>201</fpage>
          -
          <lpage>209</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Bajaj</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Koyner</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Cautious optimism: Artificial intelligence and acute kidney injury</article-title>
          ,
          <source>Clinical Journal of the American Society of Nephrology</source>
          , Vol.
          <volume>18</volume>
          , No.
          <volume>5</volume>
          ,
          <fpage>668</fpage>
          -
          <lpage>670</lpage>
          Rank, N.;
          <string-name>
            <surname>Pfahringer</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Kempfert</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; Stamm,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Kühne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ;
            <surname>Schoenrath</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ;
            <surname>Falk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ;
            <surname>Eickhoff</surname>
          </string-name>
          , C.; Meyer,
          <string-name>
            <surname>A.</surname>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Deep-learning-based real-time prediction of acute kidney injury outperforms human predictive performance, NPJ Digital Medicine</article-title>
          , Vol.
          <volume>3</volume>
          , No.
          <volume>1</volume>
          ,
          <fpage>139</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Chaudhari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Sarode</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Udtewar</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Moharkar</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Patil</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Barreto</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>A Review of Artificial Intelligence for Predictive Healthcare Analytics and Healthcare IoT Applications</article-title>
          ,
          <source>International Conference on Intelligent Computing and Networking</source>
          , Springer,
          <fpage>555</fpage>
          -
          <lpage>562</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , H.;
          <string-name>
            <surname>Preddie</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Krackov</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ; Sor,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Waguespack</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ;
            <surname>Kuang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            ;
            <surname>Ye</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            ;
            <surname>Kotanko</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          (
          <year>2022</year>
          ).
          <article-title>Deep learning to classify arteriovenous access aneurysms in hemodialysis patients</article-title>
          ,
          <source>Clinical Kidney Journal</source>
          , Vol.
          <volume>15</volume>
          , No.
          <volume>4</volume>
          ,
          <fpage>829</fpage>
          -
          <lpage>830</lpage>
          Pan, Y.-B.;
          <string-name>
            <surname>Ye</surname>
          </string-name>
          , H.-M.;
          <string-name>
            <surname>Jiang</surname>
            ,
            <given-names>Z.-H.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Chen</surname>
            , D.-J.; Teng,
            <given-names>Y.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Guan</surname>
            ,
            <given-names>C.-A.</given-names>
          </string-name>
          (
          <year>2022</year>
          ).
          <article-title>Identification and validation of two hub genes involved in membranous nephropathy based on machine learning</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Duo</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Zuo</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Guo</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ; He,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <surname>H.</surname>
          </string-name>
          ; Kang,
          <string-name>
            <given-names>Y.</given-names>
            ;
            <surname>Tang</surname>
          </string-name>
          ,
          <string-name>
            <surname>W.</surname>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Machine learning model to estimate probability of remission in patients with idiopathic membranous nephropathy</article-title>
          ,
          <source>International Immunopharmacology</source>
          , Vol.
          <volume>125</volume>
          ,
          <issue>111126</issue>
          Destere,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Teisseyre</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Merino</surname>
          </string-name>
          ,
          <string-name>
            <surname>D.</surname>
          </string-name>
          ; Cremoni,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Gérard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. O.</given-names>
            ;
            <surname>Crepin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ; JourdeChiche, N.;
            <surname>Graça</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ;
            <surname>Zorzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ;
            <surname>Fernandez</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          ; others. (
          <year>2023</year>
          ). Optimization of rituximab
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <article-title>Therapy in Adult patients with PLA2R1-associated Membranous Nephropathy with Artificial Intelligence</article-title>
          ,Kidney International Reports
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Hao</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ; Han,
          <string-name>
            <surname>W.</surname>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Accurate Kidney Pathological Image Classification Method Based on Deep Learning and Multi-Modal Fusion Method with Application to Membranous Nephropathy, Life</article-title>
          , Vol.
          <volume>13</volume>
          , No.
          <volume>2</volume>
          ,
          <issue>399</issue>
          Gao, J.;
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Xu</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Guo</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Sun</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Computer-aided diagnosis of primary membranous nephropathy using expert system</article-title>
          ,
          <source>BioMedical Engineering OnLine</source>
          , Vol.
          <volume>22</volume>
          , No.
          <issue>1</issue>
          ,
          <fpage>1</fpage>
          -
          <lpage>24</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Uleri</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Baboudjian</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Gallioli</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Territo</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Gaya</surname>
            ,
            <given-names>J. M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Sanz</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ; Robalino,
          <string-name>
            <surname>J.</surname>
          </string-name>
          ; Casadevall,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Diana</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          ; Verri, P.; others. (
          <year>2023</year>
          ).
          <article-title>A new machine-learning model to predict long-term renal function impairment after minimally invasive partial nephrectomy: the Fundació Puigvert predictive model</article-title>
          ,
          <source>World Journal of Urology</source>
          , Vol.
          <volume>41</volume>
          , No.
          <volume>11</volume>
          ,
          <fpage>2985</fpage>
          -
          <lpage>2990</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Kotanko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ; Zhang, H.;
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2023</year>
          ).
          <article-title>Artificial Intelligence and Machine Learning in Dialysis: Ready for Prime Time?</article-title>
          ,
          <source>Clinical Journal of the American Society of Nephrology</source>
          ,
          <fpage>10</fpage>
          -
          <lpage>2215</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Luo</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Phung</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ; Tran,
          <string-name>
            <given-names>T.</given-names>
            ;
            <surname>Gupta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ;
            <surname>Rana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ;
            <surname>Karmakar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ;
            <surname>Shilton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Yearwood</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          ; Dimitrova,
          <string-name>
            <given-names>N.</given-names>
            ;
            <surname>Ho</surname>
          </string-name>
          , T. B.; others. (
          <year>2016</year>
          ).
          <article-title>Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view</article-title>
          ,
          <source>Journal of Medical Internet Research</source>
          , Vol.
          <volume>18</volume>
          , No.
          <volume>12</volume>
          , e323 Van Smeden,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Reitsma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. B.</given-names>
            ;
            <surname>Riley</surname>
          </string-name>
          , R. D.; Collins,
          <string-name>
            <given-names>G. S.</given-names>
            ;
            <surname>Moons</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. G.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Clinical prediction models: diagnosis versus prognosis</article-title>
          ,
          <source>Journal of Clinical Epidemiology</source>
          , Vol.
          <volume>132</volume>
          ,
          <fpage>142</fpage>
          -
          <lpage>145</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Collins</surname>
            ,
            <given-names>G. S.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Reitsma</surname>
            ,
            <given-names>J. B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Altman</surname>
            ,
            <given-names>D. G.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Moons</surname>
            ,
            <given-names>K. G.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) the TRIPOD statement</article-title>
          ,
          <source>Circulation</source>
          , Vol.
          <volume>131</volume>
          , No.
          <volume>2</volume>
          ,
          <fpage>211</fpage>
          -
          <lpage>219</lpage>
          Riley, R. D.;
          <string-name>
            <surname>Ensor</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Snell</surname>
            ,
            <given-names>K. I.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Harrell</surname>
            ,
            <given-names>F. E.</given-names>
          </string-name>
          ; Martin,
          <string-name>
            <given-names>G. P.</given-names>
            ;
            <surname>Reitsma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. B.</given-names>
            ;
            <surname>Moons</surname>
          </string-name>
          , K. G.; Collins,
          <string-name>
            <given-names>G.; Van</given-names>
            <surname>Smeden</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>Calculating the sample size required for developing a clinical prediction model</article-title>
          ,
          <source>Bmj</source>
          , Vol.
          <volume>368</volume>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Christodoulou</surname>
            , E.; van Smeden,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Edlinger</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Timmerman</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ; Wanitschek,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Steyerberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. W.; Van</given-names>
            <surname>Calster</surname>
          </string-name>
          ,
          <string-name>
            <surname>B.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Adaptive sample size determination for the development of clinical prediction models</article-title>
          ,
          <source>Diagnostic and Prognostic Research</source>
          , Vol.
          <volume>5</volume>
          , No.
          <issue>1</issue>
          ,
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Riley</surname>
            , R. D.; Debray,
            <given-names>T. P.</given-names>
          </string-name>
          ; Collins,
          <string-name>
            <given-names>G. S.</given-names>
            ;
            <surname>Archer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            ;
            <surname>Ensor</surname>
          </string-name>
          , J.; van Smeden,
          <string-name>
            <given-names>M.</given-names>
            ;
            <surname>Snell</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. I.</surname>
          </string-name>
          (
          <year>2021</year>
          ).
          <article-title>Minimum sample size for external validation of a clinical prediction model with a binary outcome</article-title>
          , Statistics in Medicine, Vol.
          <volume>40</volume>
          , No.
          <volume>19</volume>
          ,
          <fpage>4230</fpage>
          -
          <lpage>4251</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>