<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Advanced Binary Classification for Disease Detection in Trees Using a novel Machine-Deep Learning method</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marouane Kihal</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lamia Hamza</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mohammed Charif Kihal</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Laboratory of Medical Informatics (LIMED), Faculty of Exact Sciences, University of Bejaia</institution>
          ,
          <addr-line>06000 Bejaia</addr-line>
          ,
          <country country="DZ">Algeria</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Laboratory of electrical engineering and industrial electronics (L2EI), Faculty of Science and Technology, Department of Electrical Engineering, University of Jijel</institution>
          ,
          <addr-line>18000 Jijel</addr-line>
          ,
          <country country="DZ">Algeria</country>
        </aff>
      </contrib-group>
      <fpage>8</fpage>
      <lpage>12</lpage>
      <abstract>
        <p>Detecting plant health is crucial to prevent losses in the productivity and quality of agricultural products. This study focuses on identifying plant diseases through the visual examination of leaf patterns. Speci cally, we aim to e ciently determine the health status (diseased or healthy) of lemon trees by analyzing the condition of their leaves using nine di erent machine learning algorithms optimized with a deep learning approach. Our experimental results demonstrate that this method achieves a high accuracy rate of 93%, surpassing other machine learning techniques. The integration of multiple machine learning algorithms followed by deep learning proves to be a promising solution for e ective detection of tree diseases.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Trees diseases detection</kwd>
        <kwd>Binary detection</kwd>
        <kwd>Machine learning</kwd>
        <kwd>Deep Learning</kwd>
        <kwd>Citrus fruit</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Before the advent of AI-based methods, early detection of disease in trees was often hampered by
rudimentary, empirical methods. Observers often had to rely on visible signs such as changes in
leaf color or obvious external symptoms, limiting the ability to identify diseases at an early stage of
development. In addition, the diversity of diseases and the variability of forest environments made
it di cult to implement uniform and reliable detection protocols. These challenges highlighted the
urgent need for innovative solutions to improve the e ciency and accuracy of tree disease monitoring.
Machine Learning (ML) in the eld of tree disease detection involves using algorithms to analyze
data such as images or sensory data to identify characteristic signs of disease. This approach enables
computer systems to learn from data without being explicitly programmed, thus improving the accuracy
and e ciency of diagnosis. On the other hand, Deep Learning (DL), an advanced branch of machine
learning, uses arti cial neural networks to perform complex recognition and classi cation tasks. In
tree disease detection, deep learning enables in-depth analysis of high-resolution images, facilitating
early detection of infection or structural damage thanks to its ability to extract signi cant features
and patterns from large quantities of data. Thus, detecting plant health with ML and DL algorithms is
crucial to prevent losses in yield and quality of agricultural products by examining visually observable
patterns on plants, such as leaves, stems, and fruits.</p>
      <p>In this paper, we aim at e ciently binary detection of the health status of lemon trees (diseased or
healthy) from the state of the leaves using an approach based on deep learning optimization of nine
machine learning algorithms. The main contribution of this article is to design the following:
• Binary detection of the health status of trees from the state of the leaves using an approach based
on deep learning optimization of nine machine learning algorithms.
• Comparison of our approach with nine Machine Learning algorithms.</p>
      <p>• Application of four di erent evaluation metrics to compare results.</p>
      <p>The rest of this paper is organized as follows: Section 2 reviews related works. Section 3 introduces
our proposed approach for detecting diseased trees. In Section 4, we evaluate our results. Finally,
Section 5 concludes the paper and suggests potential directions for future research.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Related works</title>
      <p>Numerous studies have focused on detecting diseases from the leaves of various plants. For tomato,
Prajwala et al.[1] proposed a variation of the convolutional neural network model, LeNet, to detect and
identify diseases in tomato leaves. For rice, Kawcher et al.[2] introduced a rice leaf disease detection
system utilizing machine learning techniques. Additionally, a study on potatoes [3] suggests a model
that employs pre-trained models for ne-tuning to extract relevant features from the dataset, followed
by a logistic regression classi er. For lemon tree, Banni and Sksvmacet [4] proposed a model that
utilises GLCM (Grey Level Co-Occurrence Matrix) algorithms for the detection of citrus leaf disease.
However, this study was unable to obtain appropriate outcomes in order to classify the image data.
This study yielded an accuracy rate of approximately 85.71%. Recently, more work has been based on
machine learning and deep learning algorithms. Pramanik et al. [5] used Transfer Learning-based Deep
Learning models, speci cally DenseNet-201, ResNet-50, ResNet-152V2, and Xception, to classify lemon
leaf diseases. Xception outperformed all other models in terms of accuracy, with 94.34%. Khattak et al.
[6] suggested the use of a CNN model to distinguish between healthy fruits and leaves and those that
have prevalent citrus diseases, including black spot, canker, scab, greening, and Melanose. This CNN
model has a test accuracy of 94.55%. Hassam et al. [7] proposed a single-stream convolutional neural
network architecture to identify illnesses in citrus fruits. The expanded citrus dataset (Citrus Fruits,
Leaves, and Hybrid Datasets) were employed in the experiment, and the accuracy was 99.4%, 99.5%,
and 99.7% respectively. However, the study reveals little redundant information in the collected deep
features. Yuan [8] evaluated and compared two deep learning models, DenseNet and MobileNet, for the
case study of lemon leaf image classi cation. This study indicated that MobileNet is more promising
in practice. Islam et al. [9] used InceptionV3 and VGG16 deep learning models to classify diseases in
citrus leaves, including melanoses, canker, scab, and black spot. InceptionV3 outperforms VGG16 in
terms of accuracy. Despite numerous studies in the eld of agronomy, no previous work has employed
a comprehensive set of ML algorithms, including DL, to optimize the detection of tree diseases.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Our approach</title>
      <p>In this Section, we propose the use of nine ML algorithms and DL techniques to enhance the detection
of tree diseases from leaf images. Various machine learning techniques that we employed for this task,
including:
1. Ada Boost : A technique of grouping a number of individual weak classi ers all together in a
single powerful classi er.
2. Logistic Regression : A model that maximises the probability for a binary dependent variable.
3. Decision Trees : A technique that divides the data into subsets according to speci c values of
the input dimensions, it can reveal the patterns correlated with plant diseases.
4. Random Forests : A learning algorithm that builds many decision trees in the training process.
5. Support Vector Machines : A method aims to select the hyperplane that provides the maximum
distance between classes of healthy and diseased leaves in the space of features.
6. k-Nearest Neighbors : Categorizes a leaf based on the results of a majority vote on the k nearest
neighbors using distance.
7. Naive Bayes : Utilize the Bayesian model with strong (naive) hypothesis of feature’s
independence.
8. Linear Discriminant Analysis : A method aims to determine the best way of dividing the
di erent classes.
9. Extreme Gradient Boosting : An optimized gradient boosting.</p>
      <p>As mentioned the result of the nine ML algorithms will be passed by a deep learning model to make
and optimize the nale decision as shown in Fig. 1.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Experimentation and results</title>
      <p>In this Section, we will present the details and results of the experiments conducted on images of lemon
trees. The images used for this study were obtained from the Collection of Di erent Category of Leaf
Images[10]</p>
      <sec id="sec-4-1">
        <title>4.1. Methodology</title>
        <p>We employed the nine machine learning algorithms discussed in the previous section, followed by
implementing a deep learning model. Speci cally, our DL model is a sequential model developed using
Keras[11] consisting of ve dense layers. The rst dense layer has 64 units with a ReLU activation
function, taking input data of dimension. The following layers have 128, 256, and 512 units, each also
using the ReLU activation. The last dense layer has a single unit with a sigmoid activation function,
suitable for binary classi cation tasks. The model is compiled with the ’adam’ optimizer, ’binary
crossentropy’ loss function. Finally, the model is trained on data for 50 epochs with a batch size of 32.</p>
      </sec>
      <sec id="sec-4-2">
        <title>4.2. Results</title>
        <p>The result of experimentation are shown in Table 1. This outcomes demonstrate a clear comparison of
various algorithms in terms of Accuracy, Precision, Recall, and F1-Score. Adaboost and SVM both achieve
an accuracy of 85%, with Adaboost showing a high recall of 99% and an F1-Score of 90%, indicating strong
performance in identifying true positives but a slightly lower precision of 82%. Logistic Regression and
XGBoost both achieve an accuracy of 87.5%, with high precision 87% and recall 96%, resulting in an
F1-Score of 92%, highlighting their balanced performance. Decision Trees and Random Forests show
lower accuracy at 82.5% and 80% respectively, k-NN achieves also 82.5% of accuracy. Linear Discriminant
Analysis achieves 85% accuracy, while Naive Bayes has the lowest accuracy at 75%, re ecting its limited
e ectiveness in this context. Notably, our proposed ML-DL approach outperforms all other algorithms
with an accuracy of 93%, precision of 90%, recall of 99%, and an F1-Score of 95%, indicating superior
overall performance in terms of both identifying true positives and minimizing false positives. Moreover,
we trained the VGG16 model proposed by Islam et al. [9] on the same datasete used to train our model,
the VGG16 model obtained about 85% in all evaluation metrics. Furthermore, the loss and accuracy
curves show that the loss steadily decreases while the accuracy consistently increases until reaching
93%, indicating good model learning, as shown in Fig. 2.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>In this paper, we have proposed a new approach based on machine learning followed by deep learning
to e ciently detect the health status of tree leaves, using nine powerful machine learning algorithms,
namely adaboost, logistic regression, decision tree, random forest, support vector machines, k-nearest
neighbors, naive bayes, linear discriminant analysis, and extreme gradient boosting. The results
presented in the experiment demonstrate that the proposed model outperformed the individual machine
learning algorithms on four evaluation measures, achieving accuracy of 93%, precision of 90%, recall of
99%, and an F1 measure of 95%. These results indicate the e ectiveness and robustness of the proposed
approach, which can be used as an e ective solution for tree disease control. Our future research will
explore the generalization of this approach to other domains and datasets.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments References</title>
      <p>This work has been sponsored by the General Directorate for Scienti c Research and Technological
Development, Ministry of Higher Education and Scienti c Research (DGRSDT), Algeria.
[1] P. Tm, A. Pranathi, K. SaiAshritha, N. B. Chittaragi, S. G. Koolagudi, Tomato leaf disease detection
using convolutional neural networks, in: 2018 eleventh international conference on contemporary
computing (IC3), IEEE, 2018, pp. 1–5.
[2] K. Ahmed, T. R. Shahidi, S. M. I. Alam, S. Momen, Rice leaf disease detection using machine
learning techniques, in: 2019 International Conference on Sustainable Technologies for Industry
4.0 (STI), IEEE, 2019, pp. 1–5.
[3] D. Tiwari, M. Ashish, N. Gangwar, A. Sharma, S. Patel, S. Bhardwaj, Potato leaf diseases detection
using deep learning, in: 2020 4th international conference on intelligent computing and control
systems (ICICCS), IEEE, 2020, pp. 461–466.
[4] R. Banni, L. Sksvmacet, Citrus leaf disease detection using image processing approaches,
International Journal of Pure and Applied Mathematics 120 (2018) 727–735.
[5] A. Pramanik, A. Z. Khan, A. A. Biswas, M. Rahman, Lemon leaf disease classi cation using
cnnbased architectures with transfer learning, in: 2021 12th International Conference on Computing
Communication and Networking Technologies (ICCCNT), IEEE, 2021, pp. 1–6.
[6] A. Khattak, M. U. Asghar, U. Batool, M. Z. Asghar, H. Ullah, M. Al-Rakhami, A. Gumaei, Automatic
detection of citrus fruit and leaves diseases using deep neural network model, IEEE access 9 (2021)
112942–112954.
[7] M. Hassam, M. A. Khan, A. Armghan, S. A. Althubiti, M. Alhaisoni, A. Alqahtani, S. Kadry, Y. Kim,
A single stream modi ed mobilenet v2 and whale controlled entropy based optimization framework
for citrus fruit diseases recognition, IEEE access 10 (2022) 91828–91839.
[8] Y. Yuan, Computer vision and deep learning for precise agriculture: A case study of lemon leaf
image classi cation, in: Journal of Physics: Conference Series, volume 2547, IOP Publishing, 2023,
p. 012024.
[9] S. F. Islam, N. Chakrabarty, M. S. Uddin, Citrus leaf disease detection through deep learning
approach, Bulletin of Electrical Engineering and Informatics 13 (2024) 2643–2649.
[10] M. Nagadia, Collection of di erent category of leaf images, Kaggle repository, 2023. URL: https:
//www.kaggle.com/datasets/meetnagadia/collection-of-di erent-category-of-leaf-images, last
accessed 2024-07-25.
[11] F. Chollet, et al., Keras, GitHub repository, 2015. URL: https://github.com/fchollet/keras, last
accessed 2024-07-25.</p>
    </sec>
  </body>
  <back>
    <ref-list />
  </back>
</article>