<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <article-id pub-id-type="doi">10.1016/j.renene.2019.06.135</article-id>
      <title-group>
        <article-title>MID-INFRARED (MIR) OCT-based inspection in industry</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>N. P. García-de-la-Puente</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rocío del Amor</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fernando García-Torres</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Niels Møller Israelsen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Coraline Lapre</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christian Rosenberg Petersen</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ole Bang</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dominik Brouczek</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin Schwentenwein</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kevin Neumann</string-name>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Niels Benson</string-name>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Valery Naranjo</string-name>
          <email>vnaranjo@upv.es</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Electrical and Photonics Engineering, Technical University of Denmark</institution>
          ,
          <addr-line>Kongens Lyngby</addr-line>
          ,
          <country country="DK">Denmark</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Instituto Universitario de Investigación e Innovación en Tecnología Centrada en el Ser Humano, HUMAN-tech, Universitat Politècnica de València</institution>
          ,
          <addr-line>Valencia</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Lithoz GmbH</institution>
          ,
          <addr-line>Vienna</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>NKT Photonics</institution>
          ,
          <addr-line>Blokken 84, 3460 Birkeroed</addr-line>
          ,
          <country country="DK">Denmark</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>NORBLIS ApS</institution>
          ,
          <addr-line>Virum</addr-line>
          ,
          <country country="DK">Denmark</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>airCode UG</institution>
          ,
          <addr-line>Duisburg</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <volume>146</volume>
      <fpage>2824</fpage>
      <lpage>2833</lpage>
      <abstract>
        <p>This paper aims to evaluate mid-infrared (MIR) Optical Coherence Tomography (OCT) systems as a tool to penetrate different materials and detect sub-surface irregularities. This is useful for monitoring production processes, allowing Non-Destructive Inspection Techniques of great value to the industry. In this exploratory study, several acquisitions are made on composite and ceramics to know the capabilities of the system. In addition, it is assessed which preprocessing and AI-enhanced vision algorithms can be anomaly-detection methodologies capable of detecting abnormal zones in the analyzed objects. Limitations and criteria for the selection of optimal parameters will be discussed, as well as strengths and weaknesses will be highlighted.</p>
      </abstract>
      <kwd-group>
        <kwd>1 mid-infrared (MIR) OCT</kwd>
        <kwd>Non-Destructive Inspection Techniques</kwd>
        <kwd>Zero Waste</kwd>
        <kwd>Defect detection</kwd>
        <kwd>AI-enhanced</kwd>
        <kwd>composite</kwd>
        <kwd>ceramics</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Minimising defects during the initial stages of industrial processes is crucial to prevent them from
spreading to subsequent steps in production. Non-Destructive Testing (NDT) processes can provide
high-quality data and identify defects [1]. The integration of artificial intelligence (AI) into these
processes not only enables the early detection of potential defects but also allows for real-time
monitoring of item progress throughout production stages. AI enhances the accuracy and speed of
defect identification, contributing to the overall efficiency of quality control. Moreover, by leveraging
AI, parameters can be continuously optimized, paving the way for enhanced quality in future
manufacturing endeavours. The combination of NDT processes and AI presents a formidable
approach to defect detection and prevention, offering a proactive strategy to ensure the highest levels
of product quality by automatization and by circumventing human interpretation uncertainty factors
[2].</p>
      <p>In NDT, a range of imaging modalities is employed to assess the integrity of materials without causing
damage. Radiographic techniques, such as X-ray and computed tomography (CT), provide detailed
insights into internal structures. Ultrasonic testing utilises sound waves to detect flaws and assess
material thickness. Thermography captures thermal patterns to identify irregularities in temperature
distribution. Visual inspection, both direct and remote, remains a fundamental method for
surfacelevel evaluations. Additionally, the growing prominence of Optical Coherence Tomography (OCT)
introduces a high-resolution, non-invasive imaging approach.</p>
      <p>OCT is an imaging technique where a light source is used to detect anomalies in both surface and
sub-surface areas. This technology relies on interferometry to measure the time difference
corresponding to the distances between the internal structures using a low-coherence near-infrared
light beam (~800 nm or ~1300 nm) toward the material. The result is a high-quality image obtained
without contact to the item under analysis. OCT has emerged in importance due to the wide variety
of information it can provide: its high resolution, and its ability to gather complex 3-dimensional (3D)
data [3]. Five years ago OCT based on mid-infrared light was realized providing deeper material
imaging [4]. In recent years some research studies have applied machine learning and deep learning
techniques to OCT anomaly detection problems. For example, Wolfgang et al. presented an evaluation
method for OCT image analysis of pharmaceutical coatings based on deep convolutional neural
networks [5]. In another study, Fin et al. applied a clustering approach (DBSCAN) to segment OCT
images of pharmaceutical products, such as coated tablets, for real-time monitoring [6]. However, to
the authors' knowledge, no previous work has focused on using AI techniques with OCT to detect
defects in industrial manufacturing processes. In this paper, we propose a deep learning-based object
detection model for defect detection in two industrial processes, wind turbine blade (WTB) generation
and ceramics.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Related work</title>
    </sec>
    <sec id="sec-3">
      <title>2.1 AI tools for NDT inspection in wind turbines</title>
      <p>The development of new AI methods has led to the emergence of systematic, quantitative and
automated tools for monitoring and diagnosing WTBs and making decisions within their life cycle.
In this sense, Regent et al. developed methods using acoustics and efficient algorithms to detect WTB
damage. These methods include the use of logistic regression and support vector machines for
decision-making using binary classification algorithms [7]. Another study proposed a method using
Gaussian Processes (GPs), which exploits the similarity between blades and the same environmental
and operational variables to predict the edge frequencies of one blade based on the frequencies of
another blade when they are in a healthy state [8]. Delamination in WTBs is a common structural
issue that can lead to high costs. Early detection of delamination is essential to prevent breakages and
downtime [9]. In [10], Jimenez et al. proposed a method for detecting delamination in WTB. The
method used nonlinear autoregressive with an exogenous input (NARX) and linear autoregressive
models to extract features from ultrasonic-guided waves, which are sensitive to delamination. Cracks
are another common structural defect in WTB that can decrease the structure’s lifespan. In [11],
treebased machine-learning algorithms were proposed to identify and detect cracks. The models were
created by analysing the vibration response of the blade when excited by a piezoelectric
accelerometer. Another study by Wang et al. found that irregular cracks can occur on blades before
they break and used deep autoencoder (DA) models to predict the imminent failure of a blade using
monitoring data [12].</p>
    </sec>
    <sec id="sec-4">
      <title>2.2 ML tools for NDT inspection in ceramic</title>
      <p>Non-destructive testing (NDT) allows the properties and integrity of ceramic parts to be examined
without causing physical damage. Among the most commonly used NDT techniques for inspecting
ceramic parts are ultrasonic inspection, infrared thermography and acoustic emission testing, among
others [13]. The use of MIR-OCT technology on ceramic parts to detect defects, as on other types of
objects, consists of examining changes in the refractive index of a sample. This non-destructive
method does not require a contact medium, providing a 3D volume containing microscopic details of
subsurface scattering. This system uses mid-infrared light with a center wavelength of 4 µm, which
allows deep penetration into industrial alumina-based ceramics [14]. By scanning industrial ceramics
with MIR-OCT, defects such as cracks, foreign particles and pores due to air bubbles inclusions
present in the layer-to-layer transitions of the prints can be identified and correlated with the quality
and performance of the printed component [15].</p>
      <p>The combination of NDT and machine learning techniques offers several significant advantages
in the inspection of ceramic parts. It enables more accurate and faster defect detection, which reduces
inspection times and increases the efficiency of the production process. In addition, by integrating
machine learning algorithms, inspection systems can adapt and continuously improve their ability to
detect new types of defects or variations in part conditions. Some authors have used machine learning
algorithms in combination with NDT techniques for the inspection of ceramic pieces, such as Support
Vector Machine, Random Forest, and K-Nearest Neighbors algorithms on acoustic signals [16], [17].
Other authors have employed computer vision through convolutional neural networks for the
analysis of images acquired using conventional and industrial photographic cameras, for the detection
and characterisation of defects in ceramic pieces [18], [19], [20]. Regarding ultrasonic inspection,
Naive Bayes classifiers, KNNs and Long Short-Term Memory (LSTM) networks have been used for
detecting flaws [21].</p>
    </sec>
    <sec id="sec-5">
      <title>3. Material and Methodology</title>
      <p>The use case scenario dataset consists of three volumes of coated glass-fibre composite from
Sample B in [22] and three volumes in ceramic green state (lithography-based parts). As can be seen
in Figure 1, two types of defects (voids and cracks) are considered in the fibre volumes and three types
(voids, surface irregularities and agglomerates) in the ceramic ones.
Volume slices have 400 x 400 dimensions (except Fiber C, which is 200 x 400) and are labelled in a
supervised manner using squared Bounding Boxes that enable the anomaly location. The volumes are
very varied in the number of defects, which produces a clear imbalance in certain classes (Table 1).
To address the difficulty of detection in such a limited dataset, the Leave-One-Out Methodology is
employed, where two volumes of material are used for training and one for validation.</p>
      <p>Because of its effectiveness and efficiency [23], YOLOv8n was selected as a model suited to the
application in industrial settings for defect detection. It divides the image into a grid and predicts
Bounding Boxes and class probabilities for each grid cell. The training hyperparameters selected for
the current study determine a batch size of 16 images, 200 epochs, considering that the training stops
if there is no improvement in the last 50 epochs. At the hardware level, the resources that have been
allocated for training correspond to NVIDIA RTX 3090 24 GB x1, 525.60.11 drivers &amp; CUDA 12.0, MSI
Z270 (MS-7A63); 32 GB and Intel i7-7700K (4.2 GHz).</p>
    </sec>
    <sec id="sec-6">
      <title>4. Results</title>
      <p>The key metrics in the evaluation of trained object detection models are the precision and the
inference time in which an image is predicted. Mean Average Precision (mAP) allows the
measurement of the prediction accuracy and Intersection over Union (IoU) to measure the overlap
between two Bounding Boxes. An IoU limit of over 50% is defined to determine whether a prediction
is regarded as true. For the presented use case, maximum mAP50 metrics achieved during inference
were collected and summarized (Table 2).</p>
      <p>The results from the YOLOv8n model trained with the dataset of coated glass-fibre composite
shows that the void defect in Fiber B volume is easily detected. However, in general, it cannot
correctly identify cracks due to the small dataset used. In parallel, the YOLOv8n model trained with
the ceramic data performs well for the case of voids but not so well for surface irrregularities and
agglomerates. Some examples of inferences with correctly detected defects are shown in Figure 2.</p>
      <p>Finally, the interest of using such lightweight models for their speed is to be noted. This can be
seen in the last column of Table 2, where the training sessions last ten minutes or less and the
inferences are around a millisecond in duration.</p>
    </sec>
    <sec id="sec-7">
      <title>5. Conclusion</title>
      <p>In conclusion, the application of YOLO (You Only Look Once) for defect detection in OCT images
of turbine blades and ceramics has demonstrated remarkable efficacy, particularly in identifying
cracks and voids. This study represents a preliminary exploration, constrained by a relatively limited
volume of available images. Future research will focus on acquiring and incorporating a larger dataset.
A larger and more diverse dataset would likely improve the generalizability of the model, further
enhancing its ability to detect defects.</p>
    </sec>
    <sec id="sec-8">
      <title>Acknowledgements</title>
      <p>
        This work has received funding from Horizon Europe, the European Union’s Framework Programme
for Research and Innovation, under Grant Agreement No. 101058054 (TURBO) and No. 101057404
(ZDZW). Views and opinions expressed are, however, those of the author(s) only and do not
necessarily reflect those of the European Union. Neither the European Union nor the granting
authority can be held responsible for them. The work of Rocío del Amor has been supported by the
Spanish Ministry of Universities (FPU20/05263). This work has received funding from Spanish
Ministry of Science and Innovation for th
        <xref ref-type="bibr" rid="ref9">e project ASSIST (PID2022</xref>
        -140189OB-C21).
      </p>
    </sec>
    <sec id="sec-9">
      <title>Declaration on Generative AI</title>
      <p>The author(s) have not employed any Generative AI tools.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>S. K.</given-names>
            <surname>Dwivedi</surname>
          </string-name>
          , M. Vishwakarma, y Prof. A. Soni, «
          <article-title>Advances and Researches on Non Destructive Testing: A Review»</article-title>
          , Mater.
          <source>Today Proc.</source>
          , vol.
          <volume>5</volume>
          , n.o 2,
          <string-name>
            <surname>Part</surname>
            <given-names>1</given-names>
          </string-name>
          , pp.
          <fpage>3690</fpage>
          -
          <lpage>3698</lpage>
          , ene.
          <year>2018</year>
          , doi: 10.1016/j.matpr.
          <year>2017</year>
          .
          <volume>11</volume>
          .620.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>H.</given-names>
            <surname>Taheri</surname>
          </string-name>
          , M. Gonzalez Bocanegra, y M. Taheri, «Artificial Intelligence,
          <article-title>Machine Learning and Smart Technologies for Nondestructive Evaluation»</article-title>
          ,
          <source>Sensors</source>
          , vol.
          <volume>22</volume>
          , n.
          <source>o 11</source>
          ,
          <article-title>Art</article-title>
          .
          <source>n.o 11</source>
          ,
          <string-name>
            <surname>ene.</surname>
          </string-name>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <year>2022</year>
          , doi: 10.3390/s22114055.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>M. Wojtkowski</surname>
          </string-name>
          et al., «
          <article-title>Three-dimensional Retinal Imaging with High-Speed UltrahighResolution Optical Coherence Tomography»</article-title>
          ,
          <source>Ophthalmology</source>
          , vol.
          <volume>112</volume>
          , n.
          <source>o 10</source>
          , pp.
          <fpage>1734</fpage>
          -
          <lpage>1746</lpage>
          , oct.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <year>2005</year>
          , doi: 10.1016/j.ophtha.
          <year>2005</year>
          .
          <volume>05</volume>
          .023.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>N. M. Israelsen</surname>
          </string-name>
          et al., «
          <article-title>Real-time high-resolution mid-infrared optical coherence tomography»</article-title>
          ,
          <source>Light Sci. Appl</source>
          ., vol.
          <volume>8</volume>
          , n.o 1,
          <source>Art. n.o 1</source>
          ,
          <string-name>
            <surname>ene</surname>
          </string-name>
          .
          <year>2019</year>
          , doi: 10.1038/s41377-019-0122-5.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>M.</given-names>
            <surname>Wolfgang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Weißensteiner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Clarke</surname>
          </string-name>
          , W.-K. Hsiao, y J. G. Khinast, «
          <article-title>Deep convolutional neural networks: Outperforming established algorithms in the evaluation of industrial optical coherence tomography (OCT) images of pharmaceutical coatings»,</article-title>
          <string-name>
            <given-names>Int. J.</given-names>
            <surname>Pharm</surname>
          </string-name>
          . X, vol.
          <volume>2</volume>
          , p.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          100058, dic.
          <year>2020</year>
          , doi: 10.1016/j.ijpx.
          <year>2020</year>
          .
          <volume>100058</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>E.</given-names>
            <surname>Fink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Clarke</surname>
          </string-name>
          , M. Spoerk, y J. Khinast, «
          <article-title>Unsupervised real-time evaluation of optical coherence tomography (OCT) images of solid oral dosage forms», J. Real-Time Image Process</article-title>
          ., vol.
          <volume>19</volume>
          , n.
          <source>o 5</source>
          , pp.
          <fpage>881</fpage>
          -
          <lpage>892</lpage>
          , oct.
          <year>2022</year>
          , doi: 10.1007/s11554-022-01229-9.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>T.</given-names>
            <surname>Regan</surname>
          </string-name>
          , C. Beale, y M.
          <article-title>Inalpolat, «Wind Turbine Blade Damage Detection Using Supervised Machine Learning Algorithms»</article-title>
          ,
          <string-name>
            <surname>J. Vib. Acoust.</surname>
          </string-name>
          , vol.
          <volume>139</volume>
          , n.o 061010,
          <string-name>
            <surname>ago</surname>
          </string-name>
          .
          <year>2017</year>
          , doi: 10.1115/1.4036951.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Energy</surname>
          </string-name>
          , vol.
          <volume>168</volume>
          , pp.
          <fpage>1249</fpage>
          -
          <lpage>1264</lpage>
          , may
          <year>2021</year>
          , doi: 10.1016/j.renene.
          <year>2020</year>
          .
          <volume>12</volume>
          .119.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>A.</given-names>
            <surname>Arcos Jiménez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. Q.</given-names>
            <surname>Gómez Muñoz</surname>
          </string-name>
          , y
          <string-name>
            <given-names>F. P.</given-names>
            <surname>García</surname>
          </string-name>
          <string-name>
            <surname>Márquez</surname>
          </string-name>
          , «
          <article-title>Machine Learning for Wind Turbine Blades Maintenance Management»</article-title>
          ,
          <source>Energies</source>
          , vol.
          <volume>11</volume>
          , n.o 1,
          <source>Art. n.o 1</source>
          ,
          <string-name>
            <surname>ene</surname>
          </string-name>
          .
          <year>2018</year>
          , doi: 10.3390/en11010013.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>