<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Classifying Raman Spectroscopy Data Using Machine Learning Algorithms for Diagnosing Infection With Sars-Cov-2</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Robert Istvan Oniga</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Katholieke Universiteit Leuven</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Belgium oniga.robi@gmail.com</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Proceedings of the 1</institution>
        </aff>
      </contrib-group>
      <fpage>168</fpage>
      <lpage>175</lpage>
      <abstract>
        <p>The rapid development of the corona crisis requires new methods and approaches that could help flatten the curve. For this reason, a possible alternative for a detection method is investigated to diagnose in a faster and more reliable way the disease and help prevent the spread. Raman spectroscopy on blood serum is a potential candidate for this issue and thus, research was done towards this direction. The data obtained from the spectrometer was further analyzed through linear discriminant analysis and a predictive model was achieved with an accuracy of 93.5%.</p>
      </abstract>
      <kwd-group>
        <kwd>SARS-COV-2</kwd>
        <kwd>LDA</kwd>
        <kwd>Raman spectroscopy</kwd>
        <kwd>data processing</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        In December 2019, a novel virus has emerged and in a brief period it has reached
all the corners of the world. This virus called the corona virus has afected all
people. Due to the continuous rise in the number of infected and deceased persons,
a new approach must be taken in order to deal with this situation. Since the
measures taken to isolate infected individuals had no significant result with the
current testing results, perhaps the development of a new detection method that
Copyright © 2021 for this paper by its authors. Use permitted under Creative Commons License
Attribution 4.0 International (CC BY 4.0).
is more precise and rapid could prevent the further spread of the virus.[
        <xref ref-type="bibr" rid="ref5 ref9">5, 9</xref>
        ] A
possible detection method that could satisfy the requirements is by means of Raman
spectroscopy on blood serum and with the help of machine learning techniques.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Used Method</title>
      <sec id="sec-2-1">
        <title>2.1. Raman Spectroscopy</title>
        <p>
          Raman spectroscopy is a method that relies on a non ionizing laser that can excite
a molecule if the energy of the incident photon matches the energy gap between the
ground state and the excited state of said molecule. The phenomena of fluorescence
will occur when the molecule relaxes and generates emission of photons in both the
visible and near-infrared spectral ranges. The emission can happen either by means
of a elastic scattering which has no relevant information, or plastic scattering which
means that a part of the energy was absorbed and only a fraction of that was
released back into the medium. That diference in terms of energy is studied in order
to obtain relevant information that may be used for bio-medical applications but
not only.[
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] In this paper the diferences in terms of energy absorption between
healthy and infected individuals is studied for a possible diagnosis. The said
diferences are subtle, however, precise statistical algorithms can detected these trends
leading to a clear diagnosis.
        </p>
        <p>
          In many bio-medical applications that include the use of Raman spectroscopy,
the probe being analyzed is blood serum. Many important features can be observed
that prove to be relevant in diagnosis. More precisely, in the blood serum, diferent
organic components are present such as proteins that can indicate the presence of
a virus, or one can analyze the serum in order to diagnose diefrent types of
carcinoma. However, in order to be able to analyse blood serum, a series of preparatory
steps must be taken to obtain a clear and reliable sample.[
          <xref ref-type="bibr" rid="ref11">11</xref>
          ] These steps include:
• Blood has to be drawn from the subject in question.
• The blood has to sit in the test tube for 15-30 minutes in order to clot.
• The blood has to be centrifuged in order to get rid of the clot.
• The serum has to be immediately transferred to another tube to preserve the
purity.
        </p>
        <p>
          Knowingly, the use of Raman spectroscopy on blood serum is proposed as a
detection method of infection with the SARS-COV-2 virus. Further knowledge
regarding the proteins that mark the presence of the virus in the human system was
acquired in order to obtain an estimated location in the spectroscopic data of those
elements for better detection by means of machine learning. The most important
protein that characterizes the virus is the spike glicoprotein also called S-protein.
Because of this particular protein the virus is able to enter our system by attaching
the so called spikes to a receptor called angiotensin converting enzyme 2 (ACE2).[
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]
Proteins in general are made of amino acid chains which all contain amine and
carboxyl functional groups. Because in this paper the main focus is about processing
raman spectroscopic data, the vibrational modes of the proteins have to be
understood. The most characteristic bands in raman spectroscopy for proteins are
associated with the CONH group that stretch up to 3100 cm−1 (amide A) and
several other band for amide B: 1600–1690 cm −1, 1480–1580 cm −1, 1230–1300 cm −1,
625–770 cm −1, 640–800 cm −1, 540–600 cm −1 and 200 cm−1.[
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] This information will
be later compared with the results of the machine learning algorithm in order to
identify with greater preciseness the component in the spectroscopic data that will
yield the best diferentiation rate.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Liner Discriminant Analysis (LDA)</title>
        <p>
          For this application, a linear classification technique called LDA was used. This
method is straightforward and it consists of analysis of statistical properties of
data that are calculated for each class. The statistical properties of interest are the
mean and covariance matrix over the multiple variables. The assumption made by
the algorithm is that all data is Gaussian and each attribute of the data has equal
variance and each value varies around the mean with the same amount overall.
After these are taken into consideration, the algorithm estimates the mean and
the variance for each class. Having these parameters, the next step can be made:
classification.[
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] In order to estimate the probability of a unknown sample to be
part of a certain class, the model uses Bayes theorem which is governed by the
following formula:
 ( |  ) =  (  | ( )) ( )
,
where  and  are events,  ( |  ) is the probability of  given  is true,  ( |  )
is probability of  given  is true and finally,  ( ) and  ( ) are independent
probabilities of  and  . [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Leave-One-Out Cross-Validation</title>
        <p>The classification technique discussed above can yield accurate results on its own
without the need of reassuring techniques such as leave-one-out cross-validation.
However, being a delicate biomedical application, the maximum achievable
accuracy is of interest. For this particular reason the sequential training and testing of
diferent unique values is made. Precisely, each data point from the data-set will
serve as test sample once. By doing this, all data points are thoroughly analyzed
and assimilated with one of the classes with greater preciseness.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Particular Application of Methods</title>
      <p>The data processing was done in MATLAB software by means of machine learning
and statistical toolboxes. The data-set consisted of Raman spectra on blood serum
of both healthy and infected subjects. The first step was to whiten the data by
removing the DC component and then the data was visually inspected in order to
observe any outstanding features that might impede the classification process. The
whitened data can be observed in Figure 1.</p>
      <p>Healthy vs SARS-COV2
6
5
4
]
.</p>
      <p>U
.
[A3
y
it
s
n
te2
n
I
1
0</p>
      <p>The displayed data has subtle diferences which cannot be picked up by the
naked eye in order to make a precise classification. For this reason, after the
algorithm successfully detects those features that are relevant for the diferentiation
between the two classes, the raman shift bands will be displayed for a better visual
analysis.</p>
      <p>
        After the normalization process, the data was randomized along with the labels
and in the healthy and infected individuals were mixed together in order to prepare
for the training process of said classifier. The division in terms of samples was done
in the following manner: 70% of the data was used as training set and 30% of the
data was used as test set. However, as it has been mentioned before, the training
was done through LDA and through LDA with leave-one-out cross-validation
technique in order to compare the results and to take into consideration the possibility
of over-fitting of the model.[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Results</title>
      <p>
        The data-set was composed of a total of 309 individuals of which 150 were healthy
and 159 were infected with the corona virus[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Initially, the training process
was done by using only the linear discriminant analysis method which yielded a
89% accuracy which means that 89% of the subjects in question were correctly
identified as being either healthy of infected while 11% were wrongfully attributed
to a class. In order to test for a possible improvement of the model, leave-one-out
cross-validation was used. In this algorithm rather than using sample by sample
to obtain the prediction, Raman shift ranges of length of approximately 50 cm-1ˆ
were used. The results of this alternative were better having a accuracy of 93.5%.
Since the algorithm performed many operations with a small amount of data, the
possibility of over-fitting was taken into consideration before applying the method.
However, this was not the case with this data-set. To get a better understanding
of the results, the confusion matrix was displayed and it is shown in Figure 2.
0
s
s
a
l
t1
C
u
p
t
u
O
      </p>
      <p>From this table it can be seen that from the total of 48 healthy individuals used
for the testing process, 47 were correctly identified as being healthy (which accounts
for 47 true negatives) and one was erroneously identified as infected (false positive).
The infected individuals had a lower accuracy when it comes to detection as from
the total of 45 infected, only 40 were correctly identified as indeed infected (true
positive) and 5 were assumed to be healthy (false negative). Other parameters
were taken into consideration for performance assessment of the classifier such as
the accuracy, sensitivity and specificity of the model. All these parameters can be
seen in Table 1.</p>
      <p>As discussed in 2.1, certain proteins yield Raman shift ranges that are useful for
the classification process. The predominant features in terms of Raman shift in this
particular data-set were in the following ranges: [400–591]cm −1, [647–673]cm −1,
[721–798]cm −1, [820–896]cm −1 and [1003–1241]cm −1. From all the ranges
discussed in 2.1 the one that overlaps significantly with the predominant features in
this dataset is the one in the 600–800 cm −1 range. The conclusion that can be
drawn from this is that the spike glicoprotein that is responsible for the infection
with the SARS-COV-2 virus has a high vibrational state in this particular range
which can be used to detect infected individuals. Now, additional information has
come to light and better approaches can be made in order to increase the
accuracy of the model. The predominant features used to achieve the classification
process are now reduced to one feature generally speaking. This single feature is
represented by a range of Raman shifts in the 600–800 cm −1 that can be seen in
Figure 4.</p>
      <p>From a visual inspection it can be seen that the data from the two classes
show little diferences in terms of intensities. However, there are certain location
in the specified ranges of raman shifts in which the diferences in intensities go up
to 0.5 [A.U.]. These values are high from the perspective of Raman spectroscopy
accounting for a diference of 12.5% in terms of intensity. When analyzing these
diferences the most important characteristic that was considered at all times was
the quantity of virus present in the sample which could have been very low for
some of the subjects. The quantity is highly dependent on one parameter: days
after infection (Figure 3). Because of this reason, and because of the fact that
there was no information regarding this parameter, possible errors in classification
might have occurred.
600
650</p>
      <p>700 750
Raman shift [cm-1]</p>
      <p>800</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>
        The proposed technique for detection of SARS-COV-2 infection proved itself to be
useful and reliable. The potential of Raman spectroscopy in the detection of the
virus is considerable especially due to its ability of observing even subtle diferences
that can be missed by the naked eye and which are key elements for the classification
process. The LDA algorithm combined with leave-one-out cross-validation created
a statistical model that is well suited for the task at hand. Rapid tests are
timeeficient, however the accuracy of detection is only ∼80%. These tests can be done
by the patient itself and they require no medical expertise.[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] The
most-widelyused method is the PCR one and this requires a laboratory and trained personnel
in order to obtain the test result. Even though it has a high accuracy, the time
needed to obtain a result is long as it can take up to 48 hours.[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] Both methods
have their own shortcomings; when compared to the Raman spectroscopy based
detection method, it can be seen that this one has only the beneficial parts of both:
does not require a laboratory as there are plenty of portable Raman spectrometers,
this method is highly time eficient as the result can be passed to the patient in less
than one hour, there is no need for extra training in order to perform the testing
operation as the process can be done by a nurse, it has high accuracy (∼93.5%).
All these advantages add up to a novel method that can impede the rapid spread
of the virus thus contributing to a faster ending of the pandemic.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>S. rekha</surname>
          </string-name>
          <article-title>Hanumanthu: Role of Intelligent Computing in COVID-19 Prognosis: A Stateof-the-Art Review</article-title>
          . Chaos, Solitons and Fractals (
          <year>2020</year>
          ), doi: https://doi.org/10.1016/j.chaos.
          <year>2020</year>
          .
          <volume>109947</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Hussain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Bouachir</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Al-Turjman</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Aloqaily: AI Techniques for COVID19 (</article-title>
          <year>2020</year>
          ), doi: https://doi.org/10.1109/ACCESS.
          <year>2020</year>
          .
          <volume>3007939</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>T.</given-names>
            <surname>Ishige</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Murata</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Taniguchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Miyabe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kitamura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kawasaki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Nishimura</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Igari</surname>
          </string-name>
          , H. Matsushita:
          <article-title>Highly sensitive detection of SARS-CoV-2 RNA by multiplex rRT-PCR for molecular diagnosis of COVID-19 by clinical laboratories</article-title>
          .
          <source>Clinica Chimica Acta</source>
          (
          <year>2020</year>
          ), doi: https://doi.org/10.1016/j.cca.
          <year>2020</year>
          .
          <volume>04</volume>
          .023.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A. J.</given-names>
            <surname>Izenman</surname>
          </string-name>
          :
          <article-title>Linear Discriminant Analysis</article-title>
          .
          <source>In: Modern Multivariate Statistical Techniques</source>
          , Springer Texts in Statistics. Springer, New York (
          <year>2013</year>
          ), doi: https://doi.org/10.1007/978-0-
          <fpage>387</fpage>
          -78189-
          <issue>1</issue>
          _
          <fpage>8</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Ludwig</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <article-title>Zarbock: Coronaviruses and SARS-CoV-2</article-title>
          , Anesthesia &amp;
          <string-name>
            <surname>Analgesia</surname>
          </string-name>
          (
          <year>2020</year>
          ), doi: https://doi.org/10.1213/ane.0000000000004845.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G.</given-names>
            <surname>Mak</surname>
          </string-name>
          , K. Cheng, S. Lau,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Lam</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Chan</surname>
          </string-name>
          ,
          <string-name>
            <surname>N.</surname>
          </string-name>
          <article-title>Tsang: Evaluation of rapid antigen test for detection of SARS-CoV-2 virus</article-title>
          ,
          <source>Journal of Clinical Virology</source>
          (
          <year>2020</year>
          ), doi: https://doi.org/10.1016/j.jcv.
          <year>2020</year>
          .
          <volume>104500</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B. G.</given-names>
            <surname>Pinto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. E.</given-names>
            <surname>Oliveira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Jimenez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. N. A.</given-names>
            <surname>Gonçalves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. L.</given-names>
            <surname>Ogava</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Creighton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P. S.</given-names>
            <surname>Peron</surname>
          </string-name>
          ,
          <string-name>
            <surname>I.</surname>
          </string-name>
          <article-title>Nakaya: ACE2 Expression is Increased in the Lungs of Patients with Comorbidities Associated with Severe COVID-19,</article-title>
          <source>The Journal of Infectious Diseases</source>
          (
          <year>2020</year>
          ), doi: https://doi.org/10.1101/
          <year>2020</year>
          .03.21.20040261.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Rygula</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Majzner</surname>
          </string-name>
          ,
          <string-name>
            <surname>K. M. Marzec</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kaczor</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Pilarczyka</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <article-title>Baranska: Raman spectroscopy of proteins: a review, Wiley Online Library (</article-title>
          <year>2013</year>
          ), doi: https://doi.org/10.1002/jrs.4335.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>B. A.</given-names>
            <surname>Taha</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Al Mashhadany</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. H.</given-names>
            <surname>Hafiz Mokhtar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Dzulkefly Bin Zan</surname>
          </string-name>
          ,
          <source>N. Arsad: An Analysis Review of Detection Coronavirus Disease 2019 (COVID-19) Based on Biosensor Application</source>
          ,
          <string-name>
            <surname>Sensors</surname>
          </string-name>
          (
          <year>2020</year>
          ), doi: https://doi.org/10.3390/s20236764.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Q.</given-names>
            <surname>Tu</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Chang: Diagnostic applications of Raman spectroscopy</article-title>
          ,
          <source>Nanomedicine: Nanotechnology, Biology and Medicine 8.5</source>
          (
          <issue>2012</issue>
          ), doi: https://doi.org/10.1016/j.nano.
          <year>2011</year>
          .
          <volume>09</volume>
          .013.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>M. K. Tuck</surname>
            ,
            <given-names>D. W.</given-names>
          </string-name>
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Chia</surname>
            ,
            <given-names>A. K.</given-names>
          </string-name>
          <string-name>
            <surname>Godwin</surname>
            ,
            <given-names>W. E.</given-names>
          </string-name>
          <string-name>
            <surname>Grizzle</surname>
            ,
            <given-names>K. E.</given-names>
          </string-name>
          <string-name>
            <surname>Krueger</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Rom</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Sanda</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Sorbara</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Stass</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>D. E.</given-names>
          </string-name>
          <string-name>
            <surname>Brenner</surname>
          </string-name>
          <article-title>: Standard Operating Procedures for Serum and Plasma Collection</article-title>
          ,
          <source>Journal of Proteome Research</source>
          (
          <year>2020</year>
          ), doi: https://doi.org/10.1021/pr800545q.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>G.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Su</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zeng</surname>
          </string-name>
          , et al.:
          <article-title>Data and code on serum Raman spectroscopy as an eficient primary screening of coronavirus disease in 2019 (COVID-19</article-title>
          ) , Nanomedicine: Nanotechnology, Biology and Medicine (
          <year>2020</year>
          ), doi: https://doi.org/10.6084/m9.figshare.
          <volume>12159924</volume>
          .
          <year>v1</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>