<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>October</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>IDENTIFICATION OF TAU LEPTONS USING DEEP LEARNING TECHNIQUES AT CMS</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>K. Androsov</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>for the CMS Collaboration</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Italy</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Konstantin Androsov</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <volume>4</volume>
      <issue>2019</issue>
      <fpage>84</fpage>
      <lpage>88</lpage>
      <abstract>
        <p>The reconstruction and identification of tau leptons decaying into hadrons are crucial for analyses with tau leptons in the final state. To discriminate hadronic  decays from the three main backgrounds (quark or gluon induced jets, electrons, and muons), with a low rate of misidentification and with high efficiency on the signal at the same time, the information of multiple CMS sub-detectors is combined. The application of deep machine learning techniques allows to exploit the available information in a very efficient way. The introduction of a new multi-class DNN-based discriminator at CMS provides a considerable improvement of the tau identification performance with respect to the previously used BDT and cut-based discriminators.</p>
      </abstract>
      <kwd-group>
        <kwd>LHC</kwd>
        <kwd>CMS</kwd>
        <kwd>machine learning</kwd>
        <kwd>tau lepton</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The tau is the heaviest Standard Model (SM) lepton with a mass of 1776.86 ± 0.12 MeV [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
It decays into hadrons + neutrino in about 64.8% of all cases. Taus play an important role for Higgs
physics, where the scalar couplings to fermions are proportional to the mass of the fermions. Other
physics analyses, such as measurements of the properties of SM particles or searches for new BSM
particles (W', Z', leptoquarks, …), also involve tau leptons. A good performance in reconstruction and
identification of the hadronic tau decays ( ℎ) is a crucial ingredient for achieving optimal results in
such analyses. For proton-proton collisions at the Large Hadron Collider (LHC), the main
backgrounds that can be misidentified as  ℎ are quark or gluon induced jets, electrons and muons that
can be produced by Drell-Yan, leptonic W decays, and other SM processes. In this article, we
introduce a new machine learning (ML) based algorithm, DeepTau, to identify  ℎ decays in the CMS
experiment [2].
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Tau reconstruction and identification in CMS</title>
      <p>The distinct feature of the CMS detector [2] is a superconducting solenoid of 6 m internal
diameter, providing a magnetic field of 3.8 T. A silicon pixel and strip tracker, a lead tungstate crystal
electromagnetic calorimeter (ECAL), and a brass and scintillator hadron calorimeter are located within
the solenoid volume. Muons are detected in gas-ionization detectors embedded in the steel flux-return
yoke outside the solenoid.</p>
      <p>
        Individual particles (electrons, muons, photons, and neutral and charged hadrons) in the event
are reconstructed by the particle-flow (PF) algorithm [3], which combines the information from all
CMS subdetectors. Jets are reconstructed based on an anti-kT algorithm [
        <xref ref-type="bibr" rid="ref2">4, 5</xref>
        ], clustering neutral and
charged PF candidates with a distance parameter of 0.4. Hadronically decaying taus are reconstructed
with the hadron-plus-strip (HPS) algorithm [
        <xref ref-type="bibr" rid="ref3">6, 7</xref>
        ], seeded by anti-kT jets. This algorithm uses
information from PF candidates belonging to the jet and reconstructs  ℎ candidates based on the
number of charged hadrons and the number of ECAL strips in the  −  plane. Tau candidates are
rejected if their absolute charge is other than 1 or if they have charged particles or strips outside the
signal cone. The signal cone is defined in the  −  plane by   = 3.0 GeV /   , and is limited to
the range 0.05 − 0.10. In [
        <xref ref-type="bibr" rid="ref3">7</xref>
        ] four modes to reconstruct  ℎ decays are defined: 1 charged prong + 0, 1,
2  0 and three charged prongs + 0  0 with tight matching conditions. Recently more inclusive decay
mode definitions (further referred to as the “updated decay modes”) have been introduced, adding
three charged prongs + 0 or 1  0 with relaxed matching conditions to the previously available
reconstruction modes.
      </p>
      <p>
        Before the introduction of DeepTau, to discriminate  ℎ decays against each type of
background three dedicated algorithms were used within CMS [
        <xref ref-type="bibr" rid="ref3">7</xref>
        ]. The rate of quark or gluon induced
jets that were reconstructed as tau candidates (  ) was reduced by a multivariate (MVA) discriminator
based on boosted decision trees (BDT) trained on 22 high-level input variables like the sums of energy
depositions in the tau isolation cone (  = 0.5) and the tau lifetime. An ensemble of 8 BDT
discriminators, each trained on  (30) variables that characterize ECAL clusters and track quality, was
used to reject electrons reconstructed as tau candidates (  ). A cut-based selection, using summary
information about hits in muon chambers and energy deposited in the calorimeters, was applied to
discriminate true taus against muons reconstructed as tau candidates (  ).
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. DeepTau: a new ML-based tau identification algorithm</title>
      <p>To further improve the identification of  ℎ decays, low-level information from multiple CMS
sub-detectors is combined. The application of ML techniques has been proven to provide superior
results for such multi-dimensional problems. DeepTau is a new multiclass tau identification algorithm
based on a convolutional deep neural network (DNN) that combines information from the high-level
variables attributed to the reconstructed hadronic tau candidate with low-level information from the
inner tracker, calorimeters and muon sub-detectors using particle candidates reconstructed within the
 ℎ signal and isolation cones. DeepTau also takes advantage from using the updated decay mode
definitions.</p>
      <p>The training is performed on a balanced mix of  (1.4 ∙ 108)   ,   ,  ℎ and   candidates
coming from Drell-Yan,   ̅, W+jets and Z' Monte Carlo (MC) simulation. Training, validation and
testing sets are composed of reconstructed tau candidates with a minimal preselection:   ∈
[20, 1000] GeV, | | &lt; 2.3, and | | &lt; 0.2 (the longitudinal impact parameter of the tau with respect
to the primary vertex), which makes it suitable for a wide range of CMS analyses with hadronic taus in
the final state. The ground truth is based on MC truth matching.</p>
      <p>The inputs are separated into sets of high-level and low-level features. As high-level inputs,
the algorithm takes 42 variables that are used during tau reconstruction or proven to provide
discriminating power by previous tau discriminators, and one global event variable – the average
energy deposition density ( ). For each candidate reconstructed within the tau signal or isolation
cones, information of 4-momentum, track quality, relation with the primary vertex, calorimeter
clusters, and muon stations is used, if available. The tau signal and isolation cones define two regions
of interest in vicinity of the tau candidate. Based on the angular distance between the reconstructed tau
4-momentum, all available candidates are split into two  ×  grids of 11 × 11 (21 × 21) cells with a
cell size of 0.02 × 0.02 (0.05 × 0.05) for the signal (isolation) cone. In cases where there is more than
one object of the given type that belong to the same cell, only the object with the highest   is
considered as input. Within each cell, the input variables are split into 3 blocks: e-gamma, muon,
hadrons. One input cell is represented by 188 inputs: 34 variables in the hadrons block, 60 variables in
the muon block, and 82 variables in the e-gamma block, plus four high-level features, which are added
for each block.</p>
      <p>As a result, the total number of inputs is 105 699: 43 high-level features and 105 656 from the
two grids. The high dimensionality of the inputs is compensated by a low occupancy: the average
number of non-empty cells in the training set is around 1.7% (7.1%) for the signal (isolation) grid.</p>
      <p>The organization of the low-level inputs into two 2D grids allows to first process the local
patterns originating from the tau or jet structure, and then iteratively to combine the obtained
information covering bigger  ×  regions up to the point where the whole tau signal or isolation
cones are covered. This approach is inspired by similar techniques that are widely used in the modern
ML-based image recognition with convolutional DNNs. Considering the high dimensionality of the
input space (188 inputs per cell), a pre-processing step with several fully connected dense layers
allows us to reduce the dimensionality before processing the signal (isolation) grid with 5 (10)
convolutional layers with 3 × 3 windows each, on each step extracting 64 features from nine alongside
cells until the entire grid is convoluted into an array of 64 features. Also, the information from the
high-level features is pre-processed by three fully connected dense layers. It is then combined with the
convoluted representations of the signal and isolation cones and passed through 5 dense layers. The
four outputs,   , of the network represent estimates of the probabilities of the reconstructed tau
candidate to be   ,   ,   , or a genuine  ℎ. The overall number of trainable parameters is 1 555 352.</p>
      <p>
        In order to ensure the best performance for a wide tau identification efficiency range, we
define a custom loss function based on the focal loss [
        <xref ref-type="bibr" rid="ref4">8</xref>
        ] for the training. The loss function is
minimized using the Adam algorithm with the Nesterov momentum [
        <xref ref-type="bibr" rid="ref5">9</xref>
        ]. The DNN structure is
implemented using the Tensorflow package [10] and the training is run for 10 epochs. The best
performance on the validation set is achieved after 7 epochs and the corresponding DNN is chosen as
the final discriminator. The discriminator score against each background source is chosen to be of the
form    =   ⁄(  +   ), where  ∈ { ,  ,  }.
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Results</title>
      <p>The performance of the algorithm is evaluated using MC simulation and, applying the
following preselection on the reconstructed tau candidates:   ∈ (20, 1000) GeV, | | &lt; 2.3,
| | &lt; 0.2 cm. The tau ID efficiency is estimated from  →  MC using reconstructed tau candidates
that match hadronically decaying taus at the generator level (the simulation step just before modelling
of interactions of the particles with the detector). The results in Figure 1 show the DeepTau
performance in form of the receiver operating characteristic (ROC) curve on 2017 MC. The jet
misidentification probability is estimated from   ̅ MC using reconstructed tau candidates that match
quarks or gluons at the generator level and do not overlap with generated prompt electrons, muons or
products of hadronic tau decays. The probability for an electron (muon) to be misidentification as  ℎ is
estimated from Drell-Yan MC using reconstructed tau candidates that match to electrons (muons) at
the generator level. DeepTau shows consistent improvement at both low and high   ranges for all
sources of backgrounds.</p>
      <p>
        To evaluate the DeepTau performance on data, events with well reconstructed muon and tau
candidates are selected. The visible  mass is reconstructed as the sum of 4-momenta of the muon
and visible tau decay products. Figure 2 shows a comparison of the distributions of the visible   mass
for 2018 data between the selection using the previously available discriminators from [
        <xref ref-type="bibr" rid="ref3">7</xref>
        ] and the
selection using DeepTau. With the DeepTau selection, the yield from genuine  ℎ increases by 20%,
while the yield from fakes decreases by 23%.
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>A new ML-based algorithm to discriminate hadronic tau decays against all main sources of
backgrounds has been developed. The introduction of DeepTau provides a considerable improvement
of the tau identification performance. Compared to the previously used discriminators, for the same
efficiency to reconstruct hadronic tau decays, the jet misidentification probability is reduced by more
than 50%, and the probability to misidentify an electron (muon) as a  ℎ is reduced by up to 95%
(90%).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Particle</given-names>
            <surname>Data Group</surname>
          </string-name>
          .
          <source>2019 Review of Particle Physics // Phys. Rev. D</source>
          <volume>98</volume>
          (
          <year>2018</year>
          )
          <volume>030001</volume>
          [2]
          <string-name>
            <given-names>CMS</given-names>
            <surname>Collaboration</surname>
          </string-name>
          .
          <source>The CMS Experiment at the CERN LHC // 2008 JINST 3 S08004</source>
          [3]
          <string-name>
            <given-names>CMS</given-names>
            <surname>Collaboration</surname>
          </string-name>
          .
          <article-title>Particle-flow reconstruction and global event description with the CMS detector</article-title>
          // 2017 JINST 12 P10003
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Cacciari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.P.</given-names>
            <surname>Salam</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Soyez. The</surname>
          </string-name>
          anti-  jet clustering algorithm // JHEP 04 (
          <year>2008</year>
          )
          <volume>063</volume>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Cacciari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.P.</given-names>
            <surname>Salam</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Soyez. FastJet</surname>
          </string-name>
          User Manual // Eur. Phys. J. C
          <volume>72</volume>
          (
          <year>2012</year>
          )
          <year>1896</year>
          [6]
          <string-name>
            <given-names>CMS</given-names>
            <surname>Collaboration</surname>
          </string-name>
          .
          <article-title>Reconstruction and identification of  lepton decays to hadrons</article-title>
          and   at CMS // 2016 JINST 11 P01019
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>CMS</given-names>
            <surname>Collaboration</surname>
          </string-name>
          .
          <article-title>Performance of reconstruction and identification of  leptons decaying to hadrons</article-title>
          and   in pp collisions at √ = 13 TeV // 2018 JINST 13 P10005
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>T.-Y.</given-names>
            <surname>Lin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Goyal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Girshick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>He</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Dollár</surname>
          </string-name>
          . Focal Loss for Dense Object Detection // arXiv:
          <fpage>1708</fpage>
          .02002
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>T.</given-names>
            <surname>Dozat</surname>
          </string-name>
          ,
          <source>Incorporating Nesterov Momentum into Adam // CS 229 Machine Learning</source>
          (
          <year>2015</year>
          )
          <volume>054</volume>
          [10]
          <string-name>
            <given-names>M.</given-names>
            <surname>Abadi</surname>
          </string-name>
          et al.
          <source>TensorFlow: Large-scale machine learning on heterogeneous systems</source>
          ,
          <year>2015</year>
          .
          <article-title>Software available from tensorflow</article-title>
          .
          <source>org.</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>