<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshop on Knowledge Discovery and User Modelling for Smart Cities
August</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Potholes vs. speed bumps: a multivariate time series classification approach</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ariel Monteserin</string-name>
          <email>ariel.monteserin@isistan.unicen.edu.ar</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ISISTAN, CONICET-UNICEN</institution>
          ,
          <addr-line>Campus Universitario, Tandil</addr-line>
          ,
          <country country="AR">Argentina</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <volume>20</volume>
      <issue>2018</issue>
      <abstract>
        <p>In this work, we present a preliminary approach to distinguish potholes from speed bumps by analyzing the acceleration values sensed by a mobile device. The information of the accelerometers is gathered by an experimental mobile application developed to automatically detect potholes. A driver, who has previously installed the application in her smartphone, places the device in a fixed position inside the vehicle. Thus, this application records the accelerometer oscillations and the place where the vehicle transits. Then, if the road is damaged, the vibrations produced in the vehicle can be captured by the accelerometers indicating the pothole. However, in a road there are other structures that can produce similar effects: speed bumps. In both potholes and street bumps, the accelerometers of the mobile device produce a sequence of oscillations in the three axis (X, Y and Z). We model these sequence as multivariate time series and then we classify these by using a temporal classification approach. The preliminary results were carried out with real-world data and showed a promising accuracy. Pothole detection, multivariate time series classification.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>When a vehicle transits in a road, potholes and others structures affect its stability. These variations in
the vehicle stability can be detected by the accelerometers of a mobile device (i.e. an smartphone). An
accelerometer provides data on the acceleration of the three coordinate axes with (almost) continuous
updates. This allows us to detect the slightest movements. Thus, placing the device in a fixed position
inside the vehicle, the mobile movements can reflect the movements of the vehicle. Then, we can detect
the presence of potholes or street bumps in the road, and its severity in terms of destabilization of
the vehicle, by analyzing the accelerometers information. Moreover, if we combine this information with
geolocation information, we can determine where these events occur. We name these events as stability
events. Particularly, we consider two types of speed bumps: speed humps and street gutter (a depression
running parallel to a street designed to collect rainwater, but that usually crosses perpendicular streets).
Figures 1 and 2 show two examples of speed humps and street gutter, respectively.</p>
      <p>The accelerometer information gathered by the application are tuples acc={rawX, diffX, rawY, diffY,
rawZ, diffZ}. The variables rawX, rawY and rawZ correspond to the acceleration values sensed by the
sensors in the axis X, Y and Z, respectively. Moreover, the variables dif f X, dif f Y and dif f Z represent
the differences between the actual raw values and the previous one. After losing stability, the vehicle takes
several seconds to stabilize again. For this reason, each stability event is composed of several tuples acc.
Then, we define a stability event as a sequence se = f(t1; acc1); (t2; acc2); :::(tn; accn)g, where acci is the
accelerometer information in time i within the stability event se.</p>
      <p>
        In this context, a sequence se represents a multivariate time series. A multivariate time series is a
sequence of numerical vectors [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Several approaches have been proposed to classify multivariate time
Page 37 of 40
series when a class can be associated with it [
        <xref ref-type="bibr" rid="ref4 ref6 ref7 ref8">4,7,6,8</xref>
        ]. Particularly, Kadous and Sammut [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] propose a
feature construction technique that parameterizes sub-events of the training set and clusters them to
construct features. Once obtained the features, a standard classifier is built to classify new instances.
Some of the components that can be applied to construct features are global extractors (duration, mean,
minimum and maximum and mode of a variable of the sequence), and the following metafeatures:
– Increasing: it detects when a sequence is increasing.
– Decreasing: it detects when a sequence is decreasing.
– Plateau: it detects when a sequence is not changing.
– LocalMax and LocalMin: it detect when a sequence has a local maximum or minimum, respectively.
– RLE: Run-Length Encoding is a process where a single value repeated several times is encoded as
that value, its starting point and its duration.
      </p>
      <p>During the experimental results, we use the Kadous and Sammut approach. However, it is worth noticing
that other multivariate time series approaches can be applied.
3</p>
    </sec>
    <sec id="sec-2">
      <title>Preliminary results</title>
      <p>The experiments were carried out with real-world information extracted from Tandil, Buenos Aires,
Argentina. In total, 48 journeys were processed. Moreover, we manually identified 24 potholes, 54 speed
Page 38 of 40
humps and 33 street gutters in the streets through which the vehicle transited. Then, taking into account
the potholes and the speed bumps identified, we extracted 371 stability events, particularly: 184 events
associated to potholes, 128 events associated to speed humps, and 59 events associated to street gutters.
In average, each event was compound of 19.04 tuples acc.</p>
      <p>
        To run the experiment we used TClass1. TClass is the implementation of the approach to classify
multivariate time series proposed by Kadous and Sammut in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Since TClass allow us to define different
feature extractors, we test different configurations to find the best one considering the accuracy of the
classification.
      </p>
      <p>The best results were obtained by using the global extractors duration, mean, min and max over the
6 attribute of the sequences: rawX, diffX, rawY, diffY, rawZ and diffZ by using a J48 classification tree.
The accuracy of the approach was 63.64%. Table 1 shows the confusion matrix and precision and recall
metrics for each class. The best precision and recall were obtained predicting speed humps and potholes,
respectively. In contrast, the worst individual metrics were obtained by predicting street gutter. We think
that this is because of the low number of stability events produced by the street gutter in the dataset.</p>
      <p>Moreover, we grouped the speed hump and street gutter in a common class, in order to differentiate
potholes from speed bumps. Considering this grouping, the accuracy increase to 70%.
4</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusions and future work</title>
      <p>In this work, we propose a preliminary approach that allows us to distinguish between potholes and speed
bumps. This approach allows us to reduce the number of false positives produced during the pothole
detection process. Moreover, this approach is key if we want to make available the application in multiple
cities with the least effort. The preliminary results obtained from real-world data were promising.</p>
      <p>Future work will focus on a more extensive experimentation. Moreover, we will analyze the use of other
multivariate time series classification approaches.
1 https://sites.google.com/site/waleedkadous/software/tclass
Page 39 of 40</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Yu</surname>
          </string-name>
          chin Tai, Cheng wei Chan, and
          <article-title>Jane Yung jen Hsu</article-title>
          .
          <article-title>Automatic road anomaly detection using smart mobile device</article-title>
          .
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>A.</given-names>
            <surname>Fox</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. V. K. V.</given-names>
            <surname>Kumar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Bai</surname>
          </string-name>
          <article-title>. Multi-lane pothole detection from crowdsourced undersampled vehicle sensor data</article-title>
          .
          <source>IEEE Transactions on Mobile Computing</source>
          ,
          <volume>16</volume>
          (
          <issue>12</issue>
          ):
          <fpage>3417</fpage>
          -
          <lpage>3430</lpage>
          ,
          <year>Dec 2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Mohammed</given-names>
            <surname>Waleed</surname>
          </string-name>
          Kadous and
          <string-name>
            <given-names>Claude</given-names>
            <surname>Sammut</surname>
          </string-name>
          .
          <article-title>Classification of multivariate time series and structured data using constructive induction</article-title>
          .
          <source>Machine Learning</source>
          ,
          <volume>58</volume>
          (
          <issue>2</issue>
          ):
          <fpage>179</fpage>
          -
          <lpage>216</lpage>
          ,
          <year>Feb 2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Chuanjun</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Latifur</given-names>
            <surname>Khan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Balakrishnan</given-names>
            <surname>Prabhakaran</surname>
          </string-name>
          .
          <article-title>Real-time classification of variable length multiattribute motions</article-title>
          .
          <source>Knowl. Inf. Syst.</source>
          ,
          <volume>10</volume>
          (
          <issue>2</issue>
          ):
          <fpage>163</fpage>
          -
          <lpage>183</lpage>
          ,
          <year>August 2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>5. H.M. Ngwangwa</surname>
            ,
            <given-names>P.S.</given-names>
          </string-name>
          <string-name>
            <surname>Heyns</surname>
            ,
            <given-names>H.G.A.</given-names>
          </string-name>
          <string-name>
            <surname>Breytenbach</surname>
            , and
            <given-names>P.S.</given-names>
          </string-name>
          <string-name>
            <surname>Els</surname>
          </string-name>
          .
          <article-title>Reconstruction of road defects and road roughness classification using artificial neural networks simulation and vehicle dynamic responses: Application to experimental data</article-title>
          .
          <source>Journal of Terramechanics</source>
          ,
          <volume>53</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Patrick</given-names>
            <surname>Schäfer</surname>
          </string-name>
          and
          <string-name>
            <given-names>Ulf</given-names>
            <surname>Leser</surname>
          </string-name>
          .
          <article-title>Multivariate time series classification with WEASEL+MUSE</article-title>
          . CoRR, abs/1711.11343,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Lin</surname>
            <given-names>Wang</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhigang Wang</surname>
            , and
            <given-names>Shan</given-names>
          </string-name>
          <string-name>
            <surname>Liu</surname>
          </string-name>
          .
          <article-title>An effective multivariate time series classification approach using echo state network and adaptive differential evolution algorithm</article-title>
          .
          <source>Expert Systems with Applications</source>
          ,
          <volume>43</volume>
          :
          <fpage>237</fpage>
          -
          <lpage>249</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Zhengzheng</given-names>
            <surname>Xing</surname>
          </string-name>
          , Jian Pei, and
          <string-name>
            <given-names>Eamonn</given-names>
            <surname>Keogh</surname>
          </string-name>
          .
          <article-title>A brief survey on sequence classification</article-title>
          .
          <source>SIGKDD Explor</source>
          . Newsl.,
          <volume>12</volume>
          (
          <issue>1</issue>
          ):
          <fpage>40</fpage>
          -
          <lpage>48</lpage>
          ,
          <year>November 2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>