<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Daily Action Dead Reckoning Using Smartphone Sensors</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Takumi Otsuki</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kohei Kanagu</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kota Tsubouchi</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nobuhiko Nishi</string-name>
          <email>nishio@cs.ritsumei.ac.jp</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ritsumeikan University</institution>
          ,
          <addr-line>Shiga</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Yahoo Japan Corporation</institution>
          ,
          <addr-line>Tokyo</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Pedestrian dead reckoning (PDR) is easy to introduce because it requires no equipment for the environment. PDR results can provide an atomic physical behavior such as step detection and turning in walking, however providing a lexible response to a user's daily actions other than walking like sitting, moving in a line or standing is tough. Our research objective is to make PDR more usable in spite of these daily actions by estimating the movement situation using the same sensor information as conventional PDR. We applied a state transition in the movement situation recognition using the transition restrictions existing between the moving situations. A new method for moving context recognition using machine learning with accelerometer and gyroscope feature vectors simultaneous with PDR is proposed herein. The experiments show that, the movement situation recognition and the state transition technique are eicient for the whole dead reckoning performance. The proposed method can also be applied to improve the PDR positioning accuracy.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Positioning techniques have been actively studied in the recent years with the
spread of services using location information. Indoor location information is
useful because it can be used for working management of factory workers and
navigation in a complex urban indoor environment, among others. Pedestrian dead
reckoning (PDR) is a typical positioning method that is functional in both indoor
and outdoor environments and achieved by continuously estimating the
walking conditions, distance and direction using the accelerometers, gyroscope and
magnetometer of the user’s smartphone, and assimilating these measurements to
estimate the current position. Moreover it does not depend on the environment
thereafter and does not require extra equipment.However, the problem is that
positioning errors are accumulated. Since PDR is a relative positioning method,
no absolute location calibration arrives. Therefore, our research focuses on the
user’s most of all kinds of movement not only walking steps that may cause
any positioning error. The current PDR, only focuses on walking recognition the
other body action states of the user are hardly considered. An erroneous step
detection when sitting in a chair at the same place, which is a daily action often
seen indoors is conirmed because of the changing leg or body posture and one’s
orientation even though he/she does not move at all. For example, we frequently
perform a changing movement in posture and body orientation, stay at the same
place with some steps , or sit for a long time as well as perform irregular
walking in which stopping is frequently and forcibly repeated such as in the line or
during congestion (hereinafter referred to as non-moving state). These states
include motion without movement, which leads to a false detection of walking
and direction estimation in PDR. The sitting condition requires to distinguish it
from the standing condition which may start moving at any time. The machine
learning technique is efective in recognizing such irregular actions and states. In
order to improve the positioning accuracy, some methods perform movement or
state identiication using highly expensive and high-precision sensors such as the
Inertial Measurement Unit(IMU)[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]; however, such devices are not available for
smartphones. The other methods using extra sensors and ixing them at speciic
positions for all would bring many limitations. Aside from clarifying the user’s
moving state, this study also performs PDR positioning by simultaneously
performing state/motion recognition using the learned model and PDR positioning
and algorithm optimization according to the estimated result of the model. We
propose a new positioning method called daily action dead reckoning to minimize
the accumulated errors and improve the positioning accuracy.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Related work</title>
      <p>2.1</p>
      <sec id="sec-2-1">
        <title>Activity recognition using a smartphone</title>
        <p>
          Makita et al.[
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] determined 11 types of walking motions and states including
a context that does not follow the movement that is diicult to predict based
on only tracked walking trajectory(e.g.sitting motions) using a sensor device
attached to the waist.Their recognition achived with 90% accuracy or more.
However, it is burdensome for the user to wear the sensor on a part of the body.
As a method without a sensor device attached to the body, Pei et al.[
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] used
a smartphone in a pocket to recognize bending considering the walking speed,
walking state, running state, and stop. Whether Cosukun et al.[
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] proposed a
method that recognizes the walking(e.g. climbing stairs) and running conditions.
KHAN et al.[
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] combined 15 smartphone acceleration sensors, microphones and
barometric pressure sensors to identify 15 daily activities and conditions. All
of the previous studies identiied the way of walking, etc., which was diferent
from the user’s movement state recognition that is the purpose of the present
research.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2 PDR using another sensor</title>
        <p>
          One method uses the IMU as a method of utilizing other sensors. The IMU is
a very high accuracy sensor compared to the micro electro mechanical system
mounted on a general smartphone and often used for PDR. Coskun et al.[
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] used
an IMU attached to the foot to estimate the leg angle etc. and optimize the PDR
according to the angle to reduce the positioning error of the PDR. Park et al.[
          <xref ref-type="bibr" rid="ref2">2</xref>
          ]
classiied the user’s movement and condition into eight using an IMU attached
to the leg and used it for PDR positioning. However, the IMU is a very expensive
sensor, and it has many limitations such as the need to ix the holding state to
a part of the body.
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3 PDR using the walking context recognition results</title>
        <p>
          Qian et al.[
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] estimated the attitude of the smartphone held by a user and
identiied the holding state of the smartphone such as calling using the smartphone,
holding it putting it in the pocket and typing characters. Depending on the
identiication result, they then optimized the PDR algorithm and improved the
positioning accuracy. However,this method cannot dynamically change the
algorithm and works only with a single algorithm. Tian et al.[
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]also estimated the
attitude of the smartphone held by a user including holding the smartphone,
swinging, and putting it in the pocket. They subsequently optimized the PDR
algorithm according to the identiication result. Kanagu et al.[
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]classiied the
state of searching for products generated during shopping from the appearance
of walking into three states, and aimed to improve the positioning accuracy.
Their method was limited because the target environment was super.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Daily action dead reckoning(DDR)</title>
      <sec id="sec-3-1">
        <title>3.1 Learning phase</title>
        <p>
          In the proposed method, we created a model by logistic regression. Logistic
regression is a regression model classiied as supervised machine learning having
the features that enable inding useful features because the weight of each feature
that leads to classiication is known. Normal walking is deined as ”walking”,
walking which is similar to stopping is deined as ”moored walk”(e.g, crowded).
Standing is deined as ”stop”, sitting is deined as ”sitting”. In addition, we also
identify standing and sitting movements for using the state transitions(3.1)
Evaluation phase In the evaluation phase, the user’s walking context is
determined by analyzing the sensor data using a trained context-aware model. The
adopted t value is the same as that used in the learning phase. The extracted
feature vectors are plotted on the data space, and a trained context recognition
model detects the context of the feature vectors. The identiied walking context
is merged with the ordinal PDR result to obtain the PDR result with context
information. The PDR algorithm is adapted to the PDR method proposed by
Yoshimi et al. [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] who accumulated changes in the stride and direction estimated
by the sensor data to identify the user’s indoor location at that time.
State transition Fig .2depicts the behavior and state identiied by the proposed
method and considered to be transitioning between some behaviors and states.
The sitting state is next to the sitting motion. The sitting motion is after the
sitting state. Some transitions cannot occur. For example, when the walking state
occurs after the sitting motion or the sitting state occurs after the leaving motion,
either of the discrimination results is erroneous. Therefore, if a class cannot be
transitioned, the state transition is performed to avoid making a transition. The
igure shows a state transition diagram that omits impossible transitions. In
the proposed method, the decrease in the discrimination accuracy between the
sitting and stop states can be by provided by identifying the action that triggers
the sitting state such as the sitting and standing actions. However, problems also
occur in this case. In the proposed method, the sensor value is cut out in time
series (the length of the cut-out time is taken as the window width) to calculate
the feature amount, but the window is appropriate in the state(e.g. sitting action
and walking state) and the width is diferent. It is necessary to return the window
width for short continuous operation and long continuous condition. If the length
is short, suicient features for walking can not be acquired, and if the length is
long, the motion may be buried. In the proposed method, state transition is
done by creating two classiiers with diferent window widths and integrating
the classiication results.
Optimization of the PDR algorithm A state of moving straight ahead
toward a destination is assumed for walking. This was the method used by Yoshimi
et al[
          <xref ref-type="bibr" rid="ref1">1</xref>
          ]which was adopted as a normal walking algorithm. In moored walk, in
a crowd or in a line, walking and stopping are continuous, and a stride may
become short;therefore a iltering algorithm that ignores a certain amount of
change in the movement direction is omitted. The stop assumes that the vehicle
stops and does not move;thus it does not use Yoshimi et al’s gait detection
algorithm and does not change the user’s current location. Similarly, step detection
is turned of while sitting down. However while sitting down, the direction of
the body does not signiicantly change from the time when it irst sat;therefore
it maintained the direction when facing the same direction for a ixed time or
more. When away from the seat reset to the direction it was holding.
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4 Evaluation</title>
      <sec id="sec-4-1">
        <title>4.1 Experiment condition</title>
        <p>In this evaluation, an attempt was made to recognize the state in which the
user is moving in the experimental building. Several chaise lounges were used
in the experimental environment. The subject was asked to walk, move in a
row, sit down, and stop. The subject in their twenties walked a speciic route
around the laboratory. The subject sat on a bench on the route, asked to change
pace at any time, and was allowed to move his posture, stride, foot, etc. As a
means of data collection, special sensor devices and sensors are not suitable for
practical use;thus we used the common smartphone Nexus 5 for evaluation. The
smartphone is put in the pocket of the pants in consideration of the burden on
the user.</p>
      </sec>
      <sec id="sec-4-2">
        <title>4.2 Estimation accuracy of models and optimization results of PDR</title>
        <p>For the feature quantities of the test data, the weighting factors in each classiier
were added up. The result of the classiier with the largest weighting factor value
was adopted as the inal estimation result. The weighting factor for the feature
value changed with each learning;thus 10 classiiers were created for each label,
and the weighting factor values were summed. In order to compare the estimation
accuracy using multiple classiiers performed by the proposed method, the case
of using a single classiier is compared. The results of using a single classiier
and the F value of each class of the proposed method (with or without state
transition) are shown in the table, and the accuracy rate of each method is
shown.(1)</p>
        <p>When a single discriminator was used the window width was set to 250 ms,
and suicient features (steps 1 and 2) of walking and mooring walk cannot be
obtained. The identiication accuracy of stand and sit motions were high, but
the state identiication accuracy was low. However, in the proposed method that
created two classiiers, gait etc. could be captured by other classiiers. Moreover
the features could be captured, and the classiication rate of the state could be
improved. Therefore, the method using classiiers with diferent window widths
was efective, but the state transition did not improve the estimation accuracy
that much. This is considered to be caused by a mistake, which caused an
erroneous transition by giving priority to the triggering of the leaving / sitting
motion. Therefore, it is thought that a mechanism such as a transition pending
state is needed so that it does not immediately transition when coming and
going sitting behavior comes in the future, and decides the transition by looking
at some subsequent estimation results.The experiment for DDR was conducted
with the route and behavior as shown in the FIG3.</p>
        <p>As a result, compared to the conventional method, the step detection error
and the direction estimation error at the time of stopping, sitting, and moored
walk are reduced(Fig4). During the stop, while the user is seated, the proposed
method does not move almost at all, and the moored walk has few positioning
errors due to a step estimation error. In the case shown in the igure, the efect
looks small because it is a short time experiment, but it can be said that it is
necessary to optimize according to the user’s state like the proposed method,
assuming long time use.
This study proposed a method that used sensor data such as acceleration and
angular acceleration that are commonly used in conventional PDR technology
to detect characteristic daily walking patterns and movements,judge the user’s
condition and use PDR. We proposed DDR to optimize the algorithm and reduce
the positioning error. Our future tasks aim to utilize this method in the actual
environment(e.g.oices) improve the estimation accuracy of the classiier, and
add motions and states to be identiied. As a state to be added, we think about
the movement to the side where the direction and movement direction of the
body are diferent, and the movement to the rear. The PDR operates with the
same movement direction as the direction of the body, these movements cannot
be distinguished from normal walking, which causes positioning errors. We also
aim to discover new issues by operating the proposed method in an environment
closer to the actual usage environment.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgement References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Shun</given-names>
            <surname>Yoshimi</surname>
          </string-name>
          , Kohei Kanagu, Masahiro Mochizuki, Kazuya Murao, and
          <string-name>
            <given-names>Nobuhiko</given-names>
            <surname>Nishio</surname>
          </string-name>
          .
          <article-title>Pdr trajectory estimation using pedestrian-space constraints: Real world evaluations</article-title>
          .
          <source>In Adjunct Proceedings of the 2015 ACM Interna- tional Joint Conference on Pervasive and Ubiquitous Computing and Proceed- ings of the 2015 ACM International Symposium on Wearable Computers</source>
          , Ubi- Comp/ISWC'15 Adjunct, pp.
          <fpage>14991508</fpage>
          , New York, NY, USA,
          <year>2015</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. PARK,
          <string-name>
            <surname>So</surname>
            <given-names>Young; JU</given-names>
          </string-name>
          , Hojin; PARK,
          <string-name>
            <given-names>Chan</given-names>
            <surname>Gook</surname>
          </string-name>
          .
          <article-title>Stance phase detection of multiple actions for military drill using foot-mounted IMU</article-title>
          . sensors,
          <year>2016</year>
          ,
          <volume>14</volume>
          :
          <fpage>16</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Koji</given-names>
            <surname>Makita</surname>
          </string-name>
          , Masakatsu Kourogi, Tomoya Ishikawa,Takashi Okuma, and Takeshi Kurata.
          <article-title>PDRplus: HumanBehaviour Sensing Method for Service Field Analysis</article-title>
          ,pp.
          <fpage>25f30</fpage>
          . Springer Japan, Tokyo,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Ling</given-names>
            <surname>Pei</surname>
          </string-name>
          , Robert Guinness, Ruizhi Chen, Jingbin Liu,Heidi Kuusniemi, Yuwei Chen, Liang Chen, and
          <string-name>
            <given-names>Jyrki</given-names>
            <surname>Kaistinen</surname>
          </string-name>
          .
          <article-title>Human behavior cognition using smartphone sensors</article-title>
          .
          <source>Sensors</source>
          , Vol.
          <volume>13</volume>
          , No.
          <issue>2</issue>
          , pp.
          <fpage>1402f1424</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>D.</given-names>
            <surname>Coskun</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. D.</given-names>
            <surname>Incel</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Ozgovde</surname>
          </string-name>
          .
          <article-title>Phone posi-tion/placement detection using accelerometer: Impact on activity recognition</article-title>
          .
          <source>In 2015 IEEE Tenth In- ternational Conference on Intelligent Sensors, Sensor Net- works and Information Processing (ISSNIP)</source>
          , pp.
          <fpage>1f6</fpage>
          ,
          <year>April 2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Khan</surname>
            ,
            <given-names>Adil</given-names>
          </string-name>
          <string-name>
            <surname>Mehmood</surname>
          </string-name>
          , et al.
          <article-title>Activity recognition on smartphones via sensor-fusion and kda-based svms</article-title>
          .
          <source>International Journal of Distributed Sensor Networks</source>
          ,
          <year>2014</year>
          ,
          <volume>10</volume>
          .5:
          <fpage>503291</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. QIAN,
          <string-name>
            <surname>Jiuchao</surname>
          </string-name>
          , et al.
          <article-title>Continuous motion recognition for natural pedestrian dead reckoning using smartphone sensors</article-title>
          .
          <source>In: Proceedings of the 27th International Technical Meeting of the ION Satellite Division, ION GNSS</source>
          .
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8. TIAN,
          <string-name>
            <surname>Qinglin</surname>
          </string-name>
          , et al.
          <article-title>An enhanced pedestrian dead reckoning approach for pedestrian tracking using smartphones</article-title>
          .
          <source>In: Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP)</source>
          ,
          <source>2015 IEEE Tenth International Conference on. IEEE</source>
          ,
          <year>2015</year>
          . p.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. KANAGU, Kohei; TSUBOUCHI, Kota; NISHIO,
          <string-name>
            <surname>Nobuhiko. Colorful</surname>
            <given-names>PDR</given-names>
          </string-name>
          :
          <article-title>Colorizing PDR with shopping context in walking</article-title>
          .
          <source>In: Indoor Positioning and Indoor Navigation (IPIN)</source>
          ,
          <source>2017 International Conference on. IEEE</source>
          ,
          <year>2017</year>
          . p.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>S. O. H.</given-names>
            <surname>Madgwick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. J. L.</given-names>
            <surname>Harrison</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Vaidyanathan</surname>
          </string-name>
          .
          <article-title>Estimation of imu and marg orientation using a gradient descent algorithm</article-title>
          .
          <source>In 2011 IEEE Inter- national Conference on Rehabilitation Robotics</source>
          , pp.
          <fpage>1f7</fpage>
          ,
          <year>June 2011</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>