<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Fall Risk Detection for the Elderly using Contactless Sensors</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Takeshi Konno</string-name>
          <email>konno.takeshi@jp.fujitsu.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hiroaki Kingetsu</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daisuke Fukuda</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Toshihiro Sonoda</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Fujitsu Laboratories LTD.</institution>
          ,
          <addr-line>4-1-1, Kamikodanaka, Nakaha-ra-ku, Kawasaki, 211-8588</addr-line>
          ,
          <country country="JP">Japan</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In recent years, Japan's elderly population has been growing. As a method of reducing the nursing care period, we studied a fall risk detection for elderly people. Our aim is to detect the fall risk with contactless sensors. First, we took a video of the 5-meter walking test by 36 subjects. Then, we processed them using OpenPose. Finally, rehabilitation exercise instructors evaluated the fall risk at 2 levels. In this paper, we reported on 3 machine learning models and evaluated the accuracy of the fall prediction. As a result, we found that sufficient accuracy can be obtained even with contactless sensors.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In recent years, Japan’s elderly population has been growing.
The proportion of elderly people is estimated to reach about
30% in 2025 and about 40% in 2060. In the future, there will
no longer be enough young people to take care of the elderly.
Therefore, it is necessary to keep people healthier for longer
and reduce the nursing care period. Injuries among the
elderly are often caused by fractures due to falls.</p>
      <p>Contact sensors or contactless sensors are used for a fall
risk detection. There is a related study on fall risk detection
using many contact sensors (Gervásio et al. 2016). However,
contact sensors should not be used for elderly people with
dementia because of a risk of the accidental ingestion.</p>
      <p>
        Our aim is to detect the fall risk with contactless sensors.
OpenPose is an open-source platform that can output 24
parts as two-dimensional coordinates on single images
        <xref ref-type="bibr" rid="ref2">(Cao
et al. 2017)</xref>
        . Therefore, we can obtain walking information
without contact using OpenPose. There are studies that
utilized OpenPose for the detection of falls and diagnosis of
gait disturbance
        <xref ref-type="bibr" rid="ref3 ref4">(Solbach et al. 2017; Esmaeilzadeh et al.
2018)</xref>
        . However, they do not evaluate the fall risk. In this
paper, we evaluated the fall risk detection for Elderly using
OpenPose.
      </p>
    </sec>
    <sec id="sec-2">
      <title>Fall Risk Detection</title>
      <sec id="sec-2-1">
        <title>Video Camera Settings</title>
        <p>We took a video of 36 people taking a 5-meter walk test
using a video camera (SONY: HDR-CX470W) on a flat place
without obstacles. A space of 3-meters at the start and end
of walking was set as the preparation section and the
remaining walking section of 5-meters was evaluated (Figure 1).
Video camera</p>
      </sec>
      <sec id="sec-2-2">
        <title>Extracted Features</title>
        <p>The photographic data was then processed using OpenPose.
From the rehabilitation exercise instructor’s interview, we
extracted the following features necessary for evaluation
and used them as input data for machine learning, which was
calculated after calibrating the origin position of the
coordinates for each subject.
• Eye line (degree): Angle calculated from keypoints of
nose (Nose, 0; see Figure 2), neck (Neck, 1) and waist
(CHip, 8).
• Heel height when landing (cm): Maximum value
obtained by subtracting the coordinates of ankle (LAnkle,
14) from that of toe (LLToe, 20).
• Toe height when making contact with the ground
(cm): Maximum value obtained by subtracting the
coordinates of ankle (LAnkle, 14) from that of toe (LLToe,
20).
• Stride length (cm): Average stride length. Here, for
simplicity, we counted how many times the foot makes
contact with the ground and divided 5-meter by that number.
• Gait velocity (m/s): Average gait speed for each
subject.</p>
        <p>keypoints</p>
        <p>Nose = 0</p>
        <p>Neck = 1
RShoulder = 2</p>
        <p>RElbow = 3</p>
        <p>RWrist = 4
LShoulder = 5</p>
        <p>LElbow = 6
LWrist = 7
CHip = 8</p>
        <p>RHip = 9
RKnee = 10
RAnkle = 11</p>
        <p>LHip = 12
LKnee = 13
LAnkle = 14
REye = 15
LEye = 16
REar = 17
LEar = 18
LRToe = 19
LLToe = 20
LHeel = 21
RLToe = 22
RRToe = 23</p>
        <p>RHeel = 24</p>
        <p>Finally, rehabilitation exercise instructors evaluated the fall
risk at 2 levels (Figure 3) for 36 people who are not
dementia:
• High (4 people)
• Low (32 people)</p>
        <sec id="sec-2-2-1">
          <title>Subject A</title>
        </sec>
        <sec id="sec-2-2-2">
          <title>Subject B</title>
        </sec>
        <sec id="sec-2-2-3">
          <title>Subject</title>
          <p>Eye line (degree)
Heel height (cm)
Toe height (cm)
Stride length (cm)</p>
          <p>Gait velocity (m/s)
Possibility of fall risk</p>
          <p>A
139
10.6
6.2
71.4
1.5</p>
          <p>B
127
7.0
6.1
45.5
0.7
We evaluated the data of 36 people using 4-fold
cross-validation. The learning algorithm used the following:
・SVM (Linear kernel)
・Linear discriminant analysis
・Logistic regression</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Result</title>
      <p>The results are shown in Table 1. Three people were
incorrect answers by all algorithms. There is one case where only
Logistic regression fails in the forecast. The predicted result
was incorrect because the weight of stride length influenced.</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>In this paper, we evaluated the fall risk with contactless
sensors and OpenPose. As a result, we found that sufficient
accuracy can be obtained even with contactless sensors.</p>
      <p>In the future, we will expand the data on elderly people
and gather additional features to improve prediction
accuracy. We interviewed functional training instructors about
how to improve accuracy and we found that the feature
quantities of balance and flexibility. The feature quantity of
the balance can be obtained by taking a video from the front
or the back of elderly people. Also, The feature quantity of
the flexibility can be obtained by taking a video the pose of
seated forward bend.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>D.</surname>
          </string-name>
          <year>2016</year>
          .
          <article-title>Falls risk detection based on spatiotemporal parameters of three-dimensional gait analysis in healthy adult women from 50 to 70 years old</article-title>
          .
          <source>Fisioterapia e Pesquisa</source>
          ,
          <volume>23</volume>
          (
          <issue>4</issue>
          ),
          <fpage>358</fpage>
          -
          <lpage>364</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Cao</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Simon</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wei</surname>
            ,
            <given-names>S. E.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sheikh</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>Realtime multiperson 2d pose estimation using part affinity fields</article-title>
          . In CVPR: pp.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Solbach</surname>
            ,
            <given-names>M. D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Tsotsos</surname>
            ,
            <given-names>J. K.</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>Vision-based fallen person detection for the elderly</article-title>
          .
          <source>CoRR, abs/1707</source>
          .07608.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Esmaeilzadeh</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Khebzegga</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Moradshahi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <year>2018</year>
          .
          <article-title>Clinical Parameters Prediction for Gait Disorder Recognition</article-title>
          . arXiv preprint arXiv:
          <year>1806</year>
          .04627.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>