<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Improving listening skills in language learning with spaced repetition technique</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Y.V. Baranov</string-name>
          <email>iaroslavbaranov@corp.ifmo.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ITMO University</institution>
          ,
          <addr-line>Russia Kronverkskiy Prospekt, 49, Sankt-Peterburg, 197101</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Listening comprehension is one of the hardest skills for many people to develop in language learning. Developing listening skills is a long, slow and painful process for them. Nevertheless, we can signi cantly increase it with spaced repetition technique. This article is about using the spacing e ect for improving listening skills. The user extracts fragments from some video and repeats them later with increasing intervals. We created the application that automates and simpli es this process.</p>
      </abstract>
      <kwd-group>
        <kwd>Listening comprehension</kwd>
        <kwd>Language learning</kwd>
        <kwd>Spaced rep- etition</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Thousands of people around the world are studying foreign languages. They
spend many years to become uent speakers. Listening comprehension is an
ordeal for many of them even though they have access to thousands of
highquality videos on the Internet. We should develop a special learning technique
because it is insu cient to watch those videos passively. People forgot words and
their sounding too fast.</p>
    </sec>
    <sec id="sec-2">
      <title>Spaced repetition</title>
      <p>
        The spacing e ect was reported by a German psychologist Hermann Ebbinghaus
in 1885 [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. He observed that we tend to remember things more e ectively if we
spread reviews out over time, instead of studying multiple times in one session.
Since the 1930s there have been many proposals for utilizing the spacing e ect
to improve learning, in what has come to be called spaced repetition. According
to Ebbinghaus, we gradually forgot things if we do not repeat them (see Fig. 1).
We should recall information if we want to maintain it in our memory.
      </p>
      <p>
        We break information down into pieces (e.g., statements or video fragments).
Each piece has the last repetition day and the next repetition day. We should
increase the interval before these days. It is ine ective to do it manually. There
are a lot of programs that can assist us. Anki [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] is one of the most popular. It
is a free, cross-platform and general-purpose application.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Spacing e ect in language learning</title>
      <p>Many learners use spaced repetition for remembering new words. It is easy and
natural to create a ashcard with a foreign word on the front side and the
translation on the back, and then just review it with increasing intervals. Pimsleur
language learning system is also based on spaced repetition. It has been gaining
popularity since 1967 when it was developed.</p>
      <p>It seems appropriate to use the similar technique for listening comprehension.
We can replace ashcards with video fragments. The user can extract these
fragments from the video and review them later at increasing intervals. Spaced
repetition can help retaining obtained listening skills and imprint the speech
deeper in users mind.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Automation of video fragments extraction</title>
      <p>It is quite hard to extract video fragments without a special program, and it is
even more di cult to organize the spaced repetitions of these fragments. We were
unable to nd any program that does and tried to write an Anki extension that
would save video fragments as ashcards, but it was proved ine cient. Thus, it
was necessary to create an application from scratch. The special interface was
created that allows the user to stop the video and extract a fragment alongside
with the subtitles (see Fig. 2). The application tries to guess the start time and
the end time of the fragment. This prediction is based on subtitles accuracy and
work well in the most cases. The user can adjust the bounds of the fragment if
subtitles timing is not good enough for him. The application has the convenient
interface for it (green arrows in Fig. 2).</p>
      <p>It is possible to attach a ashcard in case the subtitle contain a new word. The
user can improve vocabulary at the same time with listening skills. The program
stores the information about all video fragments in the database. The user can
repeat previously extracted fragments (see Fig. 3). He can slow the speed down
if the speech is too fast or unclear. Pimsleur language learning system is also
based on spaced repetition. It has been gaining popularity since 1967 when it
was developed.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Work sequence</title>
      <p>The user should stick to the special order while he is working with the
application (See Fig. 4). There are three activities the fragments extraction, the rst
repetitions and the spaced repetitions. The user should start with watching the
video and extracting fragments from it. He should repeat them on the next day
with care. The rst repetition is usually more di cult than the next repetitions
(the spaced repetitions). It is worth noting that the user should work with the
application every day and spend about 2 - 2.5 hours. We presented estimated
durations for each type of activity in Table 1.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Research</title>
      <p>When the user nished a season from some TV series, the application can
calculate the average number of extracted fragments per episode. The user can
estimate his skills by this value and track their development from season to
season. This method is very precise because episodes tend to have the same length.</p>
      <p>The assistant extracted about 7000 fragments during the three-month period
(from April to June 2016) and processed four seasons from Friends (Table 2). The
average fragments decreased from 100.15 to 51.33. Thus, the assistant improved
his listening skills twice. This is a very good result because many people spend
years to achieve the same result.
7</p>
    </sec>
    <sec id="sec-7">
      <title>Technical aspects</title>
      <p>The developer wrote the application in Java/Groovy and HTML5 mainly. It
based on client-server architecture and uses Spring Framework on the server
side and AngularJS on the client side.</p>
      <p>The video player is based on HTML5 &lt;video&gt; element. Thus, there are three
supported video formats: MP4, WebM, and Ogg. However, the user should check
if his browser supports particular codecs.</p>
      <p>
        The database is stored in a le. The application works through Hibernate
Framework and uses H2 Database as an engine. Many additional libraries and
frameworks were used, such as Apache commons, Jsoup, Jetty, Twitter bootstrap
and VTT JS.
We have proved that the spaced repetition technique is useful for improving
listening skills. The user can use the application IceMemo [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] to automate this
process. We published the article on the Internet [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], and two hundred of users
downloaded the application from our server and checked it out. Some of them
contacted us a few months later and declared that their listening skills were
improved signi cantly.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. IceMemo -
          <article-title>Improving listening skills in language learning with spaced repetition technique http://icememo</article-title>
          .org
          <source>/ (retrieved on 10 March</source>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <article-title>IceMemo studying foreign languages with TV series https</article-title>
          ://geektimes.ru/post/278382/ (retrieved on 10
          <source>March</source>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Ebbinghaus</surname>
            <given-names>H.</given-names>
          </string-name>
          (
          <year>1885</year>
          ).
          <article-title>ber das Gedchtnis. Untersuchungen zur experimentellen Psychologie [Memory: A Contribution to Experimental Psychology] (in German)</article-title>
          .
          <source>Trans. Henry A</source>
          .
          <string-name>
            <surname>Ruger Clara</surname>
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Bussenius</surname>
          </string-name>
          . Leipzig, Germany: Duncker Humblot.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. Friendly,
          <article-title>intelligent ash cards. Remembering things just became much easier</article-title>
          . http://ankisrs.net
          <source>/ (retrieved on 10 March</source>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Baddeley</surname>
            <given-names>A.</given-names>
          </string-name>
          (
          <year>1997</year>
          ).
          <article-title>Human Memory: Theory and Practice"</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>