<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards the formal veri cation of correctness and robustness of robot swarms (Invited talk)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Panagiotis Kouvaros</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alessio Lomuscio</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, University of Cyprus</institution>
          ,
          <country country="CY">Cyprus</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Computing, Imperial College London</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>We were honoured to have the opportunity to share with the ICTCS and
CILC 2017 attendees some of the recent work in our lab on verifying robot
swarms. The talk was given by Alessio Lomuscio; the key topics discussed are
based on joint work with Dr Panagiotis Kouvaros, previously at Imperial College
London. The references below are given for the bene t of those seeking more
details on the methods presented during the talk.</p>
      <p>Robot swarms are large collections of small robots, typically running lightweight
programs, interacting with their neighbours and the environment. In recent years
swarm robotics has shown considerable applicability in a wide range of domains,
including search and rescue, automatic mining, and plant monitoring.</p>
      <p>
        I began by arguing that swarm systems bene t from logic-based speci cation
languages typically used in AI and multi-agent systems that go beyond plain
temporal logic, but also concern the knowledge, the intentions, and the strategic
abilities of the agents in the system. To motivate this, I drew parallels with
the area of multi-agent systems where approaches based on symbolic model
checking [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], also in combination with symmetry reduction [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], parallel model
checking [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], and SAT [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], are now common place.
      </p>
      <p>
        I then started discussing the speci c case of swarms. One of their key feature
is that the number of agents is unbounded at design time. I illustrated a
semantics based on agent templates and introduced the parameterised model checking
problem (PMCP) as the decision problem of establishing whether all in nitely
many concrete instances of a swarm design based on agent templates satis es a
given temporal-epistemic speci cation. Cut-o procedures from [5{7] solving the
PMCP for di erent classes of swarms were presented, together with alternative
approaches such as counter-abstraction [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. This enabled us to ground the
discussion on concrete protocols such as opinion formation [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] and brie y discuss
related topics such as the veri cation of emergence in swarms [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        I concluded by exploring the issue of resilience of a swarm against adverse
functioning conditions. Again I drew parallels with our previous work on safety
analysis in the context of autonomous systems [11{13]. To do this, I introduced
the parameterised fault-tolerance problem as the decision problem of
establishing whether any concrete system in which the ratio of faulty versus total number
of agents is bounded by a parameter, satis es a given temporal-epistemic speci
cation. I illustrated how faults can be injected automatically into correct designs
so that the resulting mutated models can be automatically analysed and
conclusions on the resilience of the original design can be drawn [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Qu</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Raimondi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <string-name>
            <surname>MCMAS</surname>
          </string-name>
          :
          <article-title>A model checker for the veri cation of multi-agent systems</article-title>
          .
          <source>Software Tools for Technology Transfer</source>
          <volume>19</volume>
          (
          <issue>1</issue>
          ) (
          <year>2017</year>
          )
          <volume>9</volume>
          {
          <fpage>30</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Cohen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dam</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Qu</surname>
          </string-name>
          , H.:
          <article-title>A symmetry reduction technique for model checking temporal-epistemic logic</article-title>
          .
          <source>In: Proceedings of the 21st International Joint Conference on Arti cial Intelligence (IJCAI09)</source>
          . (
          <year>2009</year>
          )
          <volume>721</volume>
          {
          <fpage>726</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Kwiatkowska</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Qu</surname>
          </string-name>
          , H.:
          <article-title>Parallel model checking for temporal epistemic logic</article-title>
          .
          <source>In: Proceedings of the 19th European Conference on Arti cial Intelligence (ECAI10)</source>
          , IOS Press (
          <year>2010</year>
          )
          <volume>543</volume>
          {
          <fpage>548</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Kacprzak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Penczek</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>From bounded to unbounded model checking for temporal epistemic logic</article-title>
          .
          <source>Fundamenta Informaticae</source>
          <volume>63</volume>
          (
          <issue>2-3</issue>
          ) (
          <year>2004</year>
          )
          <volume>221</volume>
          {
          <fpage>240</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Automatic veri cation of parametrised interleaved multi-agent systems</article-title>
          .
          <source>In: Proceedings of the 12th International Conference on Autonomous Agents and Multi-Agent systems (AAMAS13)</source>
          ,
          <source>IFAAMAS</source>
          (
          <year>2013</year>
          )
          <volume>861</volume>
          {
          <fpage>868</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A cuto technique for the veri cation of parameterised interpreted systems with parameterised environments</article-title>
          .
          <source>In: Proceedings of the 23rd International Joint Conference on Arti cial Intelligence (IJCAI13)</source>
          , AAAI Press (
          <year>2013</year>
          )
          <year>2013</year>
          {
          <fpage>2019</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Parameterised veri cation for multi-agent systems</article-title>
          .
          <source>Arti cial Intelligence</source>
          <volume>234</volume>
          (
          <year>2016</year>
          )
          <volume>152</volume>
          {
          <fpage>189</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A counter abstraction technique for the veri cation of robot swarms</article-title>
          .
          <source>In: Proceedings of the 29th AAAI Conference on Arti cial Intelligence (AAAI15)</source>
          , AAAI Press (
          <year>2015</year>
          )
          <year>2081</year>
          {
          <fpage>2088</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Formal veri cation of opinion formation in swarms</article-title>
          .
          <source>In: Proceedings of the 15th International Conference on Autonomous Agents and Multi-Agent systems (AAMAS16)</source>
          ,
          <source>IFAAMAS</source>
          (
          <year>2016</year>
          )
          <volume>1200</volume>
          {
          <fpage>1209</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Verifying emergent properties of swarms</article-title>
          .
          <source>In: Proceedings of the 24th International Joint Conference on Arti cial Intelligence (IJCAI15)</source>
          , AAAI Press (
          <year>2015</year>
          )
          <volume>1083</volume>
          {
          <fpage>1089</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Ezekiel</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Combining fault injection and model checking to verify fault tolerance in multi-agent systems</article-title>
          .
          <source>In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS09)</source>
          , IFAAMAS Press (
          <year>2009</year>
          )
          <volume>113</volume>
          {
          <fpage>120</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Ezekiel</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Molnar</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Veres</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Verifying fault tolerance and selfdiagnosability of an autonomous underwater vehicle</article-title>
          .
          <source>In: Proceedings of the 22nd International Joint Conference on Arti cial Intelligence (IJCAI11)</source>
          , AAAI Press (
          <year>2011</year>
          )
          <volume>1659</volume>
          {
          <fpage>1664</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Ezekiel</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Combining fault injection and model checking to verify fault tolerance, recoverability, and diagnosability in multi-agent systems</article-title>
          .
          <source>Information and Computation</source>
          <volume>254</volume>
          (
          <issue>2</issue>
          ) (
          <year>2017</year>
          )
          <volume>167</volume>
          {
          <fpage>194</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Kouvaros</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Verifying fault-tolerance in parameterised multi-agent systems</article-title>
          .
          <source>In: Proceedings of the 26th International Joint Conference on Arti cial Intelligence (IJCAI17)</source>
          , AAAI Press (
          <year>2017</year>
          )
          <volume>288</volume>
          {
          <fpage>294</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>