<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Integrating NLP and Structured Occurrence Nets for Crime Modelling: A Pattern-based Approach</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tuwailaa Alshammari</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>School of Computing, Newcastle University</institution>
          ,
          <addr-line>Science Square, Newcastle upon Tyne, NE4 5TG</addr-line>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
      </contrib-group>
      <fpage>2</fpage>
      <lpage>4</lpage>
      <abstract>
        <p>Structured Occurrence Nets (SONs) [1, 2] are a Petri net-based formalism for representing the behaviour of complex systems consisting of interdependent subsystems that proceed concurrently and interact with each other. In this work we aim at constructing SONs capturing crime reports expressed in natural language. This requires the identification of the subsystems (acyclic nets ANs) and their component nodes (in particular, transitions). Identifying relevant words that identify these components from the unstructured text can be challenging. Here we propose a method based on the automatic identification of subsystem components derived from manual modelling experiments. The focus of the experiments are crime stories obtained from [3]. The participants were asked to extract and represent crime events using the SONs framework. In addition, our interest was stimulated by the prospect of observing the manual identification of ANs and corresponding events/transitions to evaluate the uniformity and consistency of the resulting models. The proposed methodology employs Natural Language Processing (NLP) to automatically detect and extract crime events, using two fundamental principles. Initially, it involves the extraction of potential entities, as represented by acyclic nets. Afterwards, it identifies transitions within these ANs in order to capture the system's behaviour for further analysis and evaluation. To accomplish this, a sentence pattern-based approach is proposed to process sentences and identify events, resulting in the generation of a comprehensive representation of the system. Approach. In our previous work [4], we discussed three approaches to extract useful information from written crime stories, recognising root verbs, root verbs alongside common crime verbs, and the inclusion of all verbs to represent events. We concluded that, of the three approaches, using root verbs alongside common verbs was the most effective approach. However, it was limited by a list of common verbs that are usually found in crime stories. The current work involves two distinct phases. Initially, we analysed manual models created by SON experts. The second phase involved attempting to identify similar outputs automatically, i.e., by discovering methods to automatically identify and capture system components and behaviour - which, in the context of this experiment, refers to the behaviour of crime participants. Manual modelling. Modellers generally selected entities such as people's names and locations to</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;structured occurrence net</kwd>
        <kwd>acyclic nets</kwd>
        <kwd>communication structured acyclic net</kwd>
        <kwd>natural language processing</kwd>
        <kwd>event extraction</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Witness</p>
      <p>enter_store
BRD
represent different ANs. For this experiment, modellers selected: people’s names, weapons, law
enforcement, relative names, co-workers and professions, transportation, locations, and witnesses.
The inconsistency in entity identification and, consequently, modelling was observed among the
modellers. Events are critical in crime reports as they provide information about the actions that
occurred during a crime. We observed that modellers generally represented events/transitions
with verbs. We also found that modellers varied in the number of events selected.
Proposed modelling approach (automatic extraction). In order to create an automatic
modelling approach that mimics human modelling, we analysed and used manually created models.
As a result, and for more accurate and consistent extraction, rules were established to base our
assumptions for linking natural language with SONs.</p>
      <p>□ ENTITIES in crime text are the represention of SON acyclic nets.
□ VERBS represents SON EVENTS within acyclic nets.</p>
      <p>□ verbs shared by several entities will result in the formation of communication buffer places.
After analysing the manual models, we observed that specific entities are of more concern with
crime investigation than others. Therefore, new NER labels were introduced [WEAPON, WITNESS,
PROFESSION, TRANSPORTATION, RELATIVES].</p>
      <p>We then implemented a pattern-based approach to identify verbs representing events from
manually-created models. To be more precise, we examined the verbs indicated by most of the
modellers and, using dependency parsing, we then determined where these verbs are located in
the sentence in terms of the relationship between verbs and surrounding words.</p>
      <p>
        Our objective was to find a pattern that would allow us to identify events by imitating human
events recognition from verbs based on the manually-created SON models without the use of
predetermined words in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. In this approach, we identified seven patterns, one example is when a
parking_lot
      </p>
      <p>enter
p1
Davis</p>
      <p>picked
p7
p19
p8
q4</p>
      <p>p6
p11 run
p13
saw
le f t
shot
walked
f ired
picked
f led
subject noun, proper noun, or pronoun precedes a verb that is followed by an object noun, proper
noun, or pronoun.</p>
      <p>Results. We conducted an experiment on one of the stories to test and compare the extractor
output with human models. Figure 1 shows the human modelling and Figure 2 is the comparable
model using the output from the extractor. The identified entities were [ parking lot, Davis, Jones,
Witnesses, witness]. Moreover, ten events were identified [ saw, enter, left, ran, shot, walked, fired,
picked, carrying, fled ] compared to eight events identified manually.</p>
      <p>Conclusion. This work proposes a sentence pattern-based verb detection (events) based on
models generated manually. Initially, entities and events are identified to represent and describe
acyclic nets and their components in order to construct formal SON models which can then be
analysed Petri net-based methods.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>M.</given-names>
            <surname>Koutny</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Randell</surname>
          </string-name>
          ,
          <article-title>Structured occurrence nets: A formalism for aiding system failure prevention and analysis techniques</article-title>
          ,
          <source>Fundam. Informaticae</source>
          <volume>97</volume>
          (
          <year>2009</year>
          )
          <fpage>41</fpage>
          -
          <lpage>91</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>B.</given-names>
            <surname>Randell</surname>
          </string-name>
          ,
          <article-title>Occurrence nets then and now: The path to structured occurrence nets</article-title>
          ,
          <source>in: PETRI NETS</source>
          <year>2011</year>
          , volume
          <volume>6709</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2011</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Violence</given-names>
            <surname>Policy</surname>
          </string-name>
          <string-name>
            <surname>Center</surname>
          </string-name>
          , [online] available at: https://vpc.org/.,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>T.</given-names>
            <surname>Alshammari</surname>
          </string-name>
          ,
          <article-title>Towards Automatic Extraction of Events for SON Modelling</article-title>
          ,
          <source>CEUR Workshop Proceedings</source>
          <volume>3170</volume>
          (
          <year>2022</year>
          )
          <fpage>188</fpage>
          -
          <lpage>201</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>