<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Victoria University of Wellington</institution>
          ,
          <addr-line>P. O. Box 600, Wellington 6140</addr-line>
          ,
          <country country="NZ">New Zealand</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Despite being one of the fundamental concepts of multi-level modeling - to the extent of occurring in the name of the discipline - the concept of “level” has no universally agreed upon meaning among multi-level modeling researchers. There is no consensus on what the nature of a level is nor on how levels should be used to organize modeling elements. In this paper, I aim to initiate a discussion on what the options for defining levels in multi-level modeling are and how they could be systematically characterized.</p>
      </abstract>
      <kwd-group>
        <kwd>multi-level modeling</kwd>
        <kwd>level</kwd>
        <kwd>order</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        Multi-level modeling has demonstrably matured from a research idea to an approach
of practical significance. The complexity-reducing properties of multi-level modeling
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], have been shown to be applicable in a number of real world models, e.g., 35%
of OMG specifications and 20% in the ReMoDD repository [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], and some real world
solutions already have been tackled with multi-level technology [
        <xref ref-type="bibr" rid="ref18 ref2">27,18,2</xref>
        ].
      </p>
      <p>
        However, there is no discipline-wide consensus on what the term “Level” in
“MultiLevel Modeling” represents. The majority of approaches align their “level” concept
with the notion of a classification stratum [
        <xref ref-type="bibr" rid="ref14 ref24 ref6">14,24,6</xref>
        ], however with considerable
variations. There are furthermore approaches that use broader notions of abstraction between
levels, including relationships that are akin to generalization [
        <xref ref-type="bibr" rid="ref15">15,26</xref>
        ]. The spectrum
continues with approaches where levels do not intrinsically emerge from level content but
are defined by association with stakeholders [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], or are even deemed unnecessary [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>An investigation into the differences of these various interpretations of “level” and
what their impact on multi-level modelers is indicated for a number of reasons:
i) level underpinnings should be made explicit in order to support an informed growth
of approaches and to avoid misunderstandings and unwarranted debates between
proponents of different approaches.
ii) a potential consolidation of ideas would lend more strength to particular schools of
thought.
iii) trade-off analyses regarding the impact on multi-level modelers should give the
latter a way to choose the optimal approach for their application.
iv) leveraging the sanity-checking ability of some level-based well-formedness
constraints has significant potential to reduce errors in modeling.</p>
      <p>
        Regarding the last aspect, Brasileiro et al. have shown that taxonomic hierarchies in
Wikidata contain an alarming amount of statements that are inconsistent with each
other [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. A staggering 85% of classes in Wikidata participate in what Brasileiro et
al. refer to as “Anti-Pattern 1”, which uses an illogical combination of classification
and generalization to allow conclusions such as “Tim Berners-Lee is an instance of
Profession”, which is an actual example from the analysis. Fragments of knowledge
representation that, when combined, allow one to infer such nonsensical conclusions
are inadmissible in so-called level adjuvant schemes ([
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]) that not only use levels as an
organizational device but also as a safeguard against ill-formed models [
        <xref ref-type="bibr" rid="ref13 ref20 ref3 ref5">3,5,20,13</xref>
        ].
      </p>
      <p>
        Considering the aforementioned reasons, I therefore could not agree more with
Almeida who stated “it is paramount for multi-level modeling as a discipline to
investigate the guiding notion of ‘level’” and with his proposed five point investigation
into the nature of levels [1, Sec. 3.2]. Due to space constraints, I will only consider
simple linear levels schemes, in particular those used for the ontological dimension of
multi-level modeling approaches. The treatment of !-levels [25] and/or spanning levels
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], or levels schemes that are organized as a lattice are left to future work.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Background</title>
      <p>The classic OMG four-layer architecture (see Fig. 1(a)) has been a popular subject of
study regarding metamodeling principles and also serves an example for how drastically
an initially nondescript layer or level hierarchy may change its appearance upon closer
examination. Figure 1(a) shows the original depiction of the four-layer architecture that
M3
M2
M1
M0</p>
      <sec id="sec-2-1">
        <title>Meta-Metamodel</title>
      </sec>
      <sec id="sec-2-2">
        <title>Metamodel</title>
      </sec>
      <sec id="sec-2-3">
        <title>Model</title>
      </sec>
      <sec id="sec-2-4">
        <title>System</title>
        <p>(a)
M2
M2
M1
W</p>
      </sec>
      <sec id="sec-2-5">
        <title>Meta-Language</title>
      </sec>
      <sec id="sec-2-6">
        <title>Language Definition</title>
      </sec>
      <sec id="sec-2-7">
        <title>Types</title>
      </sec>
      <sec id="sec-2-8">
        <title>Instances</title>
      </sec>
      <sec id="sec-2-9">
        <title>System</title>
        <p>
          (b)
used three instance of arrows of the same kind. A closer examination, however, revealed
that three different relationships are involved, of which one (connecting the system
under study with the model stack proper) is a representation relationship that often is
not related to classification at all [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. Only the upper two-layer connecting relationships
are of the (linguistic classification) kind originally suggested by the OMG.
        </p>
        <p>
          The first metamodeling principle that aimed at introducing sanity-ensuring rules
was the so-called strict metamodeling doctrine [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. The first version of deep
metamodeling ([
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]) chose classification as the relationship between levels and embraced
the strictness doctrine, i.e., its levels were separated by instance of relationships that
were restricted to only occur between two adjacent levels.
        </p>
        <p>
          Note that the so-called orthogonal classification architecture ([
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]), essentially
depicted in Figure 1(b), features two (individually strict) orthogonal classification layer
structures (formed by linguistic and ontological instance of relationships respectively).
Both of these hierarchies are therefore implied by the order (as in “classification power”)
of the elements they host. Elements representing particulars have order zero, elements
representing types of particulars have order one, etc. As a result, these early level
schemes can be referred to as order-based.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>A Story of Levels</title>
      <p>In general, the rationale for employing levels is to achieve a grouping of elements that
share some commonality with each other. For instance, in the case of the OMG’s
fourlayer architecture, all elements within a particular layer belong to one language
definition or represent usages of one language. For an explicit description of a level-based
organization scheme it is therefore helpful to explicitly state a level cohesion principle
which characterizes why elements are grouped with other elements in the same level.
3.1</p>
      <p>
        Level Cohesion Principle
Cohesion between elements in a level reflects a notion of semantic proximity. For
instance, as mentioned before, Henderson-Sellers and Gonzalez-Perez proposed a level
scheme whose level cohesion principle is stakerholdership. For schemes that are
ordersynchronized (e.g., MLT [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]), the cohesion principle is order value. For schemes that
are potency-synchronized (e.g., Metadepth [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]), the cohesion principle is potency value.
      </p>
      <p>A respective grouping of elements implies a segregation of elements (into their
disjunct levels) which is considered helpful for
– maintaining an overview by systematically organizing elements, and
– detecting potentially problematic relationships by recognizing them as
“level-crossing”.</p>
      <p>
        If a level scheme is constructed such that one would only expect one kind of
relationship – e.g., instance of for order-based schemes – or only few kinds of relationships
that are related in nature ([
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]), then the occurrence of other kinds of level-crossing
relationships could be deemed to flag problematic modeling scenarios that could be in
discord with an intended underlying modeling paradigm or are known to create illogical
scenarios (cf. Sect. 1).
      </p>
      <p>From the above it follows that an alternative way to describe a level-based
organization scheme is to explicitly state its level segregation principle which characterizes
how elements in adjacent levels are related to each other. Note that while it may initially
appear as if a segregation principle and a cohesion principle for the same level hierarchy
were just dual formulations of each other, I will later show that this is not the case.
3.2</p>
      <p>
        Level Segregation Principle
In a survey conducted ahead of Dagstuhl seminar 17492, 16 participants (out of 18
respondents) indicated in their response to the question “What is multi-level modeling?”
that the segregation principle used in multi-level modeling is abstraction [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Fewer
participants (10) phrased their definition in such a manner that allowed to infer the
abstraction principle to be classification.
      </p>
      <p>
        Within order-based level schemes there is still room for variability regarding the
placement of elements in such level hierarchies. Even when a so-called level-respecting
scheme ([
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]) is used – i.e., when within instantiation chains the change in order must
exactly correspond to the change in level ( order = level) – the exact placement
of elements is still not fully determined. The Dagstuhl seminar 17492 working group
“Formal Foundations and Ontology Integration” recognized that organizing elements
into levels always follows one of either two schemes:
      </p>
      <p>LS1: element.order = element.level, or</p>
      <p>
        LS2: element.order element.level [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>I refer to LS1 as order-synchronized and LS2 as order-aligned.</p>
      <p>It is important to observe that all aforementioned level schemes imply the same
relative level differences between elements. The relative level distance ( level) between
related elements – as measured by the difference in level values between elements in
the same classification branch – is always the same, independently of the choice of LS1
or LS2. The latter, i.e., order-aligned schemes, simply enable elements to be optionally
shifted up the level hierarchy to any desired height.</p>
      <p>As a result, it is adequate to regard order-synchronized schemes as reflecting logical
classification strata in an absolute sense, whereas the contents of order-aligned schemes
are always locally equivalent to that of order-synchronized schemes but additionally
support varying absolute localization.</p>
      <p>Due to the fact that order-synchronization is simple, easy to formally capture, and
references a tried and tested principle of organization, to which order-alignment
represents a variation that has hitherto not been explicitly motivated, I will focus the
following discussion on a comparison of these two order-based level schemes.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Comparing Order-Based Level Schemes</title>
      <p>
        Since both order-synchronization and order-alignment use the same level segregation
principle (classification), they both support the same level of sanity-checking, i.e., are
equivalent with respect to the kinds of anti-pattern (as employed by Brasileiro et al. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ])
they can be used to detect.
      </p>
      <p>However, order-synchronization and order-alignment differ in the level cohesion
principle they use. In order-synchronization the cohesion and segregation principles are
duals of each other. Any element that is segregated from a reference element is treated as
being in cohesion with all other elements that are segregated from the reference element
in the same way (here, that have the same level distance to the reference element).
Likewise, any two elements that are viewed as being cohesive, are segregated to all
other elements in the same manner respectively (here, by the same level distance).</p>
      <p>
        In order-alignment, two cohesive elements need not have coincidental segregation
properties. Figure 3 illustrates an advantage of the relaxed rules of the order-alignment
scheme. In this scenario, which features two classification hierarchies – one for
activities and one for products (cf. [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]) – it is possible for the product BobsClass to be
associated to the activity enactment BobDesigns in a manner that does not require the
association to cross a level boundary.
      </p>
      <p>Note that an order-synchronized allocation of the elements in Fig. 3 would have
required BobDesigns to reside at level zero, thus creating an association that would
have crossed a level boundary. As discussed before, a potential advantage of level-based
schemes is that they allow potentially problematic relationships to be easily recognized
by the fact that they cross level boundaries even though they are not of the kind that
gives rise to the level segregation principle. With respect to cases like BobDesigns and
BobsObject – in which an alignment of separate classification hierarchies can be easily
achieved by shifting them against each other – order-aligned schemes thus are able to
reduce the number of false positives.</p>
      <p>This desirable property of order-aligned schemes can be justified by elaborating
their associated level cohesion principle as grouping elements that share semantic
proxl
e
v
e
l
≤
r
e
d
r
o
l
e
v
e
l
≤
r
e
d
r
o
level = 2
order = 1
level = 1
order = 0</p>
      <sec id="sec-4-1">
        <title>DesignActivity</title>
        <p>duration1: Integer</p>
      </sec>
      <sec id="sec-4-2">
        <title>BobDesigns</title>
        <p>duration = 50</p>
      </sec>
      <sec id="sec-4-3">
        <title>BobsClass</title>
        <p>validated = True</p>
        <p>BobsObject
validated = True
o
r
d
e
level = 1 r</p>
        <p>
          =
order = 1 l
e
v
e
l
o
r
d
level = 0 re=
order = 0 l
e
v
e
l
imity – here in the sense of participating in relations as implied by associations –
without causing a violation of a strict (cf. [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]) application of a classification segregation
principle.
        </p>
        <p>In summary, order-aligned schemes allow the same sanity-checking capabilities as
order-synchronized schemes but support a more accommodating level cohesion
principle. On the one hand, the implicit level allocation of elements in an order-synchronized
scheme relieves modelers from making placement decisions. On the other hand, the
level hierarchy only reflects the segregation principle at the expense of not
accommodating a richer cohesion principle. While order-alignment may require manual
vertical adjustments to local classification ensembles, the placement of elements could
be largely automated by choosing placements that minimize the overall sum of
levelcrossing relationships.</p>
        <p>The optimization principle has to be one of minimization as opposed to complete
removal, since it is unfortunately not the case that order-aligned schemes can avoid all
non-problematic relationships from crossing level boundaries. In Fig. 3, BobDesigns
also entertains a relationship with BobsObject which has to reside on a different level
in order to respect its local order-level-locking ( order = level) with respect to
BobsClass. This means that the association between BobDesigns and BobsObject has to
cross a level boundary, making it a “false positive” in the aforementioned sense.</p>
        <p>
          Atkinson and Ku¨hne have argued that diagrams exhibiting such “non-strict”
scenarios can be regarded as the superimposition of two locally strict diagrams [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. Figure 4
shows a different rendering of the elements in Fig. 3, using so-called modeling spaces
to allow local classification hierarchies to be fully strict, and thus enable the notion that
every level-crossing relationship within a modeling space does constitute a problematic
relationship giving rise to the previously mentioned anti-pattern , i.e. enabling a local
“no false positives” principle.
        </p>
        <p>It seems plausible that the perimeters of modeling spaces can be straightforwardly
defined based on connected classification ensembles, but the exact details and the
empirical validation of the assumed advantages of order-aligned schemes over
ordersynchronized schemes remains future work.</p>
        <p>A2
A1
A0</p>
        <sec id="sec-4-3-1">
          <title>ActivityType</title>
        </sec>
        <sec id="sec-4-3-2">
          <title>DesignActivity</title>
        </sec>
        <sec id="sec-4-3-3">
          <title>BobDesigns</title>
          <p>P2
P1
P0</p>
        </sec>
        <sec id="sec-4-3-4">
          <title>Class</title>
        </sec>
        <sec id="sec-4-3-5">
          <title>BobsClass</title>
        </sec>
        <sec id="sec-4-3-6">
          <title>BobsObject</title>
          <p>Dagstuhl seminar 17492 working group “Formal Foundations and Ontology
Integration” concluded that fundamental notions such as the organization of elements into
levels, and the question as to which sanity-checking approaches are expedient, still require
further investigation in order to support an explicit understanding and a solid platform
for coherent multi-level modeling frameworks [1, p. 23, p. 33].</p>
          <p>This paper aimed at taking steps towards addressing these important questions. In
particular, Almeida’s question: “What does it mean for an entity to be in a ‘level’?” [1,
Sec. 3.2] can now be answered in two ways based on the framework developed in this
paper. One way to answer the question is to state how an entity is segregated from other
entities in adjacent levels. The second way to answer the question is to state the level
cohesion principle which groups the entity with other entities in the same level.</p>
          <p>I maintain that multi-level modeling research would benefit from each approach
having both its level segregation principle and its level cohesion principle explicitly
formulated. For instance, such an explication would avoid criticizing sanity-checking
strictness schemes for their apparent inflexibility when their rules are being applied to
level schemes whose level segregation principle is simply not amenable to strictness
enforcing rules. Any multi-level modeling approach with a level segregation principle
that is akin to generalization will certainly not benefit from enforced strictness.
However, it is undoubtedly the case that order-based level schemes can significantly benefit
from strictness schemes by effectively trivializing the detection of a whole class of
antipatterns.</p>
          <p>This paper showed that there is merit in separating a level segregation principle
from a level cohesion principle because there are useful examples where these
principles are not simply duals of each other. Instead, a level cohesion principle may enjoy a
constructive cohabitation with a level segregation principle, enriching the latter. I
discussed the particular case of order-alignment, which has some interesting advantages
over order-synchronization that deserve further investigation.</p>
          <p>I maintain there is promise in identifying more anti-patterns whose detection would
reveal serious inconsistencies and illogical constellations in multi-level models. Such
anti-patterns could then inform further constraints to be used for tightening level
membership principles. However, until such anti-patterns are identified within scenarios
enabled by order-alignment schemes (compared to order-synchronized schemes) it
appears to be justified to not prematurely tighten level membership rules.
Acknowledgments
This paper draws considerably from numerous insightful debates with Colin Atkinson. I
would furthermore like to thank all members of the “Formal Foundations and Ontology
Integration’ group of Dagstuhl Seminar 17492 for the stimulating discussions.
25. Mylopoulos, J., Borgida, A., Jarke, M., Koubarakis, M.: Telos: Representing knowledge
about information systems. Information Systems 8(4), 325–362 (1990)
26. Neumayr, B., Schuetz, C.G., Jeusfeld, M.A., Schrefl, M.: Dual deep modeling: multi-level
modeling with dual potencies and its formalization in f-logic. Software &amp; Systems Modeling
pp. 1–36 (2016)
27. Rossini, A., de Lara, J., Guerra, E., Nikolov, N.: A comparison of two-level and multi-level
modelling for cloud-based applications. In: Proceedings of ECMFA 2015. pp. 18–32. LNCS
9153 (2015)</p>
        </sec>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Almeida</surname>
            ,
            <given-names>J.P.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frank</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <string-name>
            <surname>Multi-Level Modelling</surname>
          </string-name>
          (
          <issue>Dagstuhl Seminar 17492</issue>
          ).
          <source>Dagstuhl Reports</source>
          <volume>7</volume>
          (
          <issue>12</issue>
          ),
          <fpage>18</fpage>
          -
          <lpage>49</lpage>
          (
          <year>2018</year>
          ), http://drops.dagstuhl.de/ opus/volltexte/2018/8675
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Aschauer</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dauenhauer</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pree</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          :
          <article-title>Representation and traversal of large clabject models</article-title>
          . In: Schu¨rr,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Selic</surname>
          </string-name>
          ,
          <string-name>
            <surname>B</surname>
          </string-name>
          . (eds.)
          <source>Proceedings of the 12th International Conference on Model Driven Engineering Languages and Systems, MODELS</source>
          <year>2009</year>
          , Denver, CO, USA, October 4-
          <issue>9</issue>
          ,
          <year>2009</year>
          . pp.
          <fpage>17</fpage>
          -
          <lpage>31</lpage>
          . Springer Verlag (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Meta-modeling for distributed object environments</article-title>
          .
          <source>In: Enterprise Distributed Object Computing</source>
          . pp.
          <fpage>90</fpage>
          -
          <lpage>101</lpage>
          . IEEE Computer Society (Oct
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gerbig</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Comparing multi-level modeling approaches</article-title>
          .
          <source>In: Proceedings of the 1st International Workshop on Multi-Level Modelling co-located with the 17th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS</source>
          <year>2014</year>
          ).
          <source>CEUR Workshop Proceedings</source>
          , vol. Vol-
          <volume>1286</volume>
          , pp.
          <fpage>43</fpage>
          -
          <lpage>52</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Separation of concerns through stratified architectures</article-title>
          .
          <source>International Workshop on Aspects and Dimensions of Concerns, ECOOP</source>
          <year>2000</year>
          , Cannes, France (
          <year>June 2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>The essence of multilevel metamodeling</article-title>
          . In: Gogolla,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Kobryn</surname>
          </string-name>
          , C. (eds.)
          <source>Proceedings of the 4th International Conference on the UML</source>
          <year>2000</year>
          , Toronto, Canada. pp.
          <fpage>19</fpage>
          -
          <lpage>33</lpage>
          . LNCS 2185, Springer Verlag (
          <year>Oct 2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Processes and products in a multi-level metamodeling architecture</article-title>
          .
          <source>International Journal of Software Engineering and Knowledge Engineering</source>
          <volume>11</volume>
          (
          <issue>6</issue>
          ),
          <fpage>761</fpage>
          -
          <lpage>783</lpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Model-driven development: A metamodeling foundation</article-title>
          .
          <source>IEEE Software 20(5)</source>
          ,
          <fpage>36</fpage>
          -
          <lpage>41</lpage>
          (
          <year>Sep 2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Rearchitecting the UML infrastructure</article-title>
          .
          <source>ACM Transactions on Modeling and Computer Simulation</source>
          <volume>12</volume>
          (
          <issue>4</issue>
          ),
          <fpage>290</fpage>
          -
          <lpage>321</lpage>
          (
          <year>Oct 2003</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Concepts for comparing modeling tool architectures</article-title>
          . In: Briand,
          <string-name>
            <surname>L</surname>
          </string-name>
          . (ed.)
          <source>Proceedings of the ACM/IEEE 8th MODELS</source>
          . pp.
          <fpage>398</fpage>
          -
          <lpage>413</lpage>
          . Springer Verlag (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Atkinson</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , Ku¨hne, T.:
          <article-title>Reducing accidental complexity in domain models</article-title>
          .
          <source>Software and Systems Modeling</source>
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <fpage>345</fpage>
          -
          <lpage>359</lpage>
          (Springer Verlag,
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Brasileiro</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Almeida</surname>
            ,
            <given-names>J.a.P.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carvalho</surname>
            ,
            <given-names>V.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guizzardi</surname>
          </string-name>
          , G.:
          <article-title>Applying a multi-level modeling theory to assess taxonomic hierarchies in wikidata</article-title>
          .
          <source>In: Proceedings of the 25th International Conference Companion on World Wide Web</source>
          . pp.
          <fpage>975</fpage>
          -
          <lpage>980</lpage>
          . WWW '16 Companion, International World Wide Web Conferences Steering Committee (
          <year>2016</year>
          ), https: //doi.org/10.1145/2872518.2891117
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Carvalho</surname>
            ,
            <given-names>V.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Almeida</surname>
            ,
            <given-names>J.P.A.</given-names>
          </string-name>
          :
          <article-title>Toward a well-founded theory for multi-level conceptual modeling</article-title>
          .
          <source>Software &amp; Systems</source>
          Modeling pp.
          <fpage>1</fpage>
          -
          <lpage>27</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Fonseca</surname>
            ,
            <given-names>C.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Almeida</surname>
            ,
            <given-names>J.P.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guizzardi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carvalho</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <article-title>A.: Multi-level conceptual modeling: From a formal theory to a well-founded language</article-title>
          .
          <source>In: Proceedings of the 37th International Conference on Conceptual Modeling (ER</source>
          <year>2018</year>
          ). LNCS, Springer Verlag (
          <year>10 2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Frank</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          :
          <article-title>Multilevel modeling - toward a new paradigm of conceptual modeling and information systems toward</article-title>
          .
          <source>Business &amp; Information Systems Engineering</source>
          <volume>6</volume>
          (
          <issue>6</issue>
          ),
          <fpage>319</fpage>
          -
          <lpage>337</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Henderson-Sellers</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gonzalez-Perez</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>On the search for a level-agnostic modelling language</article-title>
          .
          <source>In: Proceedings of the 25th International Conference on Advanced Information Systems Engineering</source>
          . pp.
          <fpage>240</fpage>
          -
          <lpage>255</lpage>
          . CAiSE'13, Springer-Verlag (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Henderson-Sellers</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gonzalez-Perez</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The rationale of powertype-based metamodelling to underpin software development methodologies</article-title>
          .
          <source>In: Proceedings of the 2Nd AsiaPacific Conference on Conceptual Modelling -</source>
          Volume
          <volume>43</volume>
          . pp.
          <fpage>7</fpage>
          -
          <lpage>16</lpage>
          . APCCM '
          <volume>05</volume>
          ,
          <string-name>
            <surname>Australian</surname>
            <given-names>Computer Society</given-names>
          </string-name>
          , Inc. (
          <year>2005</year>
          ), http://dl.acm.org/citation.cfm?id=
          <volume>1082276</volume>
          .
          <fpage>1082278</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Igamberdiev</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grossmann</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Selway</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stumptner</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>An integrated multi-level modeling approach for industrial-scale data interoperability</article-title>
          .
          <source>Software &amp; Systems</source>
          Modeling pp.
          <fpage>1</fpage>
          -
          <lpage>26</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19. Ku¨hne, T.:
          <article-title>Matters of (meta-) modeling</article-title>
          .
          <source>Software and System Modeling</source>
          <volume>5</volume>
          (
          <issue>4</issue>
          ),
          <fpage>369</fpage>
          -
          <lpage>385</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20. Ku¨hne, T.:
          <article-title>Contrasting classification with generalisation</article-title>
          .
          <source>In: Sixth Asia-Pacific Conference on Conceptual Modelling, APCCM</source>
          . pp.
          <fpage>71</fpage>
          -
          <lpage>78</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21. Ku¨hne, T.:
          <article-title>What is multi-level modeling? Dagstuhl 17492 Presentation</article-title>
          ,
          <source>Shared Documents of Dagstuhl Seminar</source>
          <volume>17492</volume>
          (
          <year>December 2017</year>
          ), https://materials.dagstuhl.de/ files/17/17492/17492.ThomasK%C3%
          <fpage>BChne4</fpage>
          .Slides.pdf
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22. Ku¨hne, T.:
          <article-title>Exploring potency</article-title>
          .
          <source>In: ACM/IEEE 21th International Conference on Model Driven Engineering Languages and Systems (MODELS '18)</source>
          . ACM (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Lara</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guerra</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cuadrado</surname>
            ,
            <given-names>J.S.</given-names>
          </string-name>
          :
          <article-title>Model-driven engineering with domain-specific metamodelling languages</article-title>
          .
          <source>Softw. Syst. Model</source>
          .
          <volume>14</volume>
          (
          <issue>1</issue>
          ),
          <fpage>429</fpage>
          -
          <lpage>459</lpage>
          (
          <year>Feb 2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Lara</surname>
            ,
            <given-names>J.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guerra</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cuadrado</surname>
            ,
            <given-names>J.S.:</given-names>
          </string-name>
          <article-title>When and how to use multilevel modelling</article-title>
          .
          <source>ACM Transactions on Software Engineering and Methodology</source>
          <volume>24</volume>
          (
          <issue>2</issue>
          ),
          <volume>12</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          :
          <fpage>46</fpage>
          (
          <year>2014</year>
          ), https: //doi.org/10.1145/2685615
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>