<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Summary of Workshop on Model-Driven Engineering Tools (MDETools'17)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mojtaba Bagherzadeh</string-name>
          <email>mojtaba@cs.queensu.ca</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francis Bordeleau</string-name>
          <email>francis.bordeleau@cmind.io</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jean-Michel Bruel</string-name>
          <email>bruel@irit.fr</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Juergen Dingel</string-name>
          <email>dingel@cs.queensu.ca</email>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Se´bastien Ge´rard</string-name>
          <email>sebastien.gerard@cea.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nicolas Hili</string-name>
          <email>hili@cs.queensu.ca</email>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sebastian Voss</string-name>
          <email>voss@fortiss.org</email>
          <xref ref-type="aff" rid="aff6">6</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>CEA list</institution>
          ,
          <addr-line>Saclay</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Cmind Inc.</institution>
          ,
          <addr-line>Ottawa</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>IRIT, University of Toulouse</institution>
          ,
          <addr-line>Toulouse</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>School of Computing, Queen's University</institution>
          ,
          <addr-line>Kingston</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>School of Computing, Queen's University</institution>
          ,
          <addr-line>Kingston</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>School of Computing, Queen's University</institution>
          ,
          <addr-line>Kingston</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff6">
          <label>6</label>
          <institution>fortiss GmbH</institution>
          ,
          <addr-line>Munich</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>-The first workshop specifically devoted to tools supporting Model Driven Engineering was held September 19, 2017 in Austin, Texas, USA. The motivation, scope, objectives, and results of the workshop are summarized. Index Terms-Model-driven Engineering, tools, software and systems modeling III. PROGRAM</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. MOTIVATION</title>
      <p>
        The easy availability of high-quality tools with effective
supporting materials and documentation significantly increases
the chances of adoption for any new software development
approach. Several research communities have recognized the
importance of tools and, e.g., created workshops specifically
designed to facilitate the evaluation and comparison of tools
(for, e.g., language workbenches [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], transformations [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ],
satisfiability solving [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], and verification [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]).
      </p>
      <p>
        In contrast, the modeling research community does not
appear to be paying as much attention to effectively leveraging
tools for illustrating, evaluating, and disseminating research
results, and for making a convincing case for more
widespread adoption of modeling and MDE. More specifically,
1) there is evidence suggesting that the quality of
documentation of many MDE tools is too low [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],
2) while efforts have been made to compare modeling
approaches (in, e.g., the Comparing Modeling Approaches
Workshop [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]), there is insufficient support for evaluating and
comparing MDE tools, their suitability for specific tasks, and
opportunities for interoperation and reuse, and
3) few repeatable tool evaluations and comparisons exist that
use appropriate, publicly accessible use cases and that have
been carried out by independent third parties.
      </p>
    </sec>
    <sec id="sec-2">
      <title>II. CHALLENGE PROBLEMS AND VIDEO TUTORIALS</title>
      <p>To facilitate the comparison of tools, two challenge
problems were defined by the organizers, called ‘Rover’ and ‘The
Intelligent House’. Descriptions were made available online1.
1http://mase.cs.queensu.ca/mdetools</p>
      <p>A total of eight submissions were received. Five of these
were accepted. The program consisted of a keynote, paper
presentations, a demo session, and a discussion session.</p>
      <p>
        The keynote ‘MDE Tools in Industry and Education:
Understanding, Comparing and Improving the Tools’ was given by
Cortland Starrett, currently president of One Fact Inc, a
company developing open source modeling tools (BridgePoint)
as well as modeling client applications. In his presentation,
Cortland drew on his experience in both industry and education
and discussed some of the challenges of comparing tools, but
also showed several inspiring examples involving modeling
and design challenges such as ET-Robocon, a UML robot
contest that has been held annually since 2002 and whose
attendance has grown from 20 (2002) to 1800 (2013) with
over 360 teams from industry, academia, and education [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>Two of the accepted papers used the ‘Rover’ challenge
problem as example: the paper “Engineering a Rover
Language in GEMOC Studio &amp; MontiCore” by Thomas Degueule,
Tanja Mayerhofer and Andreas Wortmann compared language
design using a ‘modelware’ tool (GEMOC) and a
‘grammarware’ tool (MontiCore). The paper “A Scenario-based MDE
process for Developing Reactive Systems: A Cleaning Robot
Example” by Joel Greenyer, Daniel Gritzner, Jianwei Shi and
Eric Wete illustrated the use and utility of scenario-based
modeling.</p>
      <p>Another pair of papers was devoted to identifying promising
new research problems. The paper “Modelling as a Service:
A Survey of Existing Tools” by Saheed Popoola, Jeffrey
Carver and Jeff Gray presented a first classification of
webbased modeling tools and the paper “Challenges and Research
Directions for Successfully Applying MDE Tools in Practice”
by Francis Bordeleau, Grischa Liebel, Alexander Raschke,
Gerald Stieglbauer and Matthias Tichy focussed on how best
to integrate MDE tools into industrial practice.</p>
      <p>Also, two papers from the Workshop on Human Factors
in Modeling were presented: “Investigating the Effects of
Integrating Handcrafted Code in Model-Driven Engineering”
by Tim Bolender, Bernhard Rumpe and Andreas Wortmann,
and “Visual Variables in UML: a First Empirical Assessment”
by Yosser El Ahmar, Xavier Le Pallec and Se´bastien Ge´rard.
Both of these papers emphasized the need for more empirical
studies, albeit on different topics.</p>
      <p>Finally, demos of a tool for scenario modeling
(ScenarioTools) and an Eclipse plugin for collaborative modeling using
the ReMoDD model repository were given.</p>
    </sec>
    <sec id="sec-3">
      <title>IV. DISCUSSION AND RESULTS</title>
      <p>Overall, the different parts of the workshop were attended
by about 30 people, Most had academic affiliations, but some
representatives from industry were present as well. Discussion
was lively, continued past the scheduled end of the workshop,
and focussed mostly on the following topics:</p>
      <p>
        1) Challenge problems: Two challenge problems had been
defined by the workshop organizers to facilitate comparison
of tools. The problems were phrased in very general terms
to allow for the participation of a broad set of MDE tools
that leverage models for different purposes. The keynote had
encouraged the use of challenges and contests and shown
several successful examples. In the 1995, the ‘Production Cell’
problem had allowed the comparison of different formal
methods [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. On the other hand, the effort required to define suitable
problems was acknowledged. Overall, the use of challenge
problems was considered worthwhile and the formulation of,
e.g., a ‘rover contest’, in which MDE tools are to be used to
develop software for a rover to accomplish some task, was
suggested for next year.
      </p>
      <p>
        2) Systems engineering and integration: The industry
participants noted that modeling is extensively used in systems
engineering, where it supports the development of the entire
product and not just its software. Due to the many different
kinds of models and tools used, integration of the relevant
information contained in different models constitutes a major
challenge. It was noted that the ‘Open Services for Lifecycle
Collaboration (OSLC)’ effort aims at facilitating this kind
of large-scale, product-wide integration and helping
organizations transition from ‘document-centric’ to ‘model-centric’
production processes that are organized around linked data
and model repositories [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Despite OSLC’s use of open
standards and technology such as the Resource Description
Framework (RDF), linked data, representational state transfer
(REST), and HTTP and open source tools such as Eclipse
Lyo and OSLC4Net, there appears to be little interest and use
in academic research and teaching. As an interesting aside,
efforts to address interoperability challenges using modeling
were made in, e.g., [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>
        3) Digital twin and digital thread: The concepts of ‘Digital
Twin’ and ‘Digital Thread’ were first introduced by the
military aircraft industry, but are gaining interest in other domains
such as digital and smart manufacturing and ‘Industrie 4.0’. In
short, the digital twin refers to a digital model of a product that
allows, e.g., effective assessment of the product’s current and
future performance and expected lifetime (e.g., preventative
maintenance) as well as optimization and improvements in
product design and operating conditions. The digital twin is
thus relevant not only for defect prediction and avoidance, but
also to systems engineering and lifecycle management. The
digital thread, however, refers to the ability to integrate
relevant information from different, traditionally disjoint sources
to allow for the “right information to be available in the right
place at the right time” [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Realization and use of both
concepts could benefit from the expertise in the modeling
community on, e.g., domain-specific modeling; monitoring,
animation, simulation; ‘models at runtime’; and support for
different views. However, they also require solutions to the
model integration problem already mentioned above.
      </p>
      <p>4) Human factors: The presentations on human factors
were very well received and triggered comments about the
need to improve the usability of MDE tools and the current
scarcity of empirical studies investigating usability or the
impact of modeling.</p>
    </sec>
    <sec id="sec-4">
      <title>V. CONCLUSION</title>
      <p>The workshop provided a forum for the exchange of ideas
and identification of challenges and opportunities related to
the development and use of MDE tools. The use of challenge
problems was recommended, together with an increased focus
on systems engineering, interoperability and integration (e.g.,
in the context of OSLC and the digital twin and digital thread
concepts), usability and empirical studies.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Language</given-names>
            <surname>Workbench Challenge Workshop</surname>
          </string-name>
          .
          <source>SPLASH 2016. November 1</source>
          ,
          <year>2016</year>
          . http://2016.splashcon.org/track/lwc2016
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Transformation</given-names>
            <surname>Tool</surname>
          </string-name>
          <article-title>Contest</article-title>
          .
          <source>STAF 2017. July 21</source>
          ,
          <year>2017</year>
          . http://www.transformation-tool-contest.eu
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>SAT</given-names>
            <surname>Competition</surname>
          </string-name>
          .
          <source>19th International Conference on Theory and Applications of Satisfiability Testing. July</source>
          <year>2016</year>
          . http://www.satcompetition.org
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>VerifyThis</given-names>
            <surname>Verification</surname>
          </string-name>
          <article-title>Competition</article-title>
          .
          <source>ETAPS 2016. April 2</source>
          ,
          <year>2016</year>
          . http://etaps2016.verifythis.org
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>N.</given-names>
            <surname>Kahani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bagherzadeh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Dingel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.R.</given-names>
            <surname>Cordy</surname>
          </string-name>
          .
          <article-title>The problems with Eclipse modeling tools: a topic analysis of Eclipse forums</article-title>
          .
          <source>19th International Conference on Model Driven Engineering Languages and Systems (MODELS16)</source>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <source>[6] Workshop on Comparing Modeling Approaches. 16th International Conference on Model Driven Engineering Languages and Systems (MODELS13). October 1</source>
          ,
          <year>2013</year>
          . http://cserg0.site.uottawa.ca/cma2013models
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>T.</given-names>
            <surname>Futagami</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Shimizu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Hoshi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Tanahashi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Kobayashi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Watanabe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. Yukawa H.</given-names>
            <surname>Watanabe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Watanabe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Makino</surname>
          </string-name>
          . ET Robocon:
          <article-title>A Software Design Robot Contest for Educating Embedded Systems Engineers</article-title>
          .
          <source>TNI Journal of Engineering and Technology (2)</source>
          :
          <fpage>2</fpage>
          . July - December
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>C.</given-names>
            <surname>Lewerentz</surname>
          </string-name>
          , Th.
          <source>Lindner. Formal Development of Reactive Systems: Case Study Production Cell. LNCS 891</source>
          . Springer. 1995
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Open</given-names>
            <surname>Services for Lifecycle</surname>
          </string-name>
          <article-title>Collaboration (OSLC). Community web portal</article-title>
          . http://open-services.
          <source>net</source>
          .
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>J.</given-names>
            <surname>Bezivin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.M.</given-names>
            <surname>Soley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Vallecillo</surname>
          </string-name>
          .
          <source>Summary of First International Workshop on Model Driven Interoperability (MDI'10)</source>
          . Oslo, Norway.
          <source>October 5</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>P.</given-names>
            <surname>Grace</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Pickering</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Surridge</surname>
          </string-name>
          .
          <article-title>Model-driven interoperability: engineering heterogeneous IoT systems</article-title>
          .
          <source>Annals of Telecommunications</source>
          <volume>71</volume>
          (
          <issue>3-4</issue>
          ):
          <fpage>141</fpage>
          -
          <lpage>150</lpage>
          . Springer. April
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>C.</given-names>
            <surname>Leiva</surname>
          </string-name>
          .
          <article-title>Demystifying the Digital Thread and Digital Twin Concepts</article-title>
          .
          <source>Industry Week. August 1</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>