<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>September</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Managing the Complexity in Ethical, Social and Environmental Accounting: Engineering and Evaluating a Modelling Language</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Vijanti Ramautar</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sergio España</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Utrecht University</institution>
          ,
          <addr-line>Princetonplein 5, 3584 CC Utrecht</addr-line>
          ,
          <country country="NL">The Netherlands</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2022</year>
      </pub-date>
      <volume>2</volume>
      <fpage>0</fpage>
      <lpage>23</lpage>
      <abstract>
        <p>Assessing, reporting, and monitoring ethical, social and environmental is a key practice for sustainable business innovation. There are a plethora of methods that guide these assessments. Often these methods are supported by an ICT tool. In most cases, the tools are developed to support a single method only and do not allow any tailoring. Therefore, they are rigid and inflexible. To mitigate the risk of managerial problems, reporting fatigue, loss of confidence in sustainability practices, and to manage complexity in ESEA methods we ofer a new model-driven approach. We have developed an open-source, model-driven, versatile tool, called openESEA. OpenESEA parses and interprets textual models, that are specified according to a domain-specific language (DSL). This article reports on a new iteration of the creation process of our modelling language, describes the most important modelling primitives of the DSL, and reports on the validation of the DSL through user testing. Organisational sustainability, model-driven engineering, domain-specific language, modelling language complexity, ethical social and environmental accounting, sustainability reporting</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Stakeholders are increasingly interested in the ethical, social and environmental (ESE)
performance of organisations. For minority shareholders, perceptions of poor credibility and poor
corporate social responsibility performance even result in a higher tendency to read
sustainability reports [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Also, external stakeholders (clients, business partners, citizens) sometimes
put pressure on organisations to disclose their sustainability reports publicly. To increase
their ESE performance, organisations usually apply a continuous improvement cycle [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. This
article focuses on the second process of the continuous improvement cycle, the ethical, social
and environmental accounting (ESEA) process. During the ESEA, organisations assess their
performance in material ESE topics [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. To do this, first, an ESE accountant collects data
from organisational stakeholders via surveys or extracts it from information systems. Examples
of such data (i.e. direct indicators) are the monthly electricity consumption, or the number
of men, women, and non-binary people in managerial positions. This data allows calculating
indirect performance indicators such as the percentage of women (and non-binary people) in
managerial positions and annual electricity consumption. We refer to the set of indicator values
collected by conducting an ESEA process as ESE account. Parts of this account are typically
published in a sustainability (or non-financial, or integrated) report.
      </p>
      <p>
        Several factors make ESEA methods complex from the process and ICT perspectives. The
ESEA domain abounds with methods, standards and frameworks. Many ESEA methods are
supported by ICT tools. Most of these tools are rigid and can solely be used to assess the
single ESEA method they were developed for [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. However, ESEA methods usually overlap
in the indicators they require input for; e.g. many ESEA methods ask for the number of
employees per gender, the minimum salary, and annual water consumption. We found that
numerous organisations apply multiple ESEA methods, so given the rigidity of the tools, these
organisations end up having to use several disconnected tools that ask them for the same data.
Furthermore, organisations would often like to extend or tailor the methods to their needs but
tools do not allow it.
      </p>
      <p>To reduce the complexity of managing (i.e. defining and applying) ESEA methods we are
engineering the openESEA framework. It consists of a domain-specific language (DSL) that
allows modelling ESEA methods, and an interpreter tool that allows organisations to execute
the methods. At the core of the framework lies the openESEA metamodel, which serves as an
ontology that defines the main primitives of ESEA methods. The metamodel also constitutes the
abstract syntax of the openESEA DSL. The concrete syntax is specified with a textual grammar
that is used to model ESEA methods. We have operationalised the framework by means of an
open-source, web-based, model-driven tool called openESEA. It can be configured by loading
a textual model of an ESEA method; then the tool will automatically support the method
application. Our approach allows organisations to not only apply existing ESEA methods, but
also extend methods, combine them, or create new ones from scratch, using the DSL, without
having to worry about developing or updating the tool support.</p>
      <p>
        In earlier work, we presented a first version of our framework [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Since then, we have made
improvements to the DSL and the interpreter. Regarding the DSL, we have extended the initial
version with primitives to model surveys, and we have switched from an Extended Backus Naur
Forma (EBNF) grammar with no editing tool support to an implementation in Eclipse Xtext [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]
with its corresponding model editor. Regarding the interpreter 1, we have extended it to properly
parse the models created with the new grammar, and we have re-implemented it completely to
switch from a technology based on the React framework (interface and application tier) and
Firebase Firestore, Authentication and Hosting services (back end), to a technology based on
the Vue.js framework (interface tier), the Python-based Django framework (application layer),
and Heroku Authentication and Hosting services (back end). In both versions, users can load
ESEA method models that will be parsed with a JSON schema. However, the new version of the
openESEA interpreter presented in this paper also allows specifying such methods through its
interface. While in the following sections we touch upon all these improvements, the paper
places the focus on the engineering and evaluation of the modelling language for specifying
ESEA methods. We explain the DSL development process, the most important primitives of
the grammar, and we identify potential improvements of the grammar through a user test. The
1Older version: https://github.com/sergioespana/openESEA; newer: https://github.com/sergioespana/open-sea
contributions of the paper are (i) new, more mature versions of the DSL and (ii) the model
interpreter, which practitioners and researchers can use to assess organisational sustainability;
also, (iii) an evaluation of the DSL through user testing. The overall research objective is reduce
the complexity of using the openESEA DSL to model ESEA methods.
      </p>
      <p>Section 2 lists the research questions and describes the research method. Section 3 contains
conceptual background on ESEA. Section 4 explains how we decided on the extensions of
the modelling language. In Section 5 we present the modelling language for specifying ESEA
methods. Section 6 explains the user test protocol, its results, and potential improvements of
the grammar. The main findings, limitations and future work can be found in Section 7. At last,
this article concludes in Section 8.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Research method</title>
      <p>The two main research questions that are answered in this article are the following.
1. What modelling primitives are needed to specify ESEA methods that are intended to
assess organisational sustainability?
2. How can the complexity of modelling ESEA methods be assessed and, if possible, reduced?
The goal of the first question is to find a balance between the expressiveness and complexity
of the DSL. The motivation behind the second question is to define a protocol to evaluate the
complexity experienced by modellers and to identify potential improvements of the DSL.</p>
      <p>
        Since we aim to produce and evaluate the grammar for specifying ESEA models, produce
knowledge around that grammar (e.g. its strengths and limitations), and aim to understand the
complexity of creating ESEA models, we apply Design Science [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. With respect to the language
development, we follow conventional DSL engineering practices [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Fig. 1 shows the research
method. We use the metamodel, EBNF grammar, and model interpreter from [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] as input for
this research. We refer to these artefacts as metamodel V1, openESEA EBNF grammar V1, and
openESEA interpreter V1, respectively. By executing the research method we aim to create new,
more versatile versions of the metamodel and the grammar (i.e. V2).
      </p>
      <p>
        Problem investigation. While we use the issues for improvement defined in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] as a starting
point, we perform another iteration of the research method in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] to discover additional points
of improvement. That is, in activity A1 we analyse additional ESEA methods. We model these
ESEA methods using the Process Deliverable Diagram (PDD) notation [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. We validate the
PDDs with experts in the respective ESEA methods. After the validation interviews, we update
and improve the PDDs, if necessary. The validated PDDs are used to create activity and concept
comparisons, applying the method comparison approach [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Treatment design. Based on
the concept comparison (output of activity A1) and the openESEA metamodel V1, we derive
new (and update existing) ESEA method metaclasses (activity A2), resulting in metamodel V2.
Metamodel V2 is, like its predecessor, a UML Class Diagram[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] and it specifies the data structure
of an ESEA method and its applications. Metrology standards[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] also informed our design
decisions. In activity A3 we engineer a textual Xtext grammar [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] based on the metamodel.
While automatic transformation frameworks from (Ecore) metamodels to Xtext grammars exist,
we decided to implement the textual grammar manually to have more control over the result.
In this version of the DSL, we have opted for a textual grammar. For future versions we plan to
create a diagrammatic DSL and perform user tests to find out which option is more preferable.
Treatment validation. We run a user test (activity A4) to validate the grammar and to discover
potential redesigns that would improve the modelling experience. Section 6 explains the user
test design, which is based on the Method Evaluation Model (MEM)[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], and analyses the user
test results. After completing the user test, we redesign the grammar (activity A5).
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Background</title>
      <p>
        The conceptual development of ESEA is attributed to Gray [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Over time numerous ESEA
methods have been developed. These methods provide guidance and instructions on how to
perform ESEA. Often, the methods prescribe a set of ESE topics that should be disclosed and
define a procedure to successfully assess and report on these topics. Given that sustainability is
a multifaceted concept, it is not directly measurable and therefore requires a set of indicators
to measure performance [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Hence, ESEA methods usually refine topics further into a set
of organisational sustainability performance indicators. Examples of ESEA methods are the
Sustainability Tracking, Assessment &amp; Rating System (STARS)2, the B Impact Assessment3 used
by certified B Corporations, and the Common Good Balance Sheet prescribed by the Economy
for the Common Good4. Some ESEA methods, such as the Global Reporting Initiative Standards5
and Integrated Reporting framework6, lay focus on establishing sustainable reporting guidelines,
rather than formulating an approach for measuring and assessing ESE performance [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. There
are several reasons for performing ESEA. For instance, ESEA can be performed to address
concerns from the public [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] or to obtain a specific certification [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Additionally, ESEA
can improve business performance. There has been empirical evidence that shows that ESEA
method certifications and CSR disclosures have a positive efect on organisations’ financial
performance [
        <xref ref-type="bibr" rid="ref19 ref20">19, 20</xref>
        ]. Küchler and Herzig found that ESEA methods that can be applied by
organisations in any industry sector, do not always cover the necessary industry-specific
indicators [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. This phenomenon is one of the drivers for organisations to apply multiple ESEA
methods (industry-specific and non-industry-specific), justifying the need for versatile ICT
infrastructure.
      </p>
      <p>
        There are prior works that have focused on managing the complexity of models and modelling
languages. For instance, [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] defines a modularisation approach for large models. however, this
paper focuses on evaluating and improving the user performance while understanding, updating
2https://stars.aashe.org/about-stars/
3https://bimpactassessment.net
4https://www.ecogood.org/apply-ecg/common-good-matrix/
5https://www.globalreporting.org/standards/
6https://www.integratedreporting.org/resource/international-ir-framework/
or creating ESEA method models, in the line of earlier work such as [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] and [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. Numerous
evaluation protocols for modelling languages have been reported in literature. Most of these
protocols are applied to diagrammatic modelling methods [
        <xref ref-type="bibr" rid="ref25 ref26">25, 26</xref>
        ]. Our evaluation protocol is
highly influenced by previously existing literature, nonetheless it introduces activities tailored
for evaluating an Xtext grammar.
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. ESEA method comparison</title>
      <p>
        To produce V1 of our DSL and tool, we analysed 13 ESEA methods. Now we have analysed six
additional ESEA methods to identify new requirements of the openESEA modelling language.
The new methods are the CDP company programs7, EFQM Model8, S-CORE9, SMETA10, STARS,
and WFTO Guarantee System11. The full list of analysed methods and their PDDs can be found
in the technical report [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. To extend the metamodel, we create a super-method that acts as
a generic method, based on previously- and newly-modelled PDDs. This article explains the
extension of the metamodel with additional metaclasses. Therefore, we focus on the results
of the concept comparison rather than the activity comparison. A concept is only included in
the super-method if it is present in more than one ESEA method. Table 1 shows a sample of
the concept comparison. If a super-concept is present in a method, we mark it with an equal
sign (=). If a super-concept is present in a method but it is referred to by another name we
mark the cell with the concept name that is used in the method documentation. If a concept
is not present in a method, the cell is left empty. If a concept is not explicitly mentioned in
the method, but by applying our knowledge of ESEA methods and method engineering we
can deduce that such a concept must be present, we put a hyphen (-) in the cell. Based on the
method comparison we added nine more concepts to the metamodel. Concepts that were only
present in one method were omitted. Moreover, we only focused on the accounting phase (i.e.
assessing and reporting) even though many ESEA methods define an auditing protocol as well.
We plan to include audit-related classes in a next version of the metamodel. To do this we will
extend the method comparison. In Section 5.1 we report on the metaclasses that we added based
on the concept comparison.
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Modelling language for specifying ESEA methods</title>
      <p>
        The openESEA modelling language consists of two artefacts: the metamodel and the DSL. The
metamodel depicts the classes that are necessary to support the application of ESEA methods.
A number of these metaclasses is used as the basis for engineering a textual grammar. Find a
full explanation of all metaclasses, their attributes, and relationships in a technical report [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ].
      </p>
      <sec id="sec-5-1">
        <title>5.1. Metamodel of ESEA methods</title>
        <p>questions are asked, during execution time, to the people involved in the ESEA data collection
(e.g. the ESE accountant or sustainability oficer, staf members); however, they are specified
during the method engineering. Examples of classes that are instantiated when applying or
executing the method are Organisation (which represent entities that apply the method), and
Question response (which stores the responses of questions for one specific application of an
ESEA method, by a given organisation, in a given year). The grey metaclasses provide a proper
abstract syntax for the grammar.</p>
      </sec>
      <sec id="sec-5-2">
        <title>5.2. Textual grammar for creating ESEA models</title>
        <p>We have implemented the DSL as a textual grammar that allows method engineers to create
textual models of ESEA methods. The resulting textual models can then be parsed and interpreted
by openESEA, and the tool reacts by ofering the proper interfaces and features to support
the modelled method. For every grey metaclass in the metamodel, we define a grammar
primitive. While there is a multitude of ways of designing grammar rules that operationalise
the metaclasses, we have opted for an approach that ensures human readability. For instance,
every attribute is written on a new line and we try to choose commonly used, intuitive names
for concepts (e.g. for UI components we used common names such as radio button, check box,
listTopics+=ListTopics
listIndicators+=ListIndicators
listSurveys+=ListSurveys
listCertificationLevels+=ListCertificationLevels
;</p>
        <p>Model fragment
Name: "B Impact Assessment"
Version: 6.0
isPublic: True
Description:"First step
Certification"
...</p>
        <p>towards</p>
        <p>B</p>
        <p>
          Corp
text field, etc.). An example of a grammar primitive can be found in the left column of Table 2.
Here the metaclass ESEA method is supported by an Xtext grammar rule. The rule states that
the method engineer should specify the name of the method, version, description, and whether
the method is publicly available for any organisation to access and apply it. The lists refer to
lists of topics, indicators, surveys and certification levels. Each list contains a set of items. For
instance, the topics list contains a set of ESE topics as specified in the ESEA method. In the
case of the B Impact Assessment the topic names are “Governance”, “Community”, “Workers”,
“Environment”, and “Customers”. The topics are then further specified in indicators. An example
of a model fragment according to this grammar rule is depicted in the right column in Table 2.
For the sake of brevity, we omitted the model fragments that correspond to the lists. For the
full Xtext grammar, see the technical report[
          <xref ref-type="bibr" rid="ref28">28</xref>
          ] or find it on Github 12.
        </p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>6. Validation of the ESEA grammar</title>
      <sec id="sec-6-1">
        <title>6.1. User test design</title>
        <p>
          To assess the grammar’s performance, we run a user test, supported by an e-assessment tool.
Fig. 3 shows the test procedure and variables. We use the reporting guidelines from [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ]. The
object of study is the grammar. We leave the Xtext editor out of the scope, since it might
interfere with the results. The main objective, assessing the grammar, is refined into two
sub-objectives: (i) determine to what extent users are able to successfully create ESEA method
models, using the DSL, (ii) discover potential improvements of the grammar by performing
qualitative analyses on the user test results. The test participants are 75 Information Science
bachelor students from Utrecht University, with little to no professional experience, little
programming knowledge, and no knowledge of model-driven architectures, textual grammars,
and ESEA prior to the user test. The expected future users of the grammar are ESEA method
engineers, having similar experience with ICT, but greater knowledge of ESEA.
        </p>
        <p>The test structure is as follows. There are three types of tasks: comprehension, modification,
and creation. For each task, we have formulated questions, each consisting of a number of steps.
The comprehension questions are the easiest, the modification questions ask the participants
to make a change in a given model, and the creation questions are the most challenging; they
require the participants to create a model from scratch, based on a textual description of an
ESEA method or a screenshot of a real ESEA tool. For comprehension questions, a step typically
refers to answering a multiple-choice question. For modification questions, a step refers to
making an alteration in a model or filling in a text field. For creation questions, a step refers
to writing a line of a model fragment. For instance, the model in Table 2 consists of four lines,
thus a question that asks to create such a model has four steps.</p>
        <p>
          The variables we measure based on the MEM [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] are the efectiveness of using the DSL
grammar, the eficiency in the proposed tasks, and the participant perceptions. These variables
refer to the environment and structure system dimensions according to the hierarchy of criteria
for information system artifact evaluation [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ]. For each of these constructs, we define response
variables [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]. Efectiveness refers to how well the DSL achieves its objectives. While assessing
the test responses, we produce the values of the correct steps variable. With these values, we
can calculate the following variables: average degree of correctness (see formula 1) measures to
what extent the participant correctly conducted the steps of the modelling tasks in the user
task, success indicates that the participant did not make any mistakes and thus answered the
entire question correctly, and success ratio (formula 2) reflects the normalised percentage of
successful responses.
        </p>
        <p>=
Eficiency refers to the efort required to apply the DSL. For each question, the e-assessment
tool automatically measures the time that the participant spent on it. As a better variable for
eficiency, we define time per correct step (formula 3).
(1)
(2)
∑︀|=1|
∑︀|=1|</p>
        <p>||
||
(3)
The formulas are aggregating the results per task (comprehension, modification or creation),
where || represents the total number of questions per task. When aggregating the
average degree of correctness and success ratio per grammar primitive, || should
be changed to || which represents the total number of questions related to each
grammar primitive (per task). Similarly, responses represents the set of responses. To assess
participant perceptions, the MEM ofers an adaptable questionnaire that allows measuring
the perceived usefulness, the perceived ease of use, and the intention to use the DSL in the future,
if confronted with similar tasks during their profession.</p>
        <p>In accordance with the test procedure shown in Fig. 3, the participants receive a
ninetyminute training (B1) where we introduce them to ESEA methods. We also train them in the DSL
grammar. After the training, the participants perform a knowledge test (B2). The knowledge
test also consists of three types of questions (comprehension, modification, and creation). The
purpose of the knowledge test is to have the participants apply their newly acquired knowledge
and receive feedback on their performance. This resembles the training that the future users of
the grammar (i.e. ESEA method engineers) will receive. After the participants have finished
the knowledge test, they attend an explanation session (B3), where we discuss the answers to
the knowledge test. Hereafter, the participants start the user task; i.e. a test where we actually
measure their efectiveness and eficiency. They answer comprehension (B4), modification (B5)
and creation questions (B6), in that order. The questions are similar to the ones in the knowledge
test, but the overall test is longer and more challenging. After the test, the participants are
asked to fill in the MEM questionnaire (B7).</p>
      </sec>
      <sec id="sec-6-2">
        <title>6.2. User test results</title>
        <p>Table 3 shows the average degree of correctness and the success ratio for each grammar primitive
per task, as well as the time spent per correct step, the average degree of correctness, and the
success ratio aggregated per task. The average degree of correctness per task is quite high,
ranging from 86% to 89%. The success ratios range from 72% for the creation task to 83% for
the modification task. Overall, a positive sign, indicating that many participants were able to
execute questions flawlessly. When evaluating the participant’s answers we have chosen to
be very strict since, strictly speaking, every deviation from the grammar rules is a syntactic
error. In practice, most syntactic mistakes will be prevented by the usage of the editor, since the
editor ensures that the models comply with the syntax.</p>
        <p>To put eficiency results in the context of industrial practice, we have estimated the size of a
real ESEA method and the total time it would take to author its model using the grammar. We
have taken the basic variant of the XES Social Balance as a reference, since we have full access
to its internal documentation. That method has five topics, 203 indicators, one survey, five
survey sections, 86 questions, and five text fragments. The language primitive Topic requires
three lines, so modelling all five topics of the XES Social Balance implies writing 15 lines. An
Indirect indicator has eight lines, Direct indicator has seven lines, Answer option has three lines,
Survey has eight lines, Survey section has four lines, Question has eight lines, and Text fragment
has three lines. As a result, the total size of the model would be 2,916 lines. Given that our
participants spent 50 seconds per correct line, creating a fully correct method model without
the editor would take them 50 * 2, 916 = 145, 800 seconds (40 hours and 30 minutes). Most
probably, this is an overestimation. We suspect that users of the grammar will become more
eficient while producing the model because there are many repetitive actions. For instance,
we expect that the ESEA method engineers will spend more time on the first few indicators
and become quicker as they progress. They can also copy, paste, and tweak method fragments.
Furthermore, in a real-life setting, grammar users will use the editor, which should further
improve their eficiency. On the other hand, the real source of complexity in ESEA method
engineering is the participatory design of the method, especially in the case of bottom-up,
democratic design processes, as is the case of the XES Social Balance. But this falls out of the
scope of the DSL.</p>
        <p>The results per grammar primitive help us pinpoint where we can improve the grammar and
the training. The grammar primitive Answer option in the creation task has the lowest values
for the efectiveness variables. The reason for this is that most participants forgot to define
the answer options altogether. Perhaps users find it counter-intuitive to define the answer
options when modelling a direct indicator (see metamodel, Figure 2). A more intuitive approach
could be to define the answer options when modelling its corresponding question. However,
a more probable reason for participants forgetting to define the answer options is that users
have to select the correct data type for the answer option rule to be triggered. Upon further
inspection, we found that in many cases the selected data type was incorrect, making the
forgotten answer options an unpreventable follow-up error. The autocompletion feature of
the editor will show users exactly which grammar rules are triggered. This will, for instance,
prevent the users from forgetting to define answer options. The Indicator primitive scores
fairly well in the comprehension and modification task. In the creation task, on the other hand,
Indicator has the lowest success ratio. Most syntactic mistakes in the creation questions related
to Indicator were non-critical (e.g. capitalisation mistakes). Most semantic mistakes were made
in the data type. This compromises the utility of the indicator for measuring the intended
organisational sustainability performance. In the indicator creation task 65% of the subjects
chose the wrong data type. We suspect this is caused by a lack of experience with ESEA and
insuficient knowledge about ESEA methods. This can probably be solved by providing a longer,
more detailed training session. The success ratio of the Question primitive in the creation task
is rather low, but most mistakes are non-critical. However, one frequently appearing serious
mistake is made in the order attribute of Question. The order in which questions should be
displayed in a survey is indicated with a numeric value in the attribute order. The question with
the lowest order value is displayed first, followed by the question with the consecutive numeric
value, and so on. Overlapping order numbers are not allowed, since multiple questions cannot
be in the same place in the survey. Nonetheless, users frequently gave questions the same order
number. To tackle this problem, we should add a constraint to the grammar by extending the
validator [33]. The grammar primitives that have proven to cause confusion will be reassessed
and possibly updated in next versions of the modelling language.</p>
        <p>The results of the perceptions and intentions questionnaire yield Fig. 4. It shows whether
participants found the grammar easy to use and useful. Additionally, it gives some indication
of their intention to use the grammar in combination with a model-driven interpreter, if they
become a sustainability oficer after their studies. The majority of the participants have indicated
that they found it easy to make small changes in the models, understand the models, and create
models. Just 24% of the participants found that creating ESEA models required a lot of mental
efort. For perceived usefulness, 67% of the participants felt like using the grammar would
save them time when engineering ESEA methods and 48% said that using the grammar would
increase their productivity. The majority of the participants have indicated that they are willing
to use openESEA in combination with the grammar if they ever become an ESE accountant.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>7. Discussion</title>
      <p>The modelling language allows us to specify any ESEA methods and combinations of ESEA
methods. The benefit of this is that organisations can create a model combining all the methods
that they wish to apply (e.g. B Impact Assessment, Common Good Balance Sheet, and GRI
Standards). By uploading the textual model (which contains three methods) in openESEA,
the tool parses and interprets the model. It displays all surveys, topics, indicators and other
necessary elements to execute the three methods specified in the textual model. This way
organisations will no longer have to use multiple tools to support their ESEA.</p>
      <p>To increase the expressiveness of the DSL we added new concepts to the metamodel. This,
of course, increases the complexity of the DSL. However, by means of a user test, we found
that users can manage this complexity, since they can create models successfully. The user
test allowed us to identify four major points of improvement. At least one of these points can
be resolved by introducing the editor. Two points can be addressed with additional training
and one point requires an extension of the Xtext validator. We consider the user test overall a
success and deem that, overall, users can efectively create ESEA models. The success rate and
degree of correctness are high and the observed mistakes are mostly non-critical.</p>
      <p>
        The only model-driven approach for ESEA we found is our own earlier work [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The
modelling language presented herein builds upon the artefacts from that article, therewith all
extensions of these artefacts are new contributions to the model-driven ESEA approach. For
testing an Xtext DSL we only found one article that also performed a user test. Jonathan et al.,
developed a DSL and syntax checker in Xtext for producing mapping configuration files for
ASML’s Twinscan machine. To test the artefacts, a component test, code review, and user test
were performed [34]. Similar to our user test, test subjects were asked to create configuration
ifles. The number of scientific works that describe how to test Xtext DSLs is limited. The test
procedure in this article can contribute to an approach for testing Xtext DSLs.
      </p>
      <p>
        A limitation is that the group of students is not a representative group to measure the intention
to use, since they do not (yet) work in the domain of ESEA. Consequently, they might not be
able to imagine whether they would use such a tool. Anyhow, in earlier (and ongoing) expert
assessment interviews, ESEA experts show appreciation and interest in our approach [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Future work includes testing how the Xtext model editor influences the grammar usage and
whether the proposed improvements result in a more successful application of the grammar.
Also, we plan an experiment to evaluate the learning curve of grammar users. We opted not
to do this for the current version of the grammar, since we still have a planned roadmap with
substantial updates. Additionally, we could extend the Xtext validator to implement constraints
and provide domain-specific errors [ 33]. In terms of new versions of the modelling language
for specifying ESEA methods, we plan to extend the language so that ESE accounts can be
audited. Auditing and assurance of sustainability reports are critical for building trust in their
content. On top of that, we envision that openESEA will, in the future, support other impact
measurement families, such as social impact assessment and life-cycle assessment. Finally, we
have so far opted for engineering a textual grammar to support the DSL. We actually envision a
combination of textual and graphical modelling of ESEA methods, since a graphical specification
of the process dimension of methods may be more intuitive and we already have experience in
modelling ESEA methods with PDDs.</p>
    </sec>
    <sec id="sec-8">
      <title>8. Conclusion</title>
      <p>
        We consider that business informatics will play a role in making organisations more sustainable
and managing the complexity that these practices entail. In this paper, we contribute an updated
modelling language for ethical, social and environmental accounting methods. The modelling
language is interpreted by an open-source, model-driven tool for producing ESE assessments
and reports. The modelling language consists of a metamodel and a textual grammar. To
design the grammar we have used improvement points from [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], and analysed additional ESEA
methods. We have tested our approach with a user test. The results are promising and lay the
basis for further development. We intend that the textual grammar can be used to express any
ESEA method, although this remains to be proven. The ESEA models can then be uploaded to
openESEA, which will be capable of supporting the method applications. Therewith, we expect
to simplify the ESEA ICT tool support and hopefully lower the barrier for performing ESEA.
With this change in the tool support landscape, we encourage organisations to start measuring,
reporting and monitoring ESE performance and impacts, so they discover how they can start
building sustainable communities and formulate their sustainability strategy.
[33] L. Bettini, Implementing domain-specific languages with Xtext and Xtend, Packt, 2016.
[34] B. Jonathan, R. Avetyan, S. Abeln, Create Domain-Specific Language and Syntax Checker
Using Xtext, Int. j. eng. res. ind. appl. 4 (2020) 26–32.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>V.</given-names>
            <surname>Smith</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Dumay</surname>
          </string-name>
          ,
          <article-title>Shareholder use of CSR reports: an accountability perspective</article-title>
          ,
          <source>Meditari Accountancy Research</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S.</given-names>
            <surname>España</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Ramautar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q. T.</given-names>
            <surname>Le</surname>
          </string-name>
          ,
          <article-title>Assessing the ethical, social and environmental performance of conferences, in: RCIS proc</article-title>
          ., Springer,
          <year>2022</year>
          , pp.
          <fpage>752</fpage>
          -
          <lpage>760</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R.</given-names>
            <surname>Gray</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. A.</given-names>
            <surname>Adams</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Owen</surname>
          </string-name>
          , Accountability, social responsibility and sustainability, Pearson,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>C. A.</given-names>
            <surname>Adams</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Larrinaga-González</surname>
          </string-name>
          ,
          <article-title>Engaging with organisations in pursuit of improved sustainability accounting and performance, Account</article-title>
          . Audit. Account. J. (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>España</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Bik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Overbeek</surname>
          </string-name>
          ,
          <article-title>Model-driven engineering support for social and environmental accounting</article-title>
          , in: RCIS, IEEE,
          <year>2019</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>H.</given-names>
            <surname>Behrens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Clay</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Eftinge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Eysholdt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Friese</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Köhlein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wannheden</surname>
          </string-name>
          , S. Zarnekow, contributors, Xtext user guide,
          <source>Eclipse Fundation</source>
          (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>R. J.</given-names>
            <surname>Wieringa</surname>
          </string-name>
          ,
          <article-title>Design science methodology for information systems</article-title>
          and software engineering, Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M.</given-names>
            <surname>Mernik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Heering</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Sloane</surname>
          </string-name>
          ,
          <article-title>When and how to develop domain-specific languages</article-title>
          ,
          <source>ACM Comput Surv</source>
          <volume>37</volume>
          (
          <year>2005</year>
          )
          <fpage>316</fpage>
          -
          <lpage>344</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>I. van</surname>
          </string-name>
          de Weerd, S. Brinkkemper,
          <article-title>Meta-modeling for situational analysis and design methods, in: Handbook of research on modern systems analysis and design technologies and applications</article-title>
          ,
          <source>IGI Global</source>
          ,
          <year>2009</year>
          , pp.
          <fpage>35</fpage>
          -
          <lpage>54</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>I. van de Weerd</surname>
          </string-name>
          , S. de Weerd, S. Brinkkemper,
          <article-title>Developing a reference method for game production by method comparison</article-title>
          ,
          <source>in: Working Conf. on Method Engineering</source>
          , Springer,
          <year>2007</year>
          , pp.
          <fpage>313</fpage>
          -
          <lpage>327</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>OMG</surname>
          </string-name>
          ,
          <string-name>
            <surname>Unified Modeling</surname>
          </string-name>
          <article-title>Language (OMG UML)</article-title>
          ,
          <source>Version 2.5.1</source>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12] ISO/IEC, International vocabulary of metrology - Basic and
          <article-title>general concepts and associated terms (VIM), Standard</article-title>
          , ISO/IEC Guide 99:
          <year>2007</year>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>D</surname>
          </string-name>
          . L. Moody,
          <article-title>The Method Evaluation Model: A Theoretical Model for Validating Information Systems Design Methods</article-title>
          ,
          <source>in: ECIS Proc.</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>R.</given-names>
            <surname>Gray</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bebbington</surname>
          </string-name>
          ,
          <article-title>Accounting for the environment</article-title>
          ,
          <source>Sage</source>
          (
          <year>1993</year>
          )
          <fpage>13</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>G.</given-names>
            <surname>Lamberton</surname>
          </string-name>
          ,
          <article-title>Sustainability accounting-a brief history and conceptual framework, in: Accounting forum</article-title>
          , volume
          <volume>29</volume>
          ,
          <string-name>
            <surname>Elsevier</surname>
          </string-name>
          ,
          <year>2005</year>
          , pp.
          <fpage>7</fpage>
          -
          <lpage>26</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Sisaye</surname>
          </string-name>
          ,
          <article-title>The influence of non-governmental organizations (ngos) on the development of voluntary sustainability accounting reporting rules</article-title>
          ,
          <source>JBSED</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>S. S.</given-names>
            <surname>Gao</surname>
          </string-name>
          ,
          <string-name>
            <surname>J. J. Zhang,</surname>
          </string-name>
          <article-title>Stakeholder engagement, social auditing and corporate sustainability</article-title>
          ,
          <source>BPMJ</source>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>P.</given-names>
            <surname>Castka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Balzarova</surname>
          </string-name>
          ,
          <article-title>A critical look on quality through CSR lenses: Key challenges stemming from the development of ISO 26000</article-title>
          ,
          <string-name>
            <surname>IJQRM</surname>
          </string-name>
          (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>V.</given-names>
            <surname>Paelman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Van Cauwenberge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. Vander</given-names>
            <surname>Bauwhede</surname>
          </string-name>
          ,
          <article-title>Efect of B Corp certification on short-term growth: European evidence</article-title>
          ,
          <source>Sustainability</source>
          <volume>12</volume>
          (
          <year>2020</year>
          )
          <fpage>8459</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Chakraborty</surname>
          </string-name>
          ,
          <article-title>Does CSR disclosure influence financial performance of firms? Evidence from an emerging economy</article-title>
          ,
          <source>SAMPJ</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>R.</given-names>
            <surname>Küchler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Herzig</surname>
          </string-name>
          ,
          <article-title>Connectivity is key: holistic sustainability assessment and reporting from the perspective of food manufacturers</article-title>
          ,
          <source>British Food Journal</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>G.</given-names>
            <surname>Figueiredo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Duchardt</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Hedblom</surname>
          </string-name>
          , G. Guizzardi,
          <article-title>Breaking into pieces: An ontological approach to conceptual model complexity management</article-title>
          ,
          <source>in: RCIS</source>
          ,
          <year>2018</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>D</surname>
          </string-name>
          . L. Moody,
          <article-title>Complexity efects on end user understanding of data models: An experimental comparison of large data model representation methods</article-title>
          ,
          <source>ECIS</source>
          (
          <year>2002</year>
          )
          <fpage>10</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Manso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Genero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Piattini</surname>
          </string-name>
          ,
          <article-title>No-redundant metrics for UML class diagram structural complexity</article-title>
          ,
          <source>in: CaiSE</source>
          , Springer,
          <year>2003</year>
          , pp.
          <fpage>127</fpage>
          -
          <lpage>142</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>R.</given-names>
            <surname>Petrusel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Mendling</surname>
          </string-name>
          ,
          <article-title>Eye-tracking the factors of process model comprehension tasks</article-title>
          , in: CaiSE, Springer,
          <year>2013</year>
          , pp.
          <fpage>224</fpage>
          -
          <lpage>239</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Buchmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Karagiannis</surname>
          </string-name>
          ,
          <article-title>Modelling mobile app requirements for semantic traceability</article-title>
          ,
          <source>Requir. Eng</source>
          .
          <volume>22</volume>
          (
          <year>2017</year>
          )
          <fpage>41</fpage>
          -
          <lpage>75</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>V.</given-names>
            <surname>Ramautar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>España</surname>
          </string-name>
          ,
          <source>Domain Analysis of Ethical, Social and Environmental Accounting Methods</source>
          ,
          <source>Technical Report</source>
          , Utrecht University,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>V.</given-names>
            <surname>Ramautar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>España</surname>
          </string-name>
          ,
          <article-title>The openESEA Modelling Language for Ethical, Social and Environmental</article-title>
          ,
          <source>Technical Report</source>
          , Utrecht University,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>S.</given-names>
            <surname>Brinkkemper</surname>
          </string-name>
          ,
          <article-title>Method engineering: engineering of information systems development methods and tools</article-title>
          ,
          <source>Inf Softw Technol</source>
          <volume>38</volume>
          (
          <year>1996</year>
          )
          <fpage>275</fpage>
          -
          <lpage>280</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>C.</given-names>
            <surname>Wohlin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Runeson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Höst</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. C.</given-names>
            <surname>Ohlsson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Regnell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Wesslén</surname>
          </string-name>
          , Experimentation in software engineering,
          <source>Science</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>N.</given-names>
            <surname>Prat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            <surname>Comyn-Wattiau</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Akoka</surname>
          </string-name>
          ,
          <article-title>Artifact evaluation in information systems designscience research-a holistic view</article-title>
          ,
          <source>in: PACIS proc. 23</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>N.</given-names>
            <surname>Juristo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Moreno</surname>
          </string-name>
          , Basics of software engineering experimentation, Springer,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>