<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Instructional Experiences with Modeling and Analysis using the i* Framework</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Zia Babar</string-name>
          <email>zia.babar@mail.utoronto.ca</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Soroosh Nalchigar</string-name>
          <email>soroosh@cs.toronto.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lysanne Lessard</string-name>
          <email>lessard@telfer.uottawa.ca</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jennifer Horkoff</string-name>
          <email>horkoff@city.ac.uk</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Eric Yu</string-name>
          <email>eric.yu@utoronto.ca</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, University of Toronto</institution>
          ,
          <addr-line>Toronto</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Human Computer Interaction, City University London</institution>
          ,
          <addr-line>London</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Faculty of Information, University of Toronto</institution>
          ,
          <addr-line>Toronto</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Telfer School of Management, University of Ottawa</institution>
          ,
          <addr-line>Ottawa</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2015</year>
      </pub-date>
      <fpage>31</fpage>
      <lpage>36</lpage>
      <abstract>
        <p>First year professional Master's students at the Faculty of Information, University of Toronto are taught how to analyze problem domains using i* modeling in the final segment of the introductory course on “Systems Analysis and Process Innovation”. Over the past several years, the course instructors and teaching assistants have had the opportunity to observe and interact with the course students on the learning and use of the i* framework for modeling and analysis which makes it possible to make general observations regarding student experiences with the i* framework in an instructional setting. These observations are broad ranging and cover areas such as pedagogical design, conceptual understanding and proficiency with the i* framework, domain modeling and analysis, and tools for i* modeling.</p>
      </abstract>
      <kwd-group>
        <kwd>experience report</kwd>
        <kwd>i* framework</kwd>
        <kwd>agent-oriented modeling</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        i* modeling [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] has been taught at a number of universities around the world for more
than a decade. This workshop offers the first opportunity for i* educators to share
experiences and to collectively advance pedagogical knowledge and practice. The
“Systems Analysis and Process Innovation” course [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] at the Faculty of Information,
University of Toronto includes i* modeling in a segment that introduces the strategic
actors perspective as complementary to well-established methods of information
systems analysis. In this paper we aim to stimulate discussion and help generate ideas
that would improve i* pedagogy for future offerings of this course as well as for the
i* teaching community at large. In an earlier work [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] a qualitative analysis was done
by surveying 15 student assignments and 15 academic papers; the discussion points in
this paper supplement this previous work. However, the observations in this paper are
not the result of a systematic study of student assignments but rather are based on our
teaching experiences and recollections as instructors and teaching assistants in this
course.
      </p>
    </sec>
    <sec id="sec-2">
      <title>Contextual Factors</title>
      <p>Since teaching and learning experiences can vary widely according to contextual
factors, we outline the educational setting of the course and the role of i* modeling
within the course.</p>
      <p>This course is taken primarily by first year professional Master’s students at the
Faculty of Information. Students come from a diversity of academic backgrounds,
ranging from humanities to social science, to business, and to health sciences. A small
number have prior degrees in computing or information systems. Thus for many
students, the course is their first exposure to systems analysis and modeling, while at the
same time they are learning basic concepts of information technology and computer
programming in concurrent courses. Upon graduation, the most common job role for
past students of this course is “business analyst”.</p>
      <p>The aim of the course is to introduce students to the methods, techniques, and
practices of systems analysis, emphasizing the need to characterize as-is and to-be
configurations of systems in organizational context at the conceptual level of “requirements”
rather than at the level of implementation technology. The course also highlights the
varying degrees of change that can result from systems analysis, ranging from
“automation” that involves minimal reconfiguration of business processes, to
“transformation” that rearranges relationships among key stakeholders, as in business model
redesign.</p>
      <p>
        Modeling techniques are introduced as conceptual tools to aid the representational
and analytical activities of the analyst. The emphasis is not on the various languages
per se, but rather on the modeling paradigms that they represent – BPMN and DFD as
illustrating the process-oriented paradigm, ERD and class diagrams for the
dataoriented paradigm, UML for the object-oriented paradigm, and i* as representative of
a goal- and agent-oriented paradigm. The intentional strategic actors perspective of i*
is further contrasted with the value network perspective of VNA [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        An important objective is for students to acquire a critical reflective understanding
of a range of modeling paradigms and associated techniques, their capabilities and
limitations, as well as their underlying motivations and suitability for various
contexts. To this end, students engage in real-life case studies for project assignments
rather than rely on exercises and drills. The pedagogical design of the assignments is
further described in a companion paper [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Experiences and Discussions</title>
      <p>Given the above instructional context for i*, we discuss our experiences,
observations, and potential avenues for improvements in several areas.
3.1</p>
      <sec id="sec-3-1">
        <title>Conceptual Understanding of the Premises and Objectives underlying i*</title>
        <p>
          The students were generally appreciative of the distinctive line of reasoning of the i*
framework and its complementary nature to other modeling techniques. Over the
duration of the course, students progress from process and data modeling to
agentoriented modeling [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. The core concepts of the i* framework, particularly the ability
to broadly model and evaluate an organizational setting, were relatively accessible to
the students. Students acknowledged the capability of the i* framework to depict a
social organization which helped them visualize the various motives, beliefs,
intentions and dependencies that typically exist in an organization; aspects which are
generally not acknowledged or supported in other modeling techniques. They were able
to critically contrast i* with VNA, and with process modeling.
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Proficiency in i* Modeling</title>
        <p>Although the course objective is not to learn the i* language (or any other specific
language) per se but to appreciate and experience first-hand the strategic actors
thinking expressed through i*, students nevertheless need to acquire a sufficient level of
proficiency in the language in order to benefit from the experiential learning in
reallife projects.</p>
        <p>Despite the limited instructional hours allocated to the i* segment in the course,
we found that students were able to construct i* Strategic Dependency (SD) models
fairly readily, and Strategic Rationale (SR) models with some extra effort. The
following concepts typically require more attention. Most students overcome these
conceptual barriers upon clarification during class or project discussions, although
misconceptions also appear in final assignment submissions.</p>
        <p>For SD models:
 Differentiating goal dependencies from task dependencies. Similarly for goal
dependencies versus soft-goal dependencies.
 The direction of the dependency relationship between “depender” and “dependee”
actors is at times incorrectly indicated.
 The naming of goals and other intentional elements are often stated according to
domain-specific priorities (e.g., “Make more money”) rather than in accordance
with naming guidelines for each type of element (e.g., “Profits be increased” for a
softgoal vs. “Increase sales revenue” for a task goal).
 Distinctions among i* actor types (roles, positions and agents) are rarely used, as
are IS-A relationships among actors. These are noted as more “advanced” concepts
in class, to avoid cognitive overload for beginner learners. Their usage is
recommended on an as-needed basis.
 IT systems are often modeled initially as resources to be used by other actors. The
benefits of treating non-humans as actors require further explanation.</p>
        <p>For SR models, difficulties often relate to the link types:
 Decomposition is readily understood, whereas means-ends requires more effort.</p>
        <p>Initial models often confuse the two.
 A high-level goal is often directly decomposed into sub-goals without determining
the possible means of achieving that end. This limits exploration of alternatives,
and reduces the potential for model analysis, evaluation and alternative selection.
 Contribution links are generally understood, once the softgoal vs. goals distinction
is made; however initial models often confuse means-ends with contribution links.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>From Modeling to Analysis</title>
        <p>Throughout the course, the analytical powers of models are emphasized so that they
are not seen as merely descriptive. In student work, such analytical capabilities are
typically under-utilized. This applies to the earlier assignments involving process
modeling, as well as to the assignment where i* is used. Models serve as descriptions,
but conclusions are often drawn based on domain knowledge rather than using the
models. The concepts of goal satisfaction analysis are typically not fully exploited;
while students typically do perform some type of analysis to fulfill assignment
requirements, they do not always use the results of these analyses to make
recommendations. The reasons for this could be varied, ranging from incomplete domain models
that lead to unhelpful or incorrect results, to students’ inexperience with model
evaluation and analysis. As a result, students may be unable to provide strong and justified
explanations on how the modeling analysis exercise helped them to come up with
redesigned to-be alternatives which solve the issues in the problem domain.
3.4</p>
      </sec>
      <sec id="sec-3-4">
        <title>Managing Model Complexity</title>
        <p>
          Managing complexity and layout within i* SD and SR diagrams takes particular care
because of the flexibility of usage that the i* framework provides. It is easy to get
carried away with modeling a domain which can lead to unmanageable models.
Following the layout rules for i* models (such as no intersecting links or dependency
links having a natural flowing line [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]) can be challenging in large models.
Visualization of the problem domain becomes increasingly problematic with the increasing
number of intentions, actors and links. Transferring a large model drawn in a software
tool to an assignment document can result in an illegible figure, unless extra effort is
made to develop proper views or model subsets. To help simplify the final i* model,
students were encouraged to remove elements of the model which are not important to
the domain analysis. However this is often most easily done once the initial model
was developed and students have determined that certain actors (and their associated
intentions and links) are not important to subsequent analysis and alternative
selection. Producing the final model can require multiple iterations requiring significant
investment in time and effort.
3.5
        </p>
      </sec>
      <sec id="sec-3-5">
        <title>Teaching Resources</title>
        <p>
          Students are introduced to i* through class lectures with detailed examples, and
readings of selected representative papers on i*. The course adopts the version of i* as
described in [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]. The i* wiki [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] serves as a supplementary resource. It was meant as a
guide for students new to the i* framework as well as providing a reference guide to
experienced modelers. Nevertheless, the availability of pedagogical literature and
learning aids are not comparable to well-established modeling techniques and
standardized languages (such as BPMN and UML) which have extensive literature and
educational material available for students for making the progression from basic to
advanced modeling and analysis more quickly.
        </p>
        <p>A useful addition to the existing material would be a set of usage scenarios and
examples that cover progressively more difficult cases, preferably using a large,
realworld problem domain. The series of examples taken as a whole should be
comprehensive so that the lesser used or more difficult to understand constructs (like IS-A
relationships, different actor types, different contribution links etc.) are also covered.
Detailed explanations on the various goal satisfaction analysis methods and their
proper usage could then be provided by using this depicted domain model as an
example setting. Instructional videos could be made which show the best practices and
guidelines for i* modeling and analysis. These could be embedded within the wiki
itself or uploaded to a video sharing site such as YouTube. These resources would
further help students adjust to the agent- and goal-oriented paradigm in the limited
time available to them and help them model and analyze problem domains using i*
effectively and comprehensively. Such an endeavor could benefit from collaborative
effort from the i* community.
3.6</p>
      </sec>
      <sec id="sec-3-6">
        <title>Tools for Supporting i* Modeling, Analysis, and Model Management</title>
        <p>
          Typically students in the course create i* SD and SR diagrams using either an i*
stencil for Microsoft Visio [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] or OpenOME [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. Students are usually familiar with
Microsoft Visio and are able to quickly use the i* stencil to start modeling the problem
domain. OpenOME is a specialized software tool developed for agent- and
goaloriented modeling and analysis. It offers and supports language-specific concepts
such as syntax checking, model statistics, and goal satisfaction analysis.
        </p>
        <p>Recent advances in browser side web technologies, such as HTML5 and
JavaScript, have made it possible to have a lightweight i* modeling software tool that runs
entirely as a web application in a browser with the main server-side application hosted
on a central system (similar to, for example, LucidChart, Gliffy). Any improvements
made to this deployed environment would be immediately available to everyone as
everyone accesses the same server. In addition to the capabilities of OpenOME and
other i* related tools, the new software tool could have capabilities such as immediate
checking of syntax and best practice violations, auto layout of i* models, built-in
tutorials and examples, cooperative and collaborative modeling for student groups,
ability to hide/show segments of the i* model, etc. Some of these features have
already been implemented in other tools. Such improvements could make analysis and
modeling of the problem domain using i* framework further accessible to students.
3.7</p>
      </sec>
      <sec id="sec-3-7">
        <title>Pedagogical Design</title>
        <p>
          The assignments and studio presentations are structured to encourage reflection,
comparison between multiple modeling techniques and proposal of alternative methods of
achieving organizational objectives. The pedagogical design of the course is covered
in some depth in a companion paper [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. Studio presentations take place towards the
end of the course where each student team is asked to present and explain these
models to their fellow students, who then provide constructive feedback. As part of this
experience, student teams are able to considerably improve their domain model (in
terms of depiction, syntactic use and analysis) before their final assignment
submission. These improvements could be traced back not only to fellow students’
suggestions, but also to insights gained as a result of seeing or commenting on other
students’ work.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions and Future Work</title>
      <p>The intention of this paper was to review and document our instructional experiences
as course instructors and teaching assistants for the “Systems Analysis and Process
Innovation” course. By sharing our experiences with the wider i* community, we
hope to be able to collectively further develop instructional methods and enhance the
in-class learning experience across the many universities where similar courses are on
offer. Continuous pedagogical improvements to the course can benefit from
systematic analysis of submitted assignments, subject to research ethics protocols. Input from
students on specific aspects of the i* framework, through surveys or other means, can
also be sought.
5</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Giorgini</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maiden</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mylopoulos</surname>
          </string-name>
          , J.:
          <article-title>Social Modeling for Requirements Engineering</article-title>
          . MIT Press (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. “
          <article-title>Systems Analysis and Process Innovation” course outline</article-title>
          , http://yu.ischool.utoronto.ca/1341outline.pdf
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Horkoff</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Elahi</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Abdulhadi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Reflective Analysis of the Syntax and Semantics of the i* Framework</article-title>
          .
          <source>In Advances in Conceptual Modeling-Challenges and Opportunities</source>
          , pp.
          <fpage>249</fpage>
          -
          <lpage>260</lpage>
          . Springer Berlin Heidelberg (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Allee</surname>
          </string-name>
          , V.:
          <article-title>Value network analysis and value conversion of tangible and intangible assets</article-title>
          .
          <source>Journal of Intellectual Capital</source>
          .
          <volume>9</volume>
          (
          <issue>1</issue>
          ),
          <fpage>5</fpage>
          -
          <lpage>24</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lessard</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Babar</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nalchigar</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Horkoff</surname>
          </string-name>
          , J.:
          <article-title>Teaching i* Alongside a Contrasting Modeling Framework</article-title>
          . Submitted to iStarT'
          <fpage>15</fpage>
          . (accepted)
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Why Agent-Oriented Requirements Engineering</article-title>
          .
          <source>In Proceedings of 3rd Workshop on Requirements Engineering For Software Quality</source>
          . (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>7. i* Wiki, http://istar.rwth-aachen.de/</mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Yu</surname>
          </string-name>
          , Eric S.K.:
          <article-title>Towards modelling and reasoning support for early-phase requirements engineering</article-title>
          . In Requirements Engineering,
          <source>Proceedings of the Third IEEE International Symposium on</source>
          , pp.
          <fpage>226</fpage>
          -
          <lpage>235</lpage>
          . IEEE (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>9. MS Visio i* stencil, http://istar.rwth-aachen.de/tiki-index.php?page=VISIO</mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>10. OpenOME, https://se.cs.toronto.edu/trac/ome/wiki</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>