<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Analyzing Software Engineering Courses with Process Mining and Business Intelligence?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dennis Schmitz</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matthias Feldmann</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daniel Moldt</string-name>
          <email>moldtg@informatik.uni-hamburg.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University of Hamburg, Department of Informatics</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Analysis of student performance and resulting support during practical courses is an important topic in the education of students. This contribution illustrates our ongoing work to analyze practical courses with process mining based on Petri nets and business intelligence tools. Introduction The data-driven analysis of students behavior and performance in university courses potentially provides valuable insights. The tutors get a better overview of the course and of the individual students in order to support weaker students in time and improve appropriate learning materials. The students on the other hand get the opportunity to evaluate their own performance in comparison with the requirements of the teachers. Among other things, they can analytically review their learning strategies. This work is located in the Educational Data &amp; Process Mining and Learning Analytics domains. The aim of our research is to determine the e ects of realtime process mining and business intelligence on students and teachers. During a one semester practical course we teach the comprehensive Petri netbased, agent- and organization-oriented software development approach (Paose) [3,2]. In order to analyze the practical course the technical learning environment used so far was extended by data collection capabilities. This contribution presents our ongoing work on these extensions as well as an extract of the analyzes already carried out. Data Collection Setup Interesting questions to collect data for are e.g. How long do the students need for a task?, Does the required time diverged from the targeted time?, How do the students proceed to solve a task? or Does the method of proceeding in uence the result?. The practical teaching of the Paose bases on process-oriented worksheets [4]. The worksheets' processes are modeled as work ow nets [1]. On the one hand, a project management tool was set up to collect student data to answer questions such as those mentioned above. In the last years Jira and Redmine were used. Both provide an issue tracker plus time logging (among a lot of other features)</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>and store data in a relational database. On the other hand, a Git repository was
used to track the results of the students' tasks and additional work behavior.</p>
      <p>For each task of the worksheets, tutors provide prede ned tickets in the
mentioned issue trackers. Students should update the status of the tickets and
log their working time. They should also check their work into the Git repository,
while the commit message should contain the related ticket ID and the names
of cooperating students.</p>
      <p>Data Analysis For the data analysis the process mining tools Disco and ProM
and the business intelligence tool PowerBI are used.</p>
      <p>Analysis of the tickets and the Git data in regard of the students processes
shows that the students di er greatly in their behavior when working on a
worksheet. While some students tend to learn quickly to work with these tools
systematically and organized, others have problems (to accept) to follow the
instructions. For the tutors, this is a valuable observation that helps to nd out
early which students need further assistance.</p>
      <p>Checking the conformance of the mined processes against the provided
workow nets of the worksheets, the students can review their behavior and identify
where they did not worked systemically and why problems may have arisen.</p>
      <p>Comparing the estimated times with the students' logged median time per
task with PowerBI shows which of the tasks are over-/underestimated by the
tutors. Based on these results the underestimated tasks were enriched by helpful
information to ease the solution of the tasks while the estimated time was reduced
for overestimated tasks.</p>
      <p>The analytical methods that we are currently developing can be used by
others to evaluate the behavior and performance of their students in similar
learning environments.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>van der Aalst</surname>
            ,
            <given-names>W.M.P.</given-names>
          </string-name>
          :
          <article-title>Veri cation of Work ow Nets</article-title>
          . In: Azema,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Balbo</surname>
          </string-name>
          ,
          <string-name>
            <surname>G</surname>
          </string-name>
          . (eds.)
          <source>Application and Theory of Petri Nets</source>
          <year>1997</year>
          . pp.
          <volume>407</volume>
          {
          <fpage>426</fpage>
          . Springer Berlin Heidelberg, Berlin, Heidelberg (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Cabac</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Modeling Petri Net-Based Multi-Agent Applications</article-title>
          ,
          <source>Agent Technology { Theory and Applications</source>
          , vol.
          <volume>5</volume>
          . Logos Verlag, Berlin (
          <year>2010</year>
          ), http://www. logos-verlag.de/cgi-bin/engbuchmid?isbn=2673&amp;lng=eng&amp;id=
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Moldt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>PAOSE: A way to develop distributed software systems based on Petri nets and agents</article-title>
          . In: Barjis,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Ultes-Nitsche</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            ,
            <surname>Augusto</surname>
          </string-name>
          , J.C. (eds.)
          <source>Proceedings of The Fourth International Workshop on Modelling, Simulation, Veri cation and Validation of Enterprise Information Systems (MSVVEIS'06)</source>
          ,
          <source>May 23-24</source>
          ,
          <year>2006</year>
          { Paphos,
          <string-name>
            <surname>Cyprus</surname>
          </string-name>
          <year>2006</year>
          . pp.
          <volume>1</volume>
          {
          <issue>2</issue>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Schmitz</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moldt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cabac</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mosteller</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haustermann</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Utilizing Petri Nets for Teaching in Practical Courses on Collaborative Software Engineering</article-title>
          . In: 16th International Conference on Application of Concurrency to System Design,
          <string-name>
            <surname>ACSD</surname>
          </string-name>
          <year>2016</year>
          , Torun, Poland, June 19-24,
          <year>2016</year>
          . pp.
          <volume>74</volume>
          {
          <fpage>83</fpage>
          . IEEE Computer Society (
          <year>2016</year>
          ). https://doi.org/10.1109/ACSD.
          <year>2016</year>
          .21
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>