<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Using natural user interfaces for collaborative process modelling in virtual environments</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Erik Poppe</string-name>
          <email>e.poppe@student.qut.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jan Recker</string-name>
          <email>j.recker@qut.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daniel Johnson</string-name>
          <email>dm.johnson@qut.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ross Brown</string-name>
          <email>r.brown@qut.edu.au</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Queensland University of Technology</institution>
          ,
          <country country="AU">Australia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2013</year>
      </pub-date>
      <fpage>65</fpage>
      <lpage>67</lpage>
      <abstract>
        <p>Modelling business processes for analysis or redesign usually requires the collaboration of many stakeholders. These stakeholders may be spread across locations or even companies, making co-located collaboration costly and difficult to organize. Modern process modelling technologies support remote collaboration but lack support for visual cues used in co-located collaboration. Previously we presented a prototype 3D virtual world process modelling tool that supports a number of visual cues to facilitate remote collaborative process model creation and validation. However, the added complexity of having to navigate a virtual environment and using an avatar for communication made the tool difficult to use for novice users. We now present an evolved version of the technology that addresses these issues by providing natural user interfaces for non-verbal communication, navigation and model manipulation.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Virtual worlds have received continuous attention in industry and research for purposes of
training and remote collaboration
        <xref ref-type="bibr" rid="ref3">(Messinger et al., 2009)</xref>
        . While there have been studies
showing the successful use of virtual worlds for such scenarios, there is also evidence that a
key factor in their success is the familiarity of the users with virtual environments (Montoya,
      </p>
      <p>In previous work we have explored the use of virtual worlds for remote collaborative
virtual environment difficult, in turn impeding their ability to focus on the task at hand –
process model creation, analysis or manipulation.</p>
    </sec>
    <sec id="sec-2">
      <title>Prototype</title>
      <p>
        We have previously presented a prototype process modelling tool (Figure 1) that uses a
virtual environment and avatars to enable visual cues such as pointing and gesturing to
facilitate communication between remote collaborators
        <xref ref-type="bibr" rid="ref6">(Poppe et al., 2013)</xref>
        . In this tool,
collaborators control representations of themselves in a 3-dimensional space to view, create
or manipulate process model elements such as tasks, events, gateways or other.
While our evaluation of this tool remains ongoing, we have identified three general usability
issues in regards to user interaction with our tool:
• How do we animate an avatar with a large degree of freedom intuitively?
• How do we make model manipulation as intuitive as possible?
• How do we make navigation as intuitive as possible?
Answers to these questions have been suggested in the HCI and Virtual Worlds literature
        <xref ref-type="bibr" rid="ref1 ref2 ref5">(Marks, Windsor, &amp; Burkhard, 2012; Mazalek et al., 2011; North et al., 2009)</xref>
        . On basis of
this research, we have implemented body-tracking, head-tracking and touch input to address
the issues described1.
      </p>
      <p>We address the first issue by tracking the posture of the user with a consumer depth
camera and applying this posture to the avatar in real-time. This approach enables the use of
gestures such as waving, gesticulation, and head nods and shakes, without having to navigate
menus or remember buttons. Furthermore, this input method allows for gestures that have not
been predefined or subtle variations of typical gestures.</p>
      <p>Second, we have implemented a feature for model manipulation via touch input. Instead of
having to use a mouse to edit the process model, the user can touch the process model on the
screen to create, move, scale or delete elements.</p>
      <p>A final issue of using a virtual world compared to other modelling tools is navigation. The
3D view requires users to navigate their virtual bodies in the virtual space, both for
1 A demonstration video of the prototype can be seen at: http://www.youtube.com/watch?v=nvfoBfWpxKU
communication purposes and for viewing all parts of the model. This navigation requires
movement along 3-axes and rotation around 2-3 axes and is commonly achieved using a
combination of a mouse for rotation and multiple keyboard keys for movement. In our
experience, this is confusing for users with limited experience with virtual environments. We
therefore implemented head-tracking for camera control. The user can now turn her head to
either side, up or down, to have the view turn that way and move his head forward,
backwards, sideways, up or down to move the camera in the according direction.</p>
      <p>Between these input methods, the keyboard is now required only for labelling model
elements. Also, we have reduced the number of keys the user needs to remember to a bare
minimum. These interfaces should now enable users to focus on the task of collaborative
modelling instead of handling input devices.</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>in a virtual environment.</p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgments</title>
      <p>We have presented a prototype virtual world that uses natural user interfaces to minimize
usability issues for users that are unfamiliar with virtual worlds. In our ongoing work we are
executing experimental tests to examine (a) whether this interface indeed facilitates the use of
the tool by novice users, and (b) how collaborative modelling processes are enacted by users
The contributions by Erik Poppe to this research have been supported by the Smart Services CRC in Australia</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Marks</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Windsor</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Burkhard</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Head Tracking Based Avatar Control for Virtual Environment Teamwork Training</article-title>
          .
          <source>Journal of Virtual Reality and Broadcasting</source>
          ,
          <volume>9</volume>
          (
          <issue>9</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Mazalek</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chandrasekharan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nitsche</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Welsh</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clifton</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Quitmeyer</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peer</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , et al. (
          <year>2011</year>
          ).
          <article-title>I'm in the Game : Embodied Puppet Interface Improves Avatar Control</article-title>
          . International Conference on Tangible, Embedded, and Embodied Interaction (pp.
          <fpage>129</fpage>
          -
          <lpage>136</lpage>
          ). Funchal, Portugal: ACM.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Messinger</surname>
            ,
            <given-names>P. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stroulia</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lyons</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bone</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Niu</surname>
            ,
            <given-names>R. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smirnov</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Perelgut</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Virtual worlds - past, present, and future: New directions in social computing</article-title>
          .
          <source>Decision Support Systems</source>
          ,
          <volume>47</volume>
          (
          <issue>3</issue>
          ),
          <fpage>204</fpage>
          -
          <lpage>228</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Montoya</surname>
            ,
            <given-names>M. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Massey</surname>
            ,
            <given-names>A. P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lockwood</surname>
            ,
            <given-names>N. S.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>3D Collaborative Virtual Environments : Exploring the Link between Collaborative Behaviors and Team Performance</article-title>
          .
          <source>Decision Sciences</source>
          ,
          <volume>42</volume>
          (
          <issue>2</issue>
          ),
          <fpage>451</fpage>
          -
          <lpage>476</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>North</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dwyer</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fisher</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Isenberg</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Robertson</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Inkpen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Understanding multi-touch manipulation for surface computing</article-title>
          .
          <source>Human-Computer Interaction - INTERACT</source>
          (Vol.
          <volume>5727</volume>
          , pp.
          <fpage>236</fpage>
          -
          <lpage>249</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Poppe</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , R.,
          <string-name>
            <surname>Recker</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Improving Remote Collaborative Process Modelling using Embodiment in 3D Virtual Environments</article-title>
          .
          <source>Asia-Pacific Conference on Conceptual Modelling. Adelaide</source>
          , Australia.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>