<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>GEStory: An Atlas for User-Defined Gestures as an Interactive Design Space</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>SantiagoVillarreal-Narva</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Sophia Antipolis, France</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>EICS'22: The 14th ACM SIGCHI PhD Workshop on Engineering Interactive Computing Systems</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Louvain Research Institute in Management and Organizations, Université catholique de Louvain</institution>
          ,
          <addr-line>Place des Doyens 1</addr-line>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Louvain-la-Neuve</institution>
          ,
          <addr-line>1348</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>How can we provide designers and developers with some support to identify the most appropriate gestures for gestural user interfaces depending on their context of use? To address this research question, GEStory was developed to address this research questions. It is an on-line atlas of gestures resulting from gesture elicitation studies with four main functionalities: (1) search for user-defined gestures identified in such studies by querying its features in an interactive design space, (2) show the preferred gestures and their characteristics for a given action (represented through a referent) with a given device in an environment and/or carried out with various body parts, (3) compare the existing studies and (4) suggest adding new studies. To feeGdEStory, two Systematic Literature Reviews (SLR) were performed: a macroscopic analysis of 216 papers on their metadata, such as authors, definitions, year of publication, type of publication, participants, referents, parts of the body (finger, hand, wrist, arm, head, leg, foot, and whole body), number of proposed gestures; a microscopic analysis of 267 papers analyzing and classifying the referents, the final gestures coming out the consensus set, their representation and characterization. It also proposed an assessment of credibility of these studies as a measure for categorizing their strength of impact.GEStory acts as an interactive design space for gestural interaction to inform researchers and practitioners on existing preferred gestures in diferent contexts of use, and enable the identification of gaps and opportunities for new studies.</p>
      </abstract>
      <kwd-group>
        <kwd>Human-computer interaction</kwd>
        <kwd>Gesture interaction</kwd>
        <kwd>Gesture Elicitation Study</kwd>
        <kwd>Gesture Preferences</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>santiago.villarreal@uclouvai(nS..bVeillarreal-Narvaez)
overlapping, rarely incremental and complementary.</p>
      <p>Let us consider an example showing how a GES is conducted: Suppose the case that a designer
wants to develop a gesture user interface for a new smartwatch prototype that allows users
to control 5 actions (materializerdefearsents) in the environment of a smart car: (t1) turn
on the radio, (t2) turn on air conditioning, (t3) answer a call, (t4) turn of the radio, and (t5)
turn of the air conditioning. For the study a group of potentia l uisebrrsought together,
perhaps 20 in number,i.e.,| | = 20. Each participant is shown the context existing before and
after performing each action:e.g.,The radio is of (before) and the radio is on for the referent t1
(after). The participant is asked to propose a gesture command using the smart watch to execute
the referred action. At the end of the GES, the designer, who compiled a set of 100 gesture
proposals = 5 (referent×s)20 (proposals), now looks at the set of gestures elicited for each
function to understand which gestures are in agreement among participants. If the agreement
is substantial and the sample of participants is representative enough of the target population
that the gesture-based interface is targeting, then the designer is expecting that the prompts are
intuitive and that other users, who were not part of the GES, are likely to guess, to learn easily,
and hopefully to prefer the same types of gestures. Although these GES are num2e]r, otuhsey[
do not answer all design questions as they do not cover many contexts of use. Consequently,
the following research question emerges from this paradoxical situation:</p>
      <p>RQ=how can we provide designers and developers with some support to identify the most
appropriate gestures for gesture-based user interfaces depending on their context of use?</p>
      <p>
        The expected contributions of our doctoral thesis are as follows:
1. Two SLRs related to gestural interaction: one on GES metadata and one on gestures
characteristics, along with a classification and discussiono.nA-lnine Zotero collectioofn
relevant papers and classification.
2. New methodological aspects for conducting a GES and new G4,E5S, 6[
        <xref ref-type="bibr" rid="ref7 ref8 ref9">, 7, 8, 9</xref>
        ].
3. GEStory, an on-line web application serving as a repository for gesture elicitation studies
and their results.
4. A validation oGfEStory based on multiple queries answering the initial research question.
5. A transition betweGenEStory and GESistant. If the result of a searcGhEiSntory is zero
gestures, the researcher could export these criteria to GESistant to conduct a new GES
distributed in time and space.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Work</title>
      <p>
        Regarding GES surveys and reviews, there are only three such studies: Veutlaelt.i[c10]
conducted a systematic literature review (SLR) on hand gestures for user interfaces, but without
having GES as the focus of their investigation; Vogiatzidakis and Koutsabasis first performed a
GES review [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] for mid-air interaction, then a S1L2R] [with a corpus o=f47 papers. These
two studies are limited in scope in terms of gestures covered and in terms of investigation
methods.
      </p>
      <p>
        Regarding software tools, there are several software pursuing diferent goals than ours.
GestMan 1[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] support practitioners in creating and managing 2D stroke gesture datasets, but
do not exploit them in GES. GECK1o4[], and more extensively, Omnis Praedict1io5][) support
designers in evaluating important characteristics of stroke gestures, their consistency and their
features such as time production respectively. GestureM16a]ppr[ovides visual analytics of
Kinect-based full body gestures to analyze their similarities and diferences. Gest1u7R]ING [
compiles an inventory of all ring gestu1r8e]s f[ound in the literature. These software tools
do not address the above research question directly: they are not aimed at covering the whole
body of gestural knowledge contained in the available GES and they are aimed supporting some
specific design questions other than finding the gestures for a given context of use.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Research Methodology</title>
      <p>Since our research question is not fully addressed, our initial idea consists of compiling and
consolidating the results of all existing GES into a single gesture repository that can be queried
to address the research question. This repository becomes a gesture atlas where each gesture is
characterized according to several dimensions: user, task, device, environment, human limbs,
etc. For this purpose, our research method is structured in five connected stage1s):(Fig.
Existing GES
=21-682p2ap9pa8eprpesarispneecrlxuscdleueldidgeibdle
1,819papersthrough</p>
      <p>databasesearching
+430papersthrough</p>
      <p>othersources
-311duplicatepapers
=1,938papersidentified
1,938papersscreened
-1,640irrelevantpapers
=298papersafterscreening</p>
      <p>=26-78pp2aa7pp5eerprssaipenexccrlusludedeleidgdible
SLR of GES
metadata</p>
      <p>SLR of gesture
characteristics anNdemweGthEoSds
1,394papersthrough</p>
      <p>databasesearching
+422papersthrough</p>
      <p>othersources
-301duplicatepapers
=1,515papersidentified</p>
      <p>GEStory
-NeDwifcfeornetnetxtusseorfsuasnedtasks RDeoqmuairienmmeondtesl
- Differentdevicesandsensors DDeevsieglnopment
- Differentenvironments
Newmethodologicalapproaches
- Credibilityindex
- Referentlesselicitation
- Alternativemeasures
- Modalitytransfer</p>
      <p>Validation
QueryingGEStoryby
- Usertypeandcharacteristics
- Tasktype
- Device,sensortype
- Environment
- Humanlimb
- Combination
1,515papersscreened
-1=,224705irpraepleevrasnatftpearpsecrrseening</p>
      <p>SLR of GES metadata:conduct a first SLR based on the metadata describing each G2E],S [
such as the year of publication, venue, number of participants, number of referents, experimental
setup, number of proposed gestures and number of consensus gestures. Our approach was
inspired by the four-phase SLR method (Identification, Screening, Eligibility and Inclusion)
proposed by Liberateit al. in [19] and the flow was represented in a PRISMA diagram. For
identification , the queryQ = (”Gesture” AND ”Elicitation” AND ”Study”)was performed on
ifve major Computer Science digital librariei.se.(,ACM DL, IEEE Xplore, Elsevier ScienceDirect,
Elsevier Ei Compendex, and SpringerLink) and other souric.ee.,sD(BLP CompleteSearch and
Google Scholar) to identify 2,249 candidates, from which 311 duplicates were eliminated. For
screening, we retained only those papers that explicitly introduced a GES for UI design, discussed
a GES, or explicitly used a method to examine a GES, thereby leaving 298 paperesl.igFiobirlity,
82 papers were excluded that did not match 3 conditions, leaving a final co r=p2u1s6of studies
for our examination. Foinrclusion, we verifyied quantitative and qualitative aspects of our
corpus of papers, stored and maintain asoann-line collectiownithZotero,a multi-platform
bibliography management.</p>
      <p>
        SLR of gesture characteristi.cSsince the first SLR focused on GES metadata only, we ran a
second SLR to provide an in-depth analysis of gestures elicited and agreed upon in GES after
updating the collection, stopped at the beginning of 2021. We follow the same methodology
with theQ = (”Gesture” AND (guess* OR elicit*) AND (study OR experience):)1,816 papers
were firstly identified, 1,515 papers were screened after duplicates removed, 275 papers became
eligible, and 267 papers were finally included. Based on these SLRs, we have obtained concepts
and terminologies that are part of the GES studies, we discussed some examples of representative
GES, and we provided data and calculations such as the average, the mean, maximum, and
minimum of the number of participants, references, collected gestures, final gestures, etc.
Moreover, consensus gestures are classified according to several dimensions: a taxonomy of
referents based on task classificatio2n0][, a classification of 3D gestures21[], a classification of
gestures in Augmented Realit2y2][ and another one for the whole body to control a humanoid
robot 2[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Bernsen’s theory of multimodality will be used to classify the modalities and
McAweeneyet al. [24] criteria will be expanded to classify gesture representea.tgi.,oimnasg(es,
animations, videos).
      </p>
      <p>
        New GES and methods. To complement our repository, our search conditions focus in
new contexts such as diferent users and tasks, diferent devices and sensors and diferent
environments, we identified some areas uncovered by existing GES and subsequently conducted
some of them, such as for head and shoulders gestur9e],sf[or zenithal gesture5s],[for
radarbased gestures6[
        <xref ref-type="bibr" rid="ref7">, 7</xref>
        ], for facial gesture4s][and Squeeze Gestures8[]. We are exploring new
methodological approaches, such as GES without any explicit referent to discover more proposed
gestures than with legacy bia25s][or by transformatio2n6[].
      </p>
      <p>Development ofGEStory [27]. Based on the results of the two aforementioned SLRs, a
domain model has been defined (Fig.2) to create the databaseGoEfStory, an on-line gesture
atlas for querying GES on multiple criteGrEiaSt.ory is presented as an interactive design space,
such as the one for wearable device2s8][, where various design dimensions can be explored. In
particular, selecting any particular human limb should result in selecting GES satisfying this
criterium (see a prototype in F3ig).. GEStory, beyond making gestures accessible, should also
provide some guidelines in selecting and designing gestures based on its29a]talansd[, possibly,
automate its evaluation based on guidel3in0e].s [</p>
      <p>The framework used is Vue.js. The Vue file format is divided into 3 parts:
1. The HTML structure of the page or element that you want to display,
2. The JavaScript methods and state variables used by the component. This part also allows
use the Listener design pattern to push changes to other components,
3. The CSS part that corresponds to the style of the component.</p>
      <p>GEStory has a total of 3902 gestures from 267 gesture elicitation studies (GESs) obtained in the
2 SRLs, the information of these gestures are public and availabledianttah.jseo nfile</p>
      <p>The architecture of the main page is divided into 3 parts (Se3e)Fwigh.ich communicate
with each other. These 3 components all inherit from the Vue.component class:
• The bodyMap component which takes care, based on data extracted frodmattah.jeson
ifle, of displaying points representing gestures on the body map. It has diferent attributes
such as the list of body regions (bodyRegions). As for its methods, it mainly has methods
1</p>
      <p>BodyPart
BodyPartId
BodyPartName
BodyPartDesc
Location</p>
      <p>Device
DeviceID
DeviceName
DeviceDesc</p>
      <p>User
UserId
Number
SDAge
MeansAge
MFRatio</p>
      <p>Is replication of,
 Is generalization of,
Is repurposing of</p>
      <p>Replication,
 Generalization,
Repurposing
RefID
RefName
RefRepresentation
RefGeneric</p>
      <p>1,n</p>
      <p>Gesture
GestureId
GestureName
GestureRepresentation
GestureImage
GestureType
GestureForm
GestureNature
GestureSymmetry
GestureLocale
Agreement
1,n
0,n</p>
      <p>GEStudy
StudyId
StudyTitle
Year</p>
      <p>Published
0,n AUuRtLhors</p>
      <p>StrengthOfEvidence
Replication
Generalization
Repurposing
0,n
1,n
1,n
1,n
1</p>
      <p>FunctionSubType
TaskID
TaskName
TaskDesc</p>
      <p>1,n</p>
      <p>FunctionType
TypeID
TaskSetName
TaskSetDesc</p>
      <p>Environment</p>
      <sec id="sec-3-1">
        <title>1,n EEnnvvINDame</title>
        <p>EnvDesc
Process</p>
      </sec>
      <sec id="sec-3-2">
        <title>PPrroosseessssINDame</title>
        <p>PreTest
0,n TPeosstTest</p>
        <p>Consolidation</p>
        <p>related to the display of points on the body map (getPositionForTypeAndItem, drawLineR,
changeBodySelection for example).
• The DataFilter component takes care of displaying filters as well as displaying the list
of gestures extracted from the sadmaeta.json file. Each gesture in the list has the name
of the gesture, the name of the study andctrehdeibility percentage. This component
communicates tobodyMap the list of gestures to be displayed according to the filters. It
has all the attributes related to the filters (those active, the total list of filters). As far as
methods are concerned, these are mainly methods aimed at adapting its display according
to the display of the other two components (if these are closed, you can increase the size
of DataFilter, which is achieved with returnClass, mainClass).
• The last componentIt,emDisplay, takes care of displaying the gesture that has been
selected on thbeodyMap or in the list of gestures. It therefore depends on these 2
components in order to obtain the gesture selected by the user. This element is used to
display the advanced details of the chosen gesture. The main attribute of this element is
the user selected gesture (item). Shows gesture information such as its name, name of
origin GES, authors, URL of study, year of publicatciroendi,bility, etc. (see Fig.3).</p>
        <p>To provide quantified, peer-reviewed gestures to inform the design of gesture-based user
interfaces, it is important that each stored gestures includes relevant information to become
efective. In some other references, recommended gestures could be based on the personal
opinions of a few experts, do not provide any reference to support them or any empirical
evidence to backup their application, do not provide any indication as to whether a particular
gesture represents a consensus of researchers or a large agreement among participants, do not
give any information about the relative importance of individual GES. To this end, a numerical
measure was proposed to quantify tchredibility of consensus gestures ofered by a GES. It has
reflected the essential criteria for a GES considering: (a) the length of the study (the number
of pages, e.g.,a poster of 4 pages is diferent from a paper of 25 pages), (b) the expertise of
the authors in gesture researec.gh.,(, how many papers they published on topics related to
gestures,e.g.,7 for an author based on Google Scholar entries, (c) the venue where the GES
was published (for which we useScimago’s journal rankinign terms of Q1/Q2/Q3/Q4/none
categories anCdORE Rankings Portaflor conferences in terms of A * / A / B / C / D), (d) the
number of participants involved in the stue.dgy.,,(a GES with 5 participants is assumed to have
a lower validity than a GES with &gt;30 participants), and (e) their diversity in age, we use the
standard deviation of participants’ ae.gge.,s, S(D ages = 5 when reported in the GES. It combines
(a), (b), (c), (d) and (e) in one singlSetrength of evidence measure, defined as follows:</p>
        <p>(  )2 + (  )2 + (  )2 + (  )2 + (  )2
 (GES) = 
5
(1)
where:
• A = the typical limit of page numbers for a full paper at the major HCI conferee.gn.,c1e0s (
pages), so A=10. If A &gt;= 10, then a/A is bounded to 1, so that each component of the sum
above is between 0 and 1.
• B = the total number of articles published by all authors of the GES study, and b is the
total number of gesture articles published by all authors of the GES study.
• C = 5 and we encode Q1 = 5, Q2 = 4, Q3 = 3, Q4 = 2, and other = 1 (low strength of
evidence based on the estimated quality of peer review).
• D = 20 (the typical number of participants in GES studies; this value should result from
the analysis of the appendix where the number of participants is discussed). If d &gt;= 20,
then d/D is limited to 1, so that each component of the sum above is between 0 and 1.
• E = the standard deviation of participants’ ages extracted or coem.gp.u,,tEe=d4,.15.</p>
        <p>For example, Fig.3 displays a list of gestures coming from diferent GES, ”Yes gesture” has a
strength of evidence o=f0.54 , and Bend up bed down has a strength of evidence=0o.f6 .</p>
        <p>Through my participation in the Doctoral Consortium at EICS22, we were recommended to
foster qualitative data, to propose a legacy classification of gesture names that are the same but
difer across studies. Inspired by this, we incorporatSeanakey diagramusing
the”chartjs-chartsankey”library to show the diferent relationships that exist between gestures and referents
(See Fig. 4).</p>
        <p>Validation ofGEStory. To validatGeEStory we carry out tests with a group of twelve
volunteer participants (7 Males, 4 Females, 1 not specify, aged1f7rtoom79 years). Recordings of
these interviews were made to allow calculation of success/failure rates per task and completion
of the UEQ+ questionnaire.</p>
        <p>In order to perform our tests, I have drawn up a list of 4 actions that the ”testers” are required
to perform. I decided on them based on the changes made to the platform. This allows me to
see how the user behaves in front of the diferent navigation tools (the selection menu, the
navigation bar, the “suggest a GES” button, etc), Below is the list of actions:
1. Look for an iconic dynamic type gesture of 2018
2. Submit new gesture data
3. Look for the ”Move hand UP” from 2015, to be performed with the arm.
4. Find the information containing the name of the tool on which the prototype was built
Following the UEQ+ analysis, figur5eshows that the two most important parameters for test
participants are dependability (2.42/3) and eficiency (2.33/3). Looking at the “ratings” assigned
by the testers to the organization oGf EtShteory platform, we can see in figure6 that these
two parameters are among the top five rated (with ours of 0.63 and 0.58 respectively).
3
2
1
0</p>
        <p>In Fig. 6, The best ranked parameter of the participants is that relating to the intuitive use of
theGEStory platform (1.04/3). This allows us to link this last criterion with the hypotheses we
have developed above. Indeed, we can quite easily say that we have succeeded in suficiently
reducing the workload of the platform (which seemed very high to us on the initial version
of the project) so that the user can handle this tool without needing a very extensive training.
We can also highlight the fact that the accounting of the interface is quite suitable for it to
allow users to carry out their various tasks. This allows us to draw a parallel with the success
rate of the tasks we asked them to perform which is, for each task, at least, grea7t5e%r than
success.The utility is a parameter of the UEQ+ analysis that had the most negative result (-0.98).
If we rely on the given definition, this parameter represents the fact that the use of the product
brings benefits to the user.</p>
        <p>Fig. 7 shows the result of task success/failure rate. In general, the participants were able to
perform the various tasks that were asked of them. The least successful task being number 1
(9 successes, 2 successes with our help, and 1 failure, see F7iag). During our tests, we were
able to observe that the failure of the task was often explained by a phase, on the part of the
user, of ”taking control of the platform”. Most of the participants took the time to discover the
diferent search tools (the search engine and the search criteria system) and sometimes did not
understand how they work directly (despite a platform presentation phase). performed before
the various tests).</p>
        <sec id="sec-3-2-1">
          <title>Failure rate</title>
        </sec>
        <sec id="sec-3-2-2">
          <title>Success rate with help</title>
        </sec>
        <sec id="sec-3-2-3">
          <title>Success rate</title>
        </sec>
        <sec id="sec-3-2-4">
          <title>Failure rate</title>
        </sec>
        <sec id="sec-3-2-5">
          <title>Success rate with help</title>
        </sec>
        <sec id="sec-3-2-6">
          <title>Success rate</title>
          <p>By looking at the average resolution time of each task, we can also notice that task No. 1 is
the one that took the longest to complete (which could also be justified by this phase of ”getting
started with the tool”). The average resolution times being for task No. 1: 73 seconds, task No.
2: 27 seconds, task No. 3: 61 seconds, task No. 4: 24 seconds.</p>
          <p>These task resolution times also allow us to observe the fact that the tasks requiring the
use of the search tools present on the site (task No. 1 and No. 3) required longer resolution
times than the two others. As a reminder, the first task being: Look for an iconic dynamic type
gesture from 2018, and the third: Look for the ‘Move hand UP’ from 2015, to be performed with
the arm.</p>
          <p>Transition toGESistant. A transition should be ensured betwGeEenStory andGESistant,
a software aimed at assisting the experimenter to conduct a GES in a way that is distributed in
time (stages are asynchronous) and space (participants are contributing remotely, self-assisted
and without any constraint) structured into 6 stages: define a study, conduct a study, classify
gestures, measure gestures, discuss gestures, and export gestures. When a quGeErSytionry
does not lead to a compelling set of appropriate gestures, the parameters of the query should be
transferred to the “define a study” stageGEinSistant in order to match the suggested GES
criteria.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions</title>
      <p>Based on the research methodology (F1i)g, .the first SLR has been completed and its results
are published2[]. The second SLR of gesture characteristics has been completed in terms of
research and are momentarily stored as on-line spreadsheets. Their results are under analysis.
Other GES have been conducted and published. Several others have been conducted, but not
yet analyzed, such as a GES for a haptic devvisc.ewithout it.</p>
      <p>The GEStory prototype was created based on its domain model 2(F)iwg.hose classes
include Body part, Device, Gesture, Environment, Participant, Study, Referent Classification
(FunctionSubType and FunctionType). The relationships between device and gesture, body
part and gesture, gesture and referent, participant and study, study and gesture, gesture and
environment are also considered. CurrenGtElSyt,ory [27] is considered an interactive design
space [28], whose classes are dimensions of investigation. Checking or unchecking the values of
each dimension will automatically result in the display of GES satisfying these criteria and their
consensus gestures (Fig3.). Each gesture is displayed according to a textual representation, a
textual description, a picture, JSON-based formal definition based on an Extended Backus-Naur
Form (EBNF) grammar with transformations betwe2e6n]. [By means of a Sankey diagram
(Fig. 4) the relationship between the classified gestures and the classified referents is shown;
this diagram shows the distribution of the preference of the users of a gesture to perform a
referent.</p>
      <p>A validation of the current versioGnEoSftory was carried out in which 12 participants
evaluated ”Attractiveness”, ”Eficiency”, ”Trust”, ”Dependability”, ”Adaptability”, ”Usefulness”,
”Value”, ”Intuitive use” and ”Quality of content” with the UEQ+ questionna5iraen(dFiFgi.g.6)
and performed 4 tasks for which the time to perform and the success/failure rate were calculated
(Fig. 7).</p>
      <p>It is developing the transition frGoEmStory toGESistant, this will allow the user to export
theGEStory informatione(.g.,GES result for replication, configuration parameters for a new
GES, etc.), This will allow experimenters to have a preload for a newGEGSEisSt.ant will allow
the study to be carried out remotely and asynchronously.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>The author of this paper acknowledges the support of SIGCHI Gary Marsden Travel Awards
2022 for the support given for the trip aAnFdIHM for the invitation of Doctoral Consortium
EICS2022.
Review, Multimodal Technologies and Interaction 2 (2018) 65–. hUtRtLp:s://www.mdpi.
com/2414-4088/2/4/65. doi:https://doi.org/10.3390/mti2040065.
[12] P. Koutsabasis, P. Vogiatzidakis, Empirical research in mid-air interaction: A
systematic review, International Journal of Human-Computer Interaction (2019) 1–22. URL:
https://doi.org/10.1080/10447318.2019.157235.2doi:10.1080/10447318.2019.1572352.
arXiv:https://doi.org/10.1080/10447318.2019.1572352.
[13] N. Magrofuoco, P. Roselli, J. Vanderdonckt, J. L. Pérez-Medina, R.-D. Vatavu, Gestman:
A cloud-based tool for stroke-gesture datasets, in: Proceedings of the ACM SIGCHI
Symposium on Engineering Interactive Computing Systems, EICS ’19, Association for
Computing Machinery, New York, NY, USA, 2019, pp. 1–6. URLh: ttps://doi.org/10.1145/
3319499.3328227. doi:10.1145/3319499.3328227.
[14] L. Anthony, R.-D. Vatavu, J. O. Wobbrock, Understanding the consistency of users’ pen
and finger stroke gesture articulation, in: Proceedings of Graphics Interface 2013, GI ’13,
Canadian Information Processing Society, CAN, 2013, p. 87–94.
[15] L. A. Leiva, R.-D. Vatavu, D. Martín-Albo, R. Plamondon, Omnis praedictio: Estimating
the full spectrum of human performance with stroke gestures, International Journal of
Human-Computer Studies 142 (2020) 102466. URLh:ttps://www.sciencedirect.com/science/
article/pii/S107158192030068.9doi:https://doi.org/10.1016/j.ijhcs.2020.102466.
[16] H. Dang, D. Buschek, Gesturemap: Supporting visual analytics and quantitative analysis
of motion elicitation data by learning 2d embeddings, in: Proceedings of the 2021 CHI
Conference on Human Factors in Computing Systems, CHI ’21, Association for Computing
Machinery, New York, NY, USA, 2021, pp. 1–12. URL:https://doi.org/10.1145/3411764.
3445765. doi:10.1145/3411764.3445765.
[17] R.-D. Vatavu, L.-B. Bilius, GestuRING: A Web-Based Tool for Designing Gesture Input
with Rings, Ring-Like, and Ring-Ready Devices, Association for Computing Machinery,
New York, NY, USA, 2021, p. 710–723. URL:https://doi.org/10.1145/3472749.347478.0
[18] B.-F. Gheran, J. Vanderdonckt, R.-D. Vatavu, Gestures for smart rings: Empirical results,
insights, and design implications, in: Proceedings of the 2018 Designing Interactive Systems
Conference, DIS ’18, Association for Computing Machinery, New York, NY, USA, 2018, p.
623–635. URL: https://doi.org/10.1145/3196709.319674.1doi:10.1145/3196709.3196741.
[19] A. Liberati, D. G. Altman, J. Tetzlaf, C. Mulrow, P. C. Gøtzsche, J. P. A. Ioannidis, M. Clarke,
P. J. Devereaux, J. Kleijnen, D. Moher, The prisma statement for reporting systematic
reviews and meta-analyses of studies that evaluate health care interventions:
explanation and elaboration, PLoS Medicine 6 (2009) 1–22. UhRtLt:ps://www.ncbi.nlm.nih.gov/
pubmed/19621070. doi:10.1371/journal.pmed.1000100.
[20] D. R. Lenorovitz, M. D. Phillips, R. Ardrey, G. V. Kloster, A taxonomic approach to
characterizing human-computer interaction., in: G. Salvendy (Ed.), Human-Computer
Interaction., Elsevier Science Publishers, Amsterdam, 1984, pp. 111–116.
[21] R. Aigner, D. Wigdor, H. Benko, M. Haller, D. Lindbauer, A. Ion, S. Zhao, J. T.</p>
      <p>K. V. Koh, Understanding Mid-Air Hand Gestures: A Study of Human Preferences in
Usage of Gesture Types for HCI, Technical Report MSR-TR-2012-111, Microsoft
Research, 2012. URL:https://www.microsoft.com/en-us/research/wp-content/uploads/2016/
02/GesturesTR-20121107-RoA.pd.f
[22] T. Piumsomboon, A. Clark, M. Billinghurst, A. Cockburn, User-defined gestures for
augmented reality, in: CHI ’13 Extended Abstracts on Human Factors in Computing
Systems, CHI EA ’13, ACM, New York, NY, USA, 2013, pp. 955–960. URL:http://doi.acm.
org/10.1145/2468356.2468527. doi:10.1145/2468356.2468527.
[23] M. Obaid, M. Häring, F. Kistler, R. Bühling, E. André, User-defined body gestures for
navigational control of a humanoid robot, in: S. S. Ge, O. Khatib, J.-J. Cabibihan, R. Simmons,
M.-A. Williams (Eds.), Social Robotics, Lecture Notes in Computer Science, Springer,
Berlin, Heidelberg, 2012, pp. 367–377. URLh:ttps://doi.org/10.1007/978-3-642-34103-8_3.7
doi:10.1007/978-3-642-34103-8_37.
[24] E. McAweeney, H. Zhang, M. Nebeling, User-driven design principles for gesture
representations, in: Proceedings of the 2018 CHI Conference on Human Factors in Computing
Systems, CHI ’18, Association for Computing Machinery, New York, NY, USA, 2018, pp.
1–13. URL: https://doi.org/10.1145/3173574.317412.1doi:10.1145/3173574.3174121.
[25] M. R. Morris, A. Danielescu, S. Drucker, D. Fisher, B. Lee, m. c. schraefel, J. O. Wobbrock,
Reducing legacy bias in gesture elicitation studies, Interactions 21 (2014) 40–45. URL:
https://doi.org/10.1145/259168.9doi:10.1145/2591689.
[26] N. Aquino, J. Vanderdonckt, O. Pastor, Transformation templates: Adding flexibility to
model-driven engineering of user interfaces, in: Proceedings of the 2010 ACM Symposium
on Applied Computing, SAC ’10, Association for Computing Machinery, New York, NY,
USA, 2010, p. 1195–1202. URL: https://doi.org/10.1145/1774088.177434.0doi:10.1145/
1774088.1774340.
[27] B.-F. Gheran, S. Villarreal-Narvaez, R.-D. Vatavu, J. Vanderdonckt, Repliges and gestory:
Visual tools for systematizing and consolidating knowledge on user-defined gestures, in:
Proceedings of the 2022 International Conference on Advanced Visual Interfaces, AVI
2022, Association for Computing Machinery, New York, NY, USA, 2022, pp. 1–9. URL:
https://doi.org/10.1145/3531073.353111.2doi:10.1145/3531073.3531112.
[28] F. Heller, K. Todi, K. Luyten, An Interactive Design Space for Wearable Displays, Association
for Computing Machinery, New York, NY, USA, 2021, p. 14. URLh:ttps://doi.org/10.1145/
3447526.3472034.
[29] J. Vanderdonckt, Accessing guidelines information with sierra, in: Proc. of IFIP TC13 Int.</p>
      <p>Conf. on Human-Computer Interaction, INTERACT ’95, Chapman &amp; Hall, London, 1995,
pp. 311–316.
[30] A. Beirekdar, J. Vanderdonckt, M. Noirhomme-Fraiture, A Framework and a Language
for Usability Automatic Evaluation of Web Sites by Static Analysis of HTML Source
Code, Springer Netherlands, Dordrecht, 2002, pp. 337–348. UhRtLt:ps://doi.org/10.1007/
978-94-010-0421-3_29. doi:10.1007/978-94-010-0421-3_29.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J. O.</given-names>
            <surname>Wobbrock</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. R.</given-names>
            <surname>Morris</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Wilson</surname>
          </string-name>
          ,
          <article-title>User-defined gestures for surface computing</article-title>
          ,
          <source>in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09</source>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          , New York, NY, USA,
          <year>2009</year>
          , pp.
          <fpage>1083</fpage>
          -
          <lpage>1092</lpage>
          . URL: http://doi.acm.
          <source>org/10</source>
          .1145/ 1518701.1518866. doi:
          <volume>10</volume>
          .1145/1518701.1518866.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>S.</given-names>
            <surname>Villarreal-Narvaez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          , R.-D. Vatavu,
          <string-name>
            <given-names>J. O.</given-names>
            <surname>Wobbrock</surname>
          </string-name>
          ,
          <article-title>A systematic review of gesture elicitation studies: What can we learn from 216 studies?</article-title>
          ,
          <source>in: Proceedings of the 2020 ACM Designing Interactive Systems Conference, DIS '20</source>
          ,
          <string-name>
            <surname>Association</surname>
          </string-name>
          for Computing Machinery, New York, NY, USA,
          <year>2020</year>
          , pp.
          <fpage>855</fpage>
          -
          <lpage>872</lpage>
          . URL:https://doi.org/10.1145/3357236. 3395511. doi:
          <volume>10</volume>
          .1145/3357236.3395511.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>N.</given-names>
            <surname>Magrofuoco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Roselli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          ,
          <article-title>Two-dimensional stroke gesture recognition: A survey</article-title>
          ,
          <source>ACM Comput. Surv</source>
          .
          <volume>54</volume>
          (
          <year>2021</year>
          ). URL:https://doi.org/10.1145/346540.0doi:
          <fpage>10</fpage>
          . 1145/3465400.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Pérez-Medina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villarreal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          ,
          <article-title>A gesture elicitation study of nose-based gestures</article-title>
          ,
          <source>Sensors</source>
          <volume>20</volume>
          (
          <year>2020</year>
          )
          <article-title>7118</article-title>
          . URLh:ttps://doi.org/10.3390/s2024711.8doi:
          <fpage>10</fpage>
          .3390/ s20247118.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>F.</given-names>
            <surname>Martínez-Ruiz.</surname>
          </string-name>
          ,
          <string-name>
            <surname>S. Villarreal-Narvaez.</surname>
          </string-name>
          ,
          <article-title>Eliciting user-defined zenithal gestures for privacy preferences</article-title>
          ,
          <source>in: Proceedings of the 16th International Joint Conference on Computer Vision</source>
          , Imaging and Computer Graphics Theory and Applications - HUCAPP„ INSTICC, SciTePress, Vienna,
          <year>2021</year>
          , pp.
          <fpage>205</fpage>
          -
          <lpage>213</lpage>
          .
          <year>do1i</year>
          :
          <fpage>0</fpage>
          .5220/0010259802050213.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>N.</given-names>
            <surname>Magrofuoco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Pérez-Medina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Roselli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villarreal</surname>
          </string-name>
          ,
          <article-title>Eliciting contact-based and contactless gestures with radar-based sensors</article-title>
          ,
          <source>IEEE Access 7</source>
          (
          <year>2019</year>
          )
          <fpage>176982</fpage>
          -
          <lpage>176997</lpage>
          . URL: https://doi.org/10.1109/ACCESS.
          <year>2019</year>
          .
          <volume>295134</volume>
          .9doi:
          <fpage>10</fpage>
          .1109/ACCESS.
          <year>2019</year>
          .
          <volume>2951349</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S.</given-names>
            <surname>Villarreal-Narvaez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.-I.</given-names>
            <surname>Şiean</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sluÿters</surname>
          </string-name>
          , R.-D. Vatavu,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          ,
          <article-title>Informing future gesture elicitation studies for interactive applications that use radar sensing</article-title>
          ,
          <source>in: Proceedings of the 2022 International Conference on Advanced Visual Interfaces</source>
          ,
          <source>AVI</source>
          <year>2022</year>
          ,
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <year>2022</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>3</lpage>
          . URL: https://doi.org/10.1145/3531073.353447.5doi:
          <fpage>10</fpage>
          .1145/3531073.3534475.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>S.</given-names>
            <surname>Villarreal-Narvaez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Siean</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sluÿters</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. M.</given-names>
            <surname>Luzayisu</surname>
          </string-name>
          ,
          <article-title>Theoretically defined vs. user-defined squeeze gestures</article-title>
          , in: ISS '22:
          <string-name>
            <given-names>Interactive</given-names>
            <surname>Surfaces</surname>
          </string-name>
          and Spaces Conference,
          <source>November 20-23</source>
          ,
          <year>2022</year>
          , Wellington, New Zealand, ACM,
          <year>2022</year>
          , p.
          <fpage>30</fpage>
          . URL: https://doi.org/10.xxxx/xxxxxxx.xxxxxx.xdoi:
          <volume>10</volume>
          .xxxx/xxxxxxx.xxxxxxx.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>J.</given-names>
            <surname>Vanderdonckt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Magrofuoco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Kiefer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Pérez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Rase</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Roselli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Villarreal</surname>
          </string-name>
          ,
          <article-title>Head and shoulders gestures: Exploring user-defined gestures with upper body</article-title>
          , in: A.
          <string-name>
            <surname>Marcus</surname>
            , W. Wang (Eds.), Design,
            <given-names>User</given-names>
          </string-name>
          <string-name>
            <surname>Experience</surname>
          </string-name>
          , and
          <string-name>
            <surname>Usability</surname>
          </string-name>
          .
          <source>User Experience in Advanced Technological Environments</source>
          , Springer International Publishing, Cham,
          <year>2019</year>
          , pp.
          <fpage>192</fpage>
          -
          <lpage>213</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>V.</given-names>
            <surname>Tijana</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dufy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Hay</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>McTeague</surname>
          </string-name>
          , G. Campbell,
          <string-name>
            <given-names>M.</given-names>
            <surname>Grealy</surname>
          </string-name>
          ,
          <article-title>Systematic literature review of hand gestures used in human computer interaction interfaces</article-title>
          ,
          <source>International Journal of Human-Computer Studies</source>
          <volume>129</volume>
          (
          <year>2019</year>
          )
          <fpage>74</fpage>
          -
          <lpage>94</lpage>
          . URhLt:tp://www.sciencedirect.com/ science/article/pii/S107158191830567.6doi:https://doi.org/10.1016/j.ijhcs.
          <year>2019</year>
          .
          <volume>03</volume>
          .011.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>P.</given-names>
            <surname>Vogiatzidakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Koutsabasis</surname>
          </string-name>
          ,
          <article-title>Gesture Elicitation Studies for Mid-Air Interaction: A</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>