<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Development of Brando: a robotic dog capable of expressing emotions</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Carolina Padilla Velasco</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Marco Antonio Martínez Cano</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rupendra Raavi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Patrick C.K Hung</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Business and Information Technology , Ontario Tech University</institution>
          ,
          <addr-line>Oshawa</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Robotics is a field that continues to grow and expand, and its presence is mostly found in the industry. Nevertheless, robots are joining our daily lives in many ways. An exploration of social robots was done after building Brando, a robotic dog able to express emotion with the use of a robotic tail and ears. A study was built and developed where subjects were divided into diferent groups, and each group saw the robot with diferent characteristics. After it, each one answered a survey. This questionnaire was constructed to see which perception of Brando they got and if they were able to build an emotional connection with the robot. It was found that movement in the ears and tail of the robot was directly linked to a positive impression of Brando and higher levels of empathy.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Technological development in the field of robotics is experiencing accelerated growth in the
areas where it is applied. However, research related to its social and emotional impact, hand in
hand with its design and characteristics, makes up a little-explored area.</p>
      <p>The analysis of the social impact of robots and the way in which design and characteristics
influence a dynamic of coexistence and acceptance within a society that is increasingly in contact
with technology becomes essential for the comprehensive development of robotic projects with
the intention to assisting vulnerable social groups.</p>
      <p>The concept of quadruped robots has been around among robotics field enthusiasts for a
while. However, most developments have been strictly focused on opposite industries. One
example is Sony AIBO, a robotic dog-directed towards the toy industry, capable of interacting
with users through a set of cameras and sensors, developing a personality over time through
daily interactions.</p>
      <p>
        A study on the impact of AIBO made by [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] gathered information about the interactions
of 72 children between the ages of 7 to 15 years old with Sony’s robot and a live Australian
Shepherd dog, showing a close resemblance in perception and behavior towards the live dog
and the robot. Subjects encountered concepts related to living dogs, such as the robot having
physical essence, mental states, socially, and moral standing. Thus, subjects interacted with
AIBO in similar ways as they did with the live Australian Shepard, and they appeared to be
more willing to interact with the robot rather than with the live dog closely.
      </p>
      <p>Probably the most prominent example of a development of a quadruped robot directed
towards the industry is Spot from Boston Dynamics, a robot widely used in construction sites,
nuclear energy plants, and even in rescue tasks, as its form factor allows it to take part in
activities that take place in very limited space scenarios .</p>
      <p>
        In a study developed by [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] to target the challenges and automation of data capturing during
construction processes, an automated on-site 360º image capture module was added to Spot,
and a series of weekly experiments took place at the site, monitoring construction processes
to obtain factors and indicators related to the economic impact and overall, organizational
performance within construction projects.
      </p>
      <p>
        In research related to the overall development of walking robots, [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] created AQUA, a robot
capable of walking underwater with a combination of a relatively simple hardware design and
sensors along with a software design created to test the capabilities of a mapping navigation
system technology in shallow-water environments.
      </p>
      <p>Studies keep on highlighting the limited research on factors directly attached to a robot’s
appearance and emotional showing capabilities, with the impact that these two have when a
robot is not directed to a specific sector or industry and it is also not limited to work as a toy
for entertainment.</p>
      <p>This paper presents the development of a quadruped robot with no specific target industry at
this point and the findings behind an interaction study to gain an insight into the relevance of
emotional expression and appearance on human-robot interaction.</p>
      <p>
        After building the robot, it was decided to use it as a tool to further investigate the main
characteristics that a social robot should have to promote its acceptance. Exploration of
humanrobot interaction has been done before but in most cases, with an industrial approach. Within
this type of research, it is possible to find information to better understand how humans perceive
robots. For example, [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] concluded that speed was an important factor that influenced subjects’
opinions of robots. As it was mentioned that feelings of discomfort decreased only when the
speed matched subjects’ expectations.
      </p>
      <p>
        When it comes to analyzing emotional connection with robots, diferent types of studies
have been done using commercial robots. An example is a work done by [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], using Sony
AIBO, pointing out that adults need a longer first impression contact to establish an emotional
attachment to AIBO than children. Also, functionalities are important as the interaction of
adults with AIBO was more functional-oriented or device-related.
      </p>
      <p>
        Empathy towards robots has been observed in various studies where people were asked
to inflict some type of “harm” to the machine to see if they felt comfortable doing this. For
example [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] conducted a study in which subjects were asked to trigger electric shocks to an
anthropomorphic robot capable of expressing emotion on its face, shaking its arms, and using
a speaker. It was found that subjects did feel compassion for the robot. Nevertheless, little
encouragement was enough to lead them to continue with the experiment. Concluding that
people have fewer concerns about abusing robots compared to abusing other humans.
      </p>
      <p>
        Next [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] has published research on how communication impacts people in diferent scenarios
and how communication plays a vital role in the influence of physical and mental health. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]
have written about the strategies through which introverts can communicate to improve their
careers. Therefore, it was proposed to add the capability to communicate using sign language
with the robot setting diferent signs as commands, such as sit, stand, come, go, etc. Trained on
top of a machine learning module that helps people sufering from mental health conditions
and introverted people who don’t feel comfortable communicating verbally.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Development</title>
      <p>For the research on this matter, the design of a robot capable of demonstrating emotions in
a similar way to a real dog and studying its social impact and interaction within a specific
population sample was purposed. Brando, the robotic dog, was assembled into three main parts
defined as: the head, the torso, and the legs.</p>
      <sec id="sec-2-1">
        <title>2.1. Brando’s Design</title>
        <p>The head of the robot was designed to have a close similarity to the head of a medium size
dog.Therefore, it includes the design attributes that contribute to the expression of emotions,
such as the moving ears, a set of eyes, and a microphone that resembles a dog nose.</p>
        <p>The torso area was set to contain the power and control elements, such as an 8000 mhA
LiPo battery used to power up all the moving components and the logical processing system, a
Raspberry Pi 4 Model B that uses Python to control the movement of all the components in
Brando besides retrieving data from its sensors.</p>
        <p>The main motion system, defined as the robot’s legs, is built up of two wood pieces attached
to the robot’s torso. On each moving part of each leg, a 60 kg/cm torque servo motor is placed
to provide movement, giving Brando a total of 3 degrees of movement. These pieces are all
joined together by an Axial 32 mm 51106 metal bearing to provide a more stable movement. It
was seen in earlier development stages that the servo motor joint had little to no stability at all
when taking part in challenging movements.</p>
        <p>
          On the previous development of four legged robots, an article was found made by [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] where
a walking system was developed and tested based on walking dynamics to understand the
mechanical limits of the design when the robot moved with trot gait, founding a similar appliance
with our design attached to the placement of moving mechanisms on top of the four legged
structure, this information was used to find the limits to which legs can be set to provide a
stable movement for this type of robot design.
        </p>
        <p>To provide the robot with the ability to show emotions, it was decided to replicate two basic
characteristics that dogs use to show their emotions, according to diferent studies: the tail and
the ears.</p>
        <p>
          For each attribute, a mechanical system was designed with an appropriate range of movement
to be able to imitate the movements carried out by dogs when expressing 5 of the 6 basic
emotions proposed by [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]; Happiness, Sadness, Anger, Fear and Surprise.
        </p>
        <p>
          For the mechanical design of the tail, we used research done at the University of Manitoba
by [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ]. In this study, a robotic dog tail prototype was built and attached to a vacuum robot
with the purpose of mimicking tail emotional expression and validating its accuracy by asking
participants to rate each motion in terms of perceived robotic afect. The tail’s horizontal and
vertical movement was achieved by using two servo motors and a flexible tail with a cable-pulley
mechanism.
        </p>
        <p>The tail mechanism was composed of two 35 kg/cm torque servo motors with a circular wood
piece attached to the motor gear, and each piece had two cables attached to opposite points
of the circular perimeter. The tail is made up of 7 plastic dice joined by a spring in the middle.
Each dice has 4 visible faces with a metal hook having enough space for the cable coming from
the motor’s moving piece to pass through it. In the last dice of the tail, the 4 cables are unified
to provide stability and transfer the motors’ movement to the dice.</p>
        <p>The first motor is responsible for the horizontal movement of the tail and the second motor
is responsible for the vertical movement. These two movements allow imitating a dog’s natural
movement. The mechanism is mounted on a wooden base that integrates its components as
well as adds stability to itself, applying changes in cable tension to generate movement.</p>
        <p>Two 35 kg/cm torque servo motors were used to build the ears, each with a metal piece and
a cable attached to the edge of the piece. The second cable end was attached to the top of a
system made of two wooden parts held together by a spring. By moving the motor, the cable
transfers the movement from one element to another, thus, imitating the movement of a real
dog’s ear. This mechanism was mounted on the external head structure that simulates the head
of a real dog.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Brando’s Interaction Study</title>
        <p>To be able to identify the key elements that a robot must have to promote a positive response
towards it, a study using Brando was implemented.The main purpose was to point out to which
extent the emotional expression (movement of tail and ears), appearance (wood or fur), and
speed (fast or slow) of the robot would influence the subjects’ opinions. With the use of these
three variables, the population was divided into 8 diferent groups.</p>
        <p>Groups were divided evenly taking into consideration equal distribution between male and
female subjects, their ages, and if they are dog owners or not. Due to COVID- 19 restrictions,
the study was conducted virtually. A video of Brando performing a task was shown, followed
by a survey. This was done several times in a 6 months lapsus to assess their reactions, opinions,
and interactions, as well as the evolution of the results over time.</p>
        <p>
          For the development of the survey, the Robotic Social Attribute Scale (RoSAS) was used
to make sure Brando’s perception was accurately measured . RoSAS focuses on three scale
dimensions: warmth, competence, and discomfort [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>When building the experiment, diferent research was analyzed related to how humans
interact and establish emotional bonding with real dogs, as our dog resembles a medium-sized
dog.</p>
        <p>
          Some findings in recent studies on why humans turn to the company of a dog have concluded
that the main motivations for seeking any type of dog bonding are related to the basic human
need for company. For example, dog’s role in a family network is more likely to evolve into a
human-like social interaction dynamic between dogs and its owner [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. Therefore, we expected
that the prototype’s resemblance to a living dog and the use of moving attributes would make
subjects feel attracted to interact with it similarly to a live dog.
        </p>
        <p>After this study was completed, shortened versions of it were conducted, with a reduced
number of groups. The most recent one was done at Sungkyunkwan University, in South Korea.
For this study, the population was divided into two groups, both watching a version of Brando
with fur, the main diference being the movement of the ears and tail, turned ON or OFF. Some
of the most outstanding results were found in the following questions.</p>
        <p>For the following images answer options are represented as it follows</p>
        <sec id="sec-2-2-1">
          <title>Group 2 (Fur and emotional expression OFF.) Figure 6: Q1: Brando looks like a dog.</title>
        </sec>
        <sec id="sec-2-2-2">
          <title>Group 1 (Fur and emotional expression ON)</title>
        </sec>
        <sec id="sec-2-2-3">
          <title>Group 2 (Fur and emotional expression OFF) Figure 7: Q2: The tail and ears help Brando express how he feels. Group 1 (Fur and emotional expression ON).</title>
        </sec>
        <sec id="sec-2-2-4">
          <title>Group 2 (Fur and emotional expression OFF)</title>
          <p>
            Overall, it was concluded that the movement of the tail and ears has an important positive
impact on the way subjects perceive Brando, which was consistent with the other studies
done before. When it comes to empathy, results were very similar for both groups. This was
expected as in studies where diferent appearances of the robot were shown, it was identified
that the variable that afected empathy was the appearance of Brando. As subjects expressed
empathy with both versions of the robot, but with greater intensity when the fur version was
shown. Figure 8 is the flowchart of the Machine Learning model and it’s described in the below
subsections.
2.3. Data Collection :
50 videos from diferent races of people performing sign language were collected, these videos
were then converted into images, resulting in about 150 pictures for each sign. Later, these images
were augmented with the help of Imgau [
            <xref ref-type="bibr" rid="ref14">14</xref>
            ] library, and the data augmentation techniques
used were Gaussian noise, salt and pepper, and flipping. The reason for choosing only these
augmentation techniques was that it was seen from [
            <xref ref-type="bibr" rid="ref15">15</xref>
            ] as the efects of salt and pepper were
specified, which had a considerable image impact on the image. Resulting in the formation of
a new image when it comes to Gaussian noise [
            <xref ref-type="bibr" rid="ref16">16</xref>
            ] describes how adding the Gaussian noise
improved the robustness of the model without compromising accuracy. [
            <xref ref-type="bibr" rid="ref17">17</xref>
            ] published a survey
on how data augmentation increases the accuracy of the machine learning model and also
shows the advantage of using flipping as one of the augmentation techniques.
          </p>
        </sec>
      </sec>
      <sec id="sec-2-3">
        <title>2.4. Object Detection:</title>
        <p>
          Two diferent object detection models were tested suitable for the Rasberry-pi, Tensorflow based
single-shot detector mobilenet [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ], and an improved YOLO based YOLOV3-tiny model [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ].
Still, it was observed that Tensorflow based machine learning model performs better than the
YOLO-based machine learning model. [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ] also shared the results where a huge diference in
terms of accuracy when the user has the distance with the camera was identified.
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>2.5. Brando and Google-vision Kit :</title>
        <p>Google-vision kit is placed on the top of Brando’s head through which the object detection is
performed.</p>
        <p>Google-vision kit is built on top of Rasberry-pi support’s image classification and object
detection. Still, there are certain drawbacks in the image classification where the machine
learning model will not be able to recognize if multiple diferent objects are shown. Hence, we
chose to go with the object detection model.</p>
      </sec>
      <sec id="sec-2-5">
        <title>2.6. Brando Obeying the Hand-sign</title>
        <p>Once the sign is detected with the help of Google vision kit, a string value will be obtained
from it corresponding to the specific command or routine that wants to be triggered. This data
will be used as an input in the main program of the robot to run the sires of movements that
correspond to it.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Future Works</title>
      <p>In the next stages of this project, various improvements will be done. They are beginning with
a change and adaption of the me- chanical design of the robot to make it lighter and as a
consequence, achieving a better movement. For this purpose, the next approach will be 3D printing a
new body for Brando.</p>
      <p>Once Brando’s walking is improved, more complex applications for the robot will be explored
with the addition of sensors for autonomous movement and a camera for object and person
recognition. This way information from the environment can be used to control Brando’s
emotions and actions to interact with people around him and become a useful companion.
Including diferent ways of interacting with the robot to make it accessible to most populations.</p>
      <p>Specific applications like setting Brando as a companion for disabled people, people who
experience anxiety, people who sufer from cynophobia, people with allergies or for the elderly
will be explored.</p>
      <p>When the capabilities of the robot are expanded and COVID-19 restrictions continue to
become more flexible, a set of diferent studies would be done, looking to get a deeper insight
into human-robot interaction with a quadruped robot able to express emotions.</p>
      <p>After analyzing the retrieved data, a bias was encountered, leaning towards a major level
of acceptance, interest, and understanding of four-legged robots, since most of the subjects
belonged to a computer science program and were part of a group between the ages of 18 to 25.</p>
      <p>Despite having a wide variety of nationalities within the subjects in our focus group, a
necessity for a deeper understanding of its cultural impact was highlighted. By creating another
study with a larger and a more representative diversity group, it is expected to get a better view
on how cultural diferences impact interactions with robots.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusions</title>
      <p>It was concluded that adding emotional expression to Brando had a great positive impact on the
way people perceive the robot. This leads to understanding the importance of elements such as
the tail and ears for reducing feelings of discomfort when interacting with Brando. After the
design and development of Brando were completed, it was brought to attention that a change
of material would improve its performance considerably. As budget and machinery are limited,
it is understood that continuing with this research will take time. Nevertheless, eforts will
be done to continue with this project and use the information gathered in the studies to lead
to a better design of Brando and achieve higher levels of acceptance when applied in social
situations.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Acknowledgement</title>
      <p>Special thanks to Dr. Sangseok You who is an Assistant Professor in Information Systems at
Sungkyunkwan University (SKKU), Korea for his cooperation.</p>
    </sec>
    <sec id="sec-6">
      <title>6. Links</title>
      <p>For further references visit https://youtu.be/Tg_5qGd2-ME and https://youtu.be/mq3_U-Nj7Es</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>G.</given-names>
            <surname>Melson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Jr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Beck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Friedman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Roberts</surname>
          </string-name>
          , E. Garrett,
          <article-title>Robots as dogs?: Children's interactions with the robotic dog aibo and a live australian shepherd</article-title>
          ,
          <year>2005</year>
          , pp.
          <fpage>1649</fpage>
          -
          <lpage>1652</lpage>
          . doi:
          <volume>10</volume>
          .1145/1056808.1056988.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>K.</given-names>
            <surname>Afsari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Halder</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>King</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Thabet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Serdakowski</surname>
          </string-name>
          , S. DeVito, M. Ensafi,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lopez</surname>
          </string-name>
          ,
          <article-title>Identification of indicators for efectiveness evaluation of four-legged robots in automated construction progress monitoring (</article-title>
          <year>2022</year>
          )
          <fpage>610</fpage>
          -
          <lpage>620</lpage>
          . URL: https://ascelibrary.org/doi/abs/10.1061/9780784483961.064. doi:
          <volume>10</volume>
          .1061/9780784483961.064. arXiv:https://ascelibrary.org/doi/pdf/10.1061/9780784483961.064.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>C.</given-names>
            <surname>Georgiades</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>German</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hogue</surname>
          </string-name>
          , H. Liu,
          <string-name>
            <given-names>C.</given-names>
            <surname>Prahacs</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ripsman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Sim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. A.</given-names>
            <surname>Torres-Méndez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Zhang</surname>
          </string-name>
          , M. Buehler, G. Dudek,
          <string-name>
            <given-names>M.</given-names>
            <surname>Jenkin</surname>
          </string-name>
          , E. Milios,
          <article-title>Aqua: an aquatic walking robot</article-title>
          , volume
          <volume>4</volume>
          ,
          <year>2004</year>
          , pp.
          <fpage>3525</fpage>
          -
          <lpage>3531</lpage>
          vol.
          <volume>4</volume>
          . doi:
          <volume>10</volume>
          .1109/IROS.
          <year>2004</year>
          .
          <volume>1389962</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Pan</surname>
          </string-name>
          , E. Croft, G. Niemeyer,
          <article-title>Evaluating social perception of human-to-robot handovers using the robot social attributes scale (rosas)</article-title>
          ,
          <source>in: 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI)</source>
          ,
          <source>HRI '18</source>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          ,
          <year>2018</year>
          , pp.
          <fpage>443</fpage>
          -
          <lpage>451</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Weiss</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Wurhofer</surname>
          </string-name>
          , M. Tscheligi, “
          <article-title>i love this dog”-children's emotional attachment to the robotic dog aibo</article-title>
          ,
          <source>International journal of social robotics 1</source>
          (
          <year>2009</year>
          )
          <fpage>243</fpage>
          -
          <lpage>248</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>C.</given-names>
            <surname>Bartneck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chioke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Menges</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Deckers</surname>
          </string-name>
          ,
          <article-title>Robot abuse - a limitation of the media equation</article-title>
          , in: Interact 2005 Workshop on Abuse, Rome,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S. Y.</given-names>
            <surname>Cox</surname>
          </string-name>
          ,
          <article-title>A causal-comparative study on the diference in the use of communication skills between introverts and extraverts among college students</article-title>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>R.</given-names>
            <surname>Pankratz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Zimenof</surname>
          </string-name>
          ,
          <article-title>Career communications for introverts</article-title>
          ,
          <source>Career Planning and Adult Development Journal</source>
          <volume>30</volume>
          (
          <year>2014</year>
          )
          <fpage>76</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>E.</given-names>
            <surname>Mohamed</surname>
          </string-name>
          ,
          <string-name>
            <surname>G.</surname>
          </string-name>
          and
          <article-title>Awad, Assessment of the stability of a four legged robot manipulator</article-title>
          ,
          <source>International Journal of Engineering Research</source>
          <volume>4</volume>
          (
          <year>2015</year>
          )
          <fpage>433</fpage>
          -
          <lpage>436</lpage>
          . doi:
          <volume>10</volume>
          .17950/ijer/v4s8/806.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>P.</given-names>
            <surname>Ekman</surname>
          </string-name>
          ,
          <article-title>An argument for basic emotions</article-title>
          ,
          <source>Cognition and Emotion</source>
          <volume>6</volume>
          (
          <year>1992</year>
          )
          <fpage>169</fpage>
          -
          <lpage>200</lpage>
          . doi:
          <volume>10</volume>
          .1080/ 02699939208411068.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Young</surname>
          </string-name>
          ,
          <article-title>A dog tail for communicating robotic states</article-title>
          ,
          <source>in: 2013 8th ACM/IEEE International Conference on Human-Robot Interaction, HRI '13</source>
          , IEEE Press,
          <year>2013</year>
          , pp.
          <fpage>417</fpage>
          -
          <lpage>418</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>C.</given-names>
            <surname>Carpinella</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Wyman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Perez</surname>
          </string-name>
          ,
          <string-name>
            <surname>S. Stroessner,</surname>
          </string-name>
          <article-title>The robotic social attributes scale (rosas): Development and validation</article-title>
          ,
          <source>in: 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI, HRI '17</source>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          ,
          <year>2017</year>
          , pp.
          <fpage>254</fpage>
          -
          <lpage>262</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Miklósi</surname>
          </string-name>
          , Dog Behaviour, Evolution, and
          <string-name>
            <surname>Cognition</surname>
          </string-name>
          , Oxford University Press, United Kingdom,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>A. B. Jung</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Wada</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Crall</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Tanaka</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Graving</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Reinders</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Yadav</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Banerjee</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Vecsei</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Kraft</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <string-name>
            <surname>Rui</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Borovec</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Vallentin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Zhydenko</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Pfeifer</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Cook</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          <string-name>
            <surname>Fernández</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.-M. De Rainville</surname>
            ,
            <given-names>C.-H.</given-names>
          </string-name>
          <string-name>
            <surname>Weng</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Ayala-Acevedo</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Meudec</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Laporte</surname>
          </string-name>
          , et al., imgaug, https://github.com/aleju/imgaug,
          <year>2020</year>
          . Online; accessed 01-Feb-
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>J.</given-names>
            <surname>Azzeh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Zahran</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Alqadi</surname>
          </string-name>
          ,
          <article-title>Salt and pepper noise: Efects and removal</article-title>
          , JOIV:
          <source>International Journal on Informatics Visualization</source>
          <volume>2</volume>
          (
          <year>2018</year>
          )
          <fpage>252</fpage>
          -
          <lpage>256</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>R. G.</given-names>
            <surname>Lopes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Poole</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Gilmer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. D.</given-names>
            <surname>Cubuk</surname>
          </string-name>
          ,
          <article-title>Improving robustness without sacrificing accuracy with patch gaussian augmentation</article-title>
          , arXiv preprint arXiv:
          <year>1906</year>
          .
          <volume>02611</volume>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>C.</given-names>
            <surname>Shorten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. M.</given-names>
            <surname>Khoshgoftaar</surname>
          </string-name>
          ,
          <article-title>A survey on image data augmentation for deep learning</article-title>
          ,
          <source>Journal of Big Data</source>
          <volume>6</volume>
          (
          <year>2019</year>
          )
          <fpage>1</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Younis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Shixin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Jn</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Hai</surname>
          </string-name>
          ,
          <article-title>Real-time object detection using pre-trained deep learning models mobilenetssd</article-title>
          ,
          <source>in: Proceedings of 2020 the 6th International Conference on Computing and Data Engineering</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>44</fpage>
          -
          <lpage>48</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>X.</given-names>
            <surname>Gong</surname>
          </string-name>
          , L. Ma,
          <string-name>
            <given-names>H.</given-names>
            <surname>Ouyang</surname>
          </string-name>
          ,
          <article-title>An improved method of tiny yolov3, IOP conference series</article-title>
          .
          <source>Earth and environmental science 440</source>
          (
          <year>2020</year>
          )
          <fpage>52025</fpage>
          -.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Gunnarsson</surname>
          </string-name>
          ,
          <article-title>Real time object detection on a raspberry pi</article-title>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>