<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Diversity in Online Interactions</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nardine Osman</string-name>
          <email>nardine@iiia.csic.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bruno Rosell i Gui</string-name>
          <email>rosell@iiia.csic.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Carles Sierra</string-name>
          <email>sierra@iiia.csic.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Artificial Intelligence Research Institute (IIIA-CSIC)</institution>
          ,
          <addr-line>Barcelona</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <fpage>26</fpage>
      <lpage>27</lpage>
      <abstract>
        <p>satisfaction. This paper addresses the issue of connecting people online to help them find support with their day to day problems. We make use of declarative norms for mediating online interactions, and we specifically focus on the issue of leveraging diversity when connecting people. We run pilots at diferent university sites, and the results show relative success in the diversity of the selected profiles, backed by high user diversity-enriching interaction-mediating technologies.</p>
      </abstract>
      <kwd-group>
        <kwd>norms</kwd>
        <kwd>interaction models</kwd>
        <kwd>profiles</kwd>
        <kwd>diversity</kwd>
        <kwd>user experiments</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Despite the growing use of generative AI in various domains [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], connecting people to help
them solve their problems and enrich their interactions will always be imperative. [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] shows
that Stack Overflow’s trafic went down 14% in March 2023, due to people moving to ChatGPT
for finding answers. However, this is not sustainable, as ChatGPT finds ‘good’ answers only
because it trains on ‘good’ data, such as that provided by Stack Overflow. We argue that data
lfow from us humans will always be key. Similarly, finding support in fellow humans will
always be indispensable.
      </p>
      <p>The WeNet project attempts to address the issue of connecting people to help them find
support with their day to day problems. While there are many platforms that do so today,
leveraging AI to find suitable people to connect to is still lagging. In this paper we focus on the
issue of mediating humans’ online interactions to ensure online behaviour unfolds according
to expectations. As we focus on humans and their needs, our work has been motivated by: 1)
empowering users, by giving them control over some of the technology’s functionalities, yet
ensuring crucial basic requirements are not broken; 2) connecting people, by developing profile
matching mechanisms that leverage profile diversity; and 3) aligning users’ understanding of
the norms to ensure community members have a clear understanding of the norms mediating
their interactions. We thus contribute to the hybrid machine-artificial intelligence field through</p>
    </sec>
    <sec id="sec-2">
      <title>2. A Declarative Approach for Modelling Interactions</title>
      <p>
        The proposed WeNet interaction model [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ] tackles the issue of empowering users by
considering both, user requirements and system (or organisational) requirements. This gives users
control over some functionalities (such as specifying what profiles are deemed relevant), while
ensuring crucial basic requirements are not violated (such as ethical requirements and avoiding
biases). These requirements that are mediating interactions are specified through declarative
norms [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">5, 6, 7</xref>
        ].
      </p>
      <p>Following a declarative approach for norm representation allows for dynamic norms that
can change at runtime. This has proven to be useful in our pilots as we could continue to
tweak online behaviour (through norms) even after the app’s deployment into production. For
our plans for future work (Section 6), we plan to learn and adapt the norms at runtime. This
highlights further the need for a declarative approach.</p>
      <p>The language used to specify norms is based on a simple if then statement structure. The
conditions are selected from the developed application’s variables, allowing the norms to check
issues such as if a question has been created, answered, etc., or whether certain profile attributes
satisfy certain requirements. Similarly, the consequences are also based on the the application’s
acceptable actions, such as sending messages, updating a profile, etc.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Leveraging Diversity when Selecting Profiles</title>
      <p>
        Connecting people is another of the main objectives of WeNet. We especially focus on leveraging
diversity when selecting the profiles to tackle a given issue [
        <xref ref-type="bibr" rid="ref10 ref8 ref9">8, 9, 10</xref>
        ]. However, we ask the
person making a question, the questioner, to decide which diversity dimensions are relevant
for their question. We believe that diferent diversity dimensions might be suited for diferent
contexts.
      </p>
      <p>We choose to focus on four diversity dimensions: selecting profiles based on their domain
interests, beliefs and values, social closeness, and physical closeness. Notice that we focus on
what we refer to as deep features to avoid potential biases from arising when allowing the
questioner to filter profiles based on shallow features like gender or nationality. Nevertheless,
the WeNet project developed a diversification mechanism based on shallow features, to ensure
that selected profiles are suficiently diverse with respect to a given shallow feature, like gender.</p>
      <p>How the above diversity dimensions are used in the diferent pilots to leverage diversity is is
domain dependent, and it is the norms that dictate how those are used.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Norm Alignment through User Feedback</title>
      <p>
        Ensuring community members have a clear and aligned understanding of the norms that mediate
their interactions is another issue that we have focused on. Say there is a norm that prohibits
hate speech. We argue that what is considered hate speech might change from one community to
another, or even change over time. As such, we have developed learning mechanisms [
        <xref ref-type="bibr" rid="ref11 ref12 ref13">11, 12, 13</xref>
        ]
that allow the system to understand the meaning of norms (say what constitutes hate speech)
from people’s interaction and their feedback. It can then use what it learned to guide users’
actions by highlighting when they violate certain norms and why.
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Pilots</title>
      <p>We have developed a number of pilots across diferent sites: London School of Economics (LSE),
Aalborg University (AAU), and the National University of Mongolia (NUM). The objective was
for students to use our developed application to find other students that can help answer their
questions.</p>
      <p>The diversity dimensions were defined diferently for each of the pilot sites, and how the
norms leveraged all diversity dimensions also varied from one pilot site to another, based on
each site’s requirements. For example, LSE gave diferent weights to the diferent dimensions
while AAU and NUM did not, although they did specify that some diversity dimensions were
primary while others were secondary, where requirements on primary dimensions should be
satisfied first. Furthermore, social closeness was interpreted and implemented diferently at
each site.</p>
      <p>Figure 1 presents some of the results of the AAU pilot. The results of the other pilots
are aligned with those of AAU. The  -axis presents the number of selected profiles with the
corresponding matching score ( -axis), or the score that describes the degree of a profile of
(a) Satisfaction of diversity requirements w.r.t.</p>
      <p>domain interests
(b) Satisfaction of diversity requirements w.r.t.</p>
      <p>beliefs and values
(c) Satisfaction of diversity requirements in
gen</p>
      <p>eral
satisfying the diversity requirements. The graphs follow a logarithmic scale.</p>
      <p>The results highlight the capability of diversifying selected profiles using declarative norms.
Diferent iterations of the pilots illustrated that the larger the communities, the easier it was to
ifnd profiles that fit the diversity requirements. We are confident that even larger community
sizes would result in even better profile matches. (Community size in the last iteration whose
results are presented here were at 105 users at LSE, 51 users at AAU, and 115 users at NUM.)
Finally, the exit survey highlighted the users’ satisfaction with the diversity dimensions and
appreciated their value opportunity.</p>
    </sec>
    <sec id="sec-6">
      <title>6. Conclusions and Future Work</title>
      <p>The pilots, first and foremost, showcased the power of a declarative approach to norm
specification. Even when the deadline has passed for developing the app and moving it to production, we
continued to be able to adapt some functionalities through declarative norms that can change
at runtime.</p>
      <p>The norms opened the door for users to specify their diversity requirements. For a given
question to be put forward in a community, the questioner had the option to choose whether
they were interest in looking for similar/diverse profiles with respect to domain interests and
beliefs and values, as well as close/distance profiles with respect to social and physical distance.
The norms also implemented some fixed requirements, such as sending a question to five users
only, and diversifying the final list of potential responders with respect to gender. The results
of these pilots showed that the larger the communities, the easier it is to leverage diversity.</p>
      <p>Explainability has emerged as a key requirement for users to understand how the norms
and the diversity requirements function. The last pilot iteration demonstrated the success
of explainability, though it also highlighted the challenges of explaining complex algorithms
to users. A trade-of needs to be made when it comes to the details versus the clarity of the
explanations.</p>
      <p>The interest in leveraging diversity was limited, despite the fact that the exit survey has
illustrated that users did in fact find value in those diversity requirements. As such, we strongly
believe that diversity requirements are very much context dependent. When applicable, their
value is appreciated. Though further research is needed to analyse the applicability per context.</p>
      <p>Last, but not least, the pilots have highlighted the dificulty in predicting which norm
interpretation is applicable for diferent contexts. For example, when should social closeness depend
on past relations, and when should it depend on coming from similar academic circles? How
many users should receive a question to guarantee good enough answers are collected, yet users
are not bombarded with numerous questions? We believe that feedback is key in answering
these questions. Furthermore, addressing those questions may be automated.</p>
      <p>We argue that our work on developing mechanisms that allows the system to understand the
meaning of norms (say what hate speech means) from people’s interaction and their feedback
can provide the basis for the next steps in our research, which we believe should focus on
using such mechanisms to learn the most suitable norm for a given community. For example,
analysing interaction data and user feedback can help learn the best number of people to forward
a question to in a given community. And this number can be adapted to diferent communities.
One may also learn which meaning of social closeness do users prefer and under what context.
This can help to automatically adapt the interpretation and specification of norms for diferent
contexts.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <p>This research is supported by the EU funded VALAWAI (# 101070930) and WeNet (# 823783)
projects, and the Spanish funded VAE (# TED2021-131295B-C31) and Rhymas (#
PID2020113594RB-100) projects.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Y. K.</given-names>
            <surname>Dwivedi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kshetri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Hughes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. L.</given-names>
            <surname>Slade</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Jeyaraj</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. K.</given-names>
            <surname>Kar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. M.</given-names>
            <surname>Baabdullah</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Koohang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Raghavan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Ahuja</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Albanna</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Albashrawi</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. S. AlBusaidi</surname>
          </string-name>
          , J. Balakrishnan,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Barlette</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Basu</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Bose</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Brooks</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Buhalis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Carter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Chowdhury</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Crick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. W.</given-names>
            <surname>Cunningham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. H.</given-names>
            <surname>Davies</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. M.</given-names>
            <surname>Davison</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Dé</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Dennehy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Duan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Dubey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Dwivedi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Edwards</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Flavián</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gauld</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Grover</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.-C. Hu</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Janssen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Jones</surname>
            , I. Junglas,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Khorana</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Kraus</surname>
            ,
            <given-names>K. R.</given-names>
          </string-name>
          <string-name>
            <surname>Larsen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Latreille</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Laumer</surname>
            ,
            <given-names>F. T.</given-names>
          </string-name>
          <string-name>
            <surname>Malik</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Mardani</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Mariani</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Mithas</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <string-name>
            <surname>Mogaji</surname>
            ,
            <given-names>J. H.</given-names>
          </string-name>
          <string-name>
            <surname>Nord</surname>
            ,
            <given-names>S. O</given-names>
          </string-name>
          <string-name>
            <surname>'Connor</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Okumus</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Pagani</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Pandey</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Papagiannidis</surname>
            ,
            <given-names>I. O.</given-names>
          </string-name>
          <string-name>
            <surname>Pappas</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Pathak</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Pries-Heje</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Raman</surname>
            ,
            <given-names>N. P.</given-names>
          </string-name>
          <string-name>
            <surname>Rana</surname>
            ,
            <given-names>S.-V.</given-names>
          </string-name>
          <string-name>
            <surname>Rehm</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Ribeiro-Navarrete</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Richter</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Rowe</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Sarker</surname>
            ,
            <given-names>B. C.</given-names>
          </string-name>
          <string-name>
            <surname>Stahl</surname>
            ,
            <given-names>M. K.</given-names>
          </string-name>
          <string-name>
            <surname>Tiwari</surname>
            , W. van der Aalst, V. Venkatesh, G. Viglia,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Wade</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Walton</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Wirtz</surname>
          </string-name>
          , R. Wright, “
          <article-title>so what if chatgpt wrote it?” multidisciplinary perspectives on opportunities, challenges and implications of generative conversational ai for research, practice and policy</article-title>
          ,
          <source>International Journal of Information Management</source>
          <volume>71</volume>
          (
          <year>2023</year>
          )
          <article-title>102642</article-title>
          . URL: https://www.sciencedirect.com/science/article/pii/S0268401223000233. doi:https://doi.org/10.1016/j.ijinfomgt.
          <year>2023</year>
          .
          <volume>102642</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D. F.</given-names>
            <surname>Carr</surname>
          </string-name>
          , Stack Overflow is ChatGPT casualty: Trafic down 14% in March, similarweb (
          <year>2023</year>
          ). URL: https://www.similarweb.com/blog/insights/ai-news/stack-overflow-chatgpt/, last accessed on 21-05-
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>N.</given-names>
            <surname>Osman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Sierra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chenu-Abente</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Shen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Giunchiglia</surname>
          </string-name>
          ,
          <article-title>Open social systems</article-title>
          , in: N.
          <string-name>
            <surname>Bassiliades</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Chalkiadakis</surname>
          </string-name>
          , D. de Jonge (Eds.),
          <source>Multi-Agent Systems and Agreement Technologies - 17th European Conference, EUMAS</source>
          <year>2020</year>
          ,
          <article-title>and</article-title>
          7th International Conference, AT 2020, Thessaloniki, Greece,
          <source>September 14-15</source>
          ,
          <year>2020</year>
          , Revised Selected Papers, volume
          <volume>12520</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2020</year>
          , pp.
          <fpage>132</fpage>
          -
          <lpage>142</lpage>
          . URL: https://doi. org/10.1007/978-3-
          <fpage>030</fpage>
          -66412-
          <issue>1</issue>
          _9. doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -66412-1\_9.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>N.</given-names>
            <surname>Osman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chenu-Abente</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Shen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Sierra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Giunchiglia</surname>
          </string-name>
          ,
          <article-title>Empowering users in online open communities</article-title>
          ,
          <source>SN Comput. Sci. 2</source>
          (
          <year>2021</year>
          )
          <article-title>338</article-title>
          . URL: https://doi.org/10.1007/ s42979-021-00714-5. doi:
          <volume>10</volume>
          .1007/s42979-021-00714-5.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>H.</given-names>
            <surname>Verhagen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Neumann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <article-title>Normative multiagent systems: Foundations and history</article-title>
          , in: A.
          <string-name>
            <surname>Chopra</surname>
          </string-name>
          , L. van der Torre, H. Verhagen, S. Villata (Eds.),
          <source>Handbook of Normative Multiagent Systems</source>
          , College Publications,
          <year>2018</year>
          , p.
          <fpage>3</fpage>
          -
          <lpage>25</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>G.</given-names>
            <surname>Andrighetto</surname>
          </string-name>
          , G. Governatori,
          <string-name>
            <given-names>P.</given-names>
            <surname>Noriega</surname>
          </string-name>
          ,
          <string-name>
            <surname>L. W. N. van der Torre</surname>
          </string-name>
          ,
          <source>Normative MultiAgent Systems</source>
          , volume
          <volume>4</volume>
          of
          <string-name>
            <given-names>Dagstuhl</given-names>
            <surname>Follow-Ups</surname>
          </string-name>
          ,
          <article-title>Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik</article-title>
          , Dagstuhl, Germany,
          <year>2013</year>
          . URL: https://drops.dagstuhl.de/opus/volltexte/2013/ 3997/. doi:
          <volume>10</volume>
          .4230/DFU.Vol4.12111.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>M. D'Inverno</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Luck</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Noriega</surname>
            ,
            <given-names>J. A.</given-names>
          </string-name>
          <string-name>
            <surname>Rodriguez-Aguilar</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Sierra</surname>
          </string-name>
          , Communicating open systems,
          <source>Artificial Intelligence</source>
          <volume>186</volume>
          (
          <year>2012</year>
          )
          <fpage>38</fpage>
          -
          <lpage>94</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A.</given-names>
            <surname>Georgara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Sierra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Rodríguez-Aguilar</surname>
          </string-name>
          ,
          <article-title>TAIP: an anytime algorithm for allocating student teams to internship programs</article-title>
          , CoRR abs/
          <year>2005</year>
          .09331 (
          <year>2020</year>
          ). URL: https://arxiv. org/abs/
          <year>2005</year>
          .09331. arXiv:
          <year>2005</year>
          .09331.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>Georgara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Rodríguez-Aguilar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Sierra</surname>
          </string-name>
          ,
          <article-title>Towards a competence-based approach to allocate teams to tasks</article-title>
          , in: F.
          <string-name>
            <surname>Dignum</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Lomuscio</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          <string-name>
            <surname>Endriss</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . Nowé (Eds.),
          <source>AAMAS '21: 20th International Conference on Autonomous Agents and Multiagent Systems</source>
          , Virtual Event, United Kingdom, May 3-
          <issue>7</issue>
          ,
          <year>2021</year>
          , ACM,
          <year>2021</year>
          , pp.
          <fpage>1504</fpage>
          -
          <lpage>1506</lpage>
          . URL: https://www. ifaamas.org/Proceedings/aamas2021/pdfs/p1504.pdf.
          <source>doi:10.5555/3463952</source>
          .3464140.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A.</given-names>
            <surname>Georgara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Rodríguez-Aguilar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Sierra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Mich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kazhamiakin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. P.</given-names>
            <surname>Aprosio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. R.</given-names>
            <surname>Pazzaglia</surname>
          </string-name>
          ,
          <article-title>An anytime heuristic algorithm for allocating many teams to many tasks</article-title>
          , in: P.
          <string-name>
            <surname>Faliszewski</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Mascardi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Pelachaud</surname>
          </string-name>
          , M. E. Taylor (Eds.),
          <source>21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS</source>
          <year>2022</year>
          , Auckland, New Zealand, May 9-
          <issue>13</issue>
          ,
          <year>2022</year>
          , International Foundation for Autonomous
          <source>Agents and Multiagent Systems (IFAAMAS)</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>1598</fpage>
          -
          <lpage>1600</lpage>
          . URL: https://www.ifaamas.org/Proceedings/aamas2022/ pdfs/p1598.pdf.
          <source>doi:10.5555/3535850</source>
          .3536047.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>T. F. dos Santos</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Osman</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Schorlemmer</surname>
          </string-name>
          ,
          <article-title>Learning for detecting norm violation in online communities</article-title>
          , in: A.
          <string-name>
            <surname>Theodorou</surname>
            ,
            <given-names>J. C.</given-names>
          </string-name>
          <string-name>
            <surname>Nieves</surname>
          </string-name>
          , M. D. Vos (Eds.), Coordination, Organizations, Institutions, Norms, and
          <article-title>Ethics for Governance of Multi-Agent Systems XIV</article-title>
          - International Workshop, COINE 2021, London, UK, May 3,
          <year>2021</year>
          , Revised Selected Papers, volume
          <volume>13239</volume>
          of Lecture Notes in Computer Science, Springer,
          <year>2021</year>
          , pp.
          <fpage>127</fpage>
          -
          <lpage>142</lpage>
          . URL: https://doi.org/10.1007/978-3-
          <fpage>031</fpage>
          -16617-
          <issue>4</issue>
          _9. doi:
          <volume>10</volume>
          .1007/978- 3-
          <fpage>031</fpage>
          - 16617- 4\_9.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>T. F. dos Santos</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Osman</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Schorlemmer</surname>
          </string-name>
          ,
          <article-title>Ensemble and incremental learning for norm violation detection</article-title>
          , in: P.
          <string-name>
            <surname>Faliszewski</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Mascardi</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Pelachaud</surname>
          </string-name>
          , M. E. Taylor (Eds.),
          <source>21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS</source>
          <year>2022</year>
          , Auckland, New Zealand, May 9-
          <issue>13</issue>
          ,
          <year>2022</year>
          , International Foundation for Autonomous
          <source>Agents and Multiagent Systems (IFAAMAS)</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>427</fpage>
          -
          <lpage>435</lpage>
          . URL: https://www.ifaamas.org/ Proceedings/aamas2022/pdfs/p427.pdf.
          <source>doi:10.5555/3535850</source>
          .3535899.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>T. F. dos Santos</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Cranefield</surname>
            ,
            <given-names>B. T. R.</given-names>
          </string-name>
          <string-name>
            <surname>Savarimuthu</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Osman</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Schorlemmer</surname>
          </string-name>
          ,
          <article-title>Crosscommunity adapter learning (cal) to understand the evolving meanings of norm violation</article-title>
          ,
          <source>in: 32nd International Joint Conference on Artificial Intelligence, IJCAI</source>
          <year>2023</year>
          , Macao, China,
          <source>August 19-25</source>
          ,
          <year>2023</year>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>